Yes, yellow flowers, and the berrys are actually small round and purple. Looks like a match, thanks!
Here is a photo of one of the plants. There are no berries, they are sapplings.
The berries look like blackberrys and are red turning to dark blue or purple when ripe, semi sweet
I've been told this is a currant plant. It produces berries that my grandma used to make great pies with. I brought 3 of these from the old...