I almost wanted to call this a Mulberry but their berries are more like blackberries. This looks soooo familiar. I just can't quite put the name to it.
Back to the drawing board. Here's a sequence of pics. The first is the early color. This next 2 shows a later color and one that is spikey looking on the same bush/tree.
Are you positive that these are on the same plant? The photograph with serrated leaves and a reddish fruit looks like Amelanchier of some sort. The photograph with the blue fruits has branches that continue to resemble Vaccinium to me. Lastly, the photograph of the spiky thing is some sort of gall - aberrant growth, caused by an insect or virus.
I think you're right about Amelanchier. And I think it's Amelanchier_alnifolia. http://en.wikipedia.org/wiki/Amelanchier_alnifolia Serviceberry? http://www.ecoterralandscape.com/images/serviceberry2.jpg These look an awful lot like it. I think you nailed it. Thanks!!