I'm an enthusiastic, fairly new gardener and am thoroughly delighted by flower and plant history and lore. I find I'm adding plants to my garden often after I've heard something intrigueing about its past.
If you like reading about the practical side of botany and history try Michael Pollan books like THE BOTANY OF DESIRE or a book by David Stuart on the history of common garden plants.