Lots of plants have common names based on a supposed resemblance to another. Perhaps I was mistaken but I was thinking there's an eastern plant with rosemary as part of the common name that I suspected this may be. It's not a rosemary (Rosmarinus) itself. Another example would be bog rosemary (Andromeda polifolia).
I believe you have it! A photo might be worth a thousand words, but it does nothing for odor, or it would have been fairly easy to identify.
Slender Mountain Mint, yes. Thanks all for your efforts. I went back and shot it today. Couldn't find a good pix anywhere to ID this plant.