Yes, I think you are correct. It looks like mullein to me. Most likely it is Verbascum thapsus, although it could be a relative. Here's a link from Purdue University.