I think you are right, I think most people are open minded. It is something that people would notice in the same way that they'd notice whether someone has a foreign accent. We all have some inner theory about what other people think when they meet us, even if we are not aware of it. It sounds like yours is realistic and not overly negative, that is a good thing.