This is absolutely a thing. It's not right that you have to disabuse people of their mistaken ideas or work harder to prove yourself, but it's life. A funny thing about my particular disorder. I've been told that one of the times that I'm absolutely fluent is when I'm angry or irritated. So anyone thinking I'm weak or passive need only treat me so to find out how wrong they are. Stand up for yourself, even if the words don't come out perfectly.