I had somewhat the same experiences as you. For me it actually became worse with time. I also believe that men just don't like women who stutter or perceive them as mentally challenged. I'm not saying that is the case but it feels like that because there aren't many women who stutter and there is a lot of stigma and misinformation about stuttering. It is more common with men and it is more accepted for them I think.