As a woman, I can relate to this experience. In my opinion, a big factor here, aside from “pretty privilege,” is gender roles imo. Women who are quieter or stutter are often more accepted because society expects us to be demure, and when a woman is shy, it’s seen as “cute.” On the other hand, men who struggle in similar ways are more likely to be ridiculed because they don’t conform to the societal ideal of masculinity.