I think it's because we have different levels of stuttering. Some severely, while others can control it and hide it but yeah I would say we are somehow rare. As a 26 years old dude, throughout my life I've only met 5 people who actually stutter and only one of these people was a female.