You see enemies where there are none. It sounds like you are taking your discomfort with your fluency and attributing it towards others. Stuttering isn't wrong. But it is an impediment. If you can find a way to overcome an impediment, why wouldn't you?