Is it just me?

Is it just me? No offense to anyone, but I absolutely hate it when people who don't stutter say that they know what you're going through, or that they're afraid to speak in front of people. Honestly, they don't know how good they have it. People who are fluent never have to worry about constant fear and anxiety in any conversation or social situation. If I didn't stutter, I know I'd be a different person, I know I'd be happier. Really, I just feel like my stutter is my biggest insecurity, and my greatest weakness.