I get annoyed when people without fluency disorders say they stutter

I get annoyed when people without fluency disorders say they stutter I was put in speech therapy at 18 months old for mixed SSD (articulation disorder + phonological delay) and fluency disorder (stutter). I stayed in speech therapy until I turned 13 when they decided there was nothing more that could be done to help me. So I still stutter and I have difficulty pronouncing words with r, s, th, or z. Anyway, I've noticed I get very irritated when people say they've stuttered despite not having a fluency disorder. I know that they're using the word correctly, so I don't actually express my irritation, but I need advice on how to handle these feelings internally. It's just that, in my mind, there's such a big difference between stuttering and *having a stutter.* There are so many physical and behavioural symptoms that accompany having a stutter, and I guess I become bitter when I feel like my condition is being compared to a person just stumbling through their words because they're nervous. There's so much more to it than many non-stutterers are aware of! It's similar to how I feel when I hear people talking about depression as a mood. I have PDD and occasionally MDD as well, and it's difficult knowing people mean something completely different when they say they feel depressed. When I talk about my depression, it gets met with people saying they've felt depressed before too, but it's not the same thing. When I talk about having a stutter, it gets met with, "Don't worry. Everybody stutters. It's not a big deal." They think they're consoling me, but it only invalidates the struggles I've faced all my life. I don't expect anyone to just suddenly change their language. I know that words can mean more than one thing (ie. stutter as a verb vs the condition). So as I mentioned earlier, I would really appreciate it if people could offer me advice. I could really use tips on how to manage this frustration. I'm also a bit curious about whether anyone else has felt this way before.