I'm pretty similar and most days I get don't have any trouble, I just stutter occasionally and never really feel like it's a big problem for me. I mainly just hate talking on the phone or ordering through speaker boxes. But when I was younger it was alot worse. I know the struggle of feeling like it's not worth even trying to talk to anyone because you aren't going to be able to say a word correctly and everyone is going to avoid you. If you haven't experienced the fear to even try to talk you definitely have a mild stutter. I wouldn't say you are lucky though. Maybe more fortunate then others. Just keep the optimism and confidence going. It's key to staying fluent.