I've had experiences like this where I've told people I stutter and they're surprised and said they never noticed, at first I didn't believe them. I think because we know exactly when it happens and we feel the block of fluency and the tension we imagine it's worse than how it really looks.