The worst, for me at least, is when I manage to say something fine without stuttering or minimal stuttering and they go "huh?" and want me to repeat it.