I hate it when people tell me to "slow down"

I hate it when people tell me to "slow down" I know that they are trying to be helpful but I hate it. When I tie it feels like my stuttering becomes worst and that I'm speaking at a snails pace. What I need to do is stop, take a deep breath and restart the sentence to get through. When I was in speech therapy at school my speech teacher would tell me that the reason why I stutter is because I think to fast, that I need to slow down, but when I slow down my thoughts I am more likely to stutter. I feel like it would be better if people wait patiently. I can get more words out I just need time.