Sometimes I do, but just don't talk. Or just utter phrases I know I won't block too badly on. As a rule of thumb though, if you can stutter less than 10% of your words and don't do it too badly, no one will notice.