Not necessarily. When you are stressed, a very real physical reaction, such as stress hormones, are present. Something such as this has the ability to affect you, so with stuttering, it could be something similar.