Does anyone else notice they need more time than their non stuttering peers to return to an emotional baseline?

Does anyone else notice they need more time than their non stuttering peers to return to an emotional baseline? Im 32 (f) Stress greatly impacts my stuttering and I notice after a traumatic event or any type of conflict it takes me a while to calm my nerves and come back to the situation. Otherwise I noticed I get very stressed and unable to speak. This makes me very conflict avoidant to the point where I feel I’m sometimes preyed on in the work environment. I noticed mean or toxic people will try to stress me out for their entertainment and seem to enjoy when I start stuttering as a result. Does anyone else experience this? Or am I being slightly paranoid?