I feel you. My anxiety around speaking can definitely trigger my stutter to start but the cause is genetic through my dad's side. Managing the anxiety definitely helps to just relieve some of that tension when speaking. I think for me it was sort of an acceptance of the stutter as part of me and not something that needed to be "fixed" or "cured" but just understood/managed like anything else. I'd talk to a counselor or therapist to help with the stress and develop healthy coping mechanisms.