Yes, this used to happen constantly to me. I'd get all worked up - It got better for me as I got into my late 20s and early 30s - I think because I became less focused on myself/ on the stutter and I started going to ToastMasters where there's an improv/impromptu speaking component - this helped me get rid of the anxiety about speaking up in front of people in a very safe and encouraging environment.