That's why you should practice in non-threatening situations at first, e.g. reading aloud alone or even talking to a pet. That way you build "fluency memories" (a fancy term for confidence and self trust) and you can gradually increase the stress level of the situation.