Give it a time. After 1 Month ask yourself "do I feel more confident that at the day 1?" If so, it will get only better. I can imagine that most of the time you will improve. Let´s say you stutter like crazy for 5 times. You will get "tired" of anxiety and start not to care that much about it anymore. At that point the fluency will improve and the stress will decrease, because "it can´t be worse anymore".