Similar experience here. I had to take more hours at work and was using coffee to keep myself alert, but I also noticed that my stutter got worse too. After 2 days off coffee I could feel my speech improving already. However my stutter isn't completely gone. I'm fine most of the time, but specific situations where I get anxious it tends to show up.