I'm the same way. One way I can improve public speech is by talking in the car on the way to work. Just for the recent muscle memory and confidence of hearing yourself fluent that day. Talk all you can when you're alone, gives the brain a baseline for what your speech should be. Most stutterers love being able to not speak, since speaking is so emotionally painful, but it's the only way to climb out.