I'm experiencing exactly the same scenario you're describing. I've been wondering however if part of what im experiencing as worse stuttering, is me having the confidence to try and say how I feel on the spot, talk to people I wouldn't have in ways i wouldn't have a few years ago when I had lower self esteem, whereas before I'd avoid most conversations when I could, and was more self conscious of being perceived as a stutterer.