I was the opposite and I stuttered a lot only when I'm nervous like giving speeches in front of the class but then I became exactly like what you described. I feel it's because with people you're nervous with your brain is working subconsciously and does the synonyms thingy where you swap words when you know you're going to stutter. If you observe what happens more closely next time, this would be it.