I actually experience this too!! I've only met like 2-3 other stutterers in my whole life and I was totally fluent when talking to them, they probably didn't even know I was a stutterer myself. It's really weird.