Sounds like an ego thing to me, like "I'm unique because of MY stuttering, that's my identity. You're not a stutterer, stop pretending that you are one and thus undermining my uniqueness and self-image".