I am only one?

I am only one? Has it happened that because of heavy stuttering you refuse to go to friends or to invitations that someone close to you has invited you to go? if yes, how are you coping with the feeling that friends or someone close to you called you, they will feel sad or maybe even lose respect for you because you didn't go to them, I have refused many requests and I don't even care if someone loses respect for me or not, I have come to a point where to say a word is like climbing several big hills, I don't care about anyone if they get upset or lose respect for me