When stuttering was a big issue in my life, I think the worst part was feeling like I was making my listener(s) uncomfortable or making them feel embarrassed