The same thing happens to me. My family is never mean about my stuttering but sometimes I don't like the way they respond, finishing my sentences and stuff, so that may be causing extra stress in my case.