I do the same. My father also came with his share of trauma. I don't think I stutter because of the trauma he caused me. I can see how he was also traumatized in his life, and unconsciously passes his neurosis on to me. No one is perfect. I stutter with him the most because he is the person whose opinion I care for the most. I feel like I'm letting him down with every stutter. He did cause some of this. He always tried to downplay it, and chalk it up as overthinking on my part. This stressed me out further as I made it to be my fault. He didn't understand it, but he hated to see me suffer. It hurt him too. I can't blame him for coping in that manner. He's not omnipotent. He's a man. I'm not perfect either. To some extent, you're resorting to avoidant behavior (unless your family is abusive), which isn't a solution as much as it is a symptom of the problem.