This is the exact same for me. I’m comfortable conversing with my family but I tend to stutter much more with them than with my friends or even strangers, however anxiety and nervousness worsens my stutter. Lol it’s weird.