My stutter gets worse around people that I'm close to as well. I think it's because with people I don't know, I try harder to speak more slowly and to think of replacement words that don't trip me up as much. If I'm around family or close friends then I'm not as careful because they already know about my stutter and aren't as likely to notice.