Just look past their stutter and continue to talk to them. As someone who used to stutter a lot it was nice to have people who I could feel comfortable with. Over time my confidence improved a million times over.