I struggle with communicating with anyone in general, including women. There were times with certain women, where a relationship was possible, but my insecurity and attempt to avoid emotional intimacy regarding myself got in the way. A lot of that was due to my own attitude to my stutter, because I felt thoroughly ashamed of it. You should talk to these women anyway. They won't remember or judge you for stutter, particularly if you're confident and you get a conversation going. Even fluent people make speech blunders but they just brush it off.