If I like the person, why not? I think that sometimes it will be difficult. I think that we feel/recognize the stress more then a non-stutterer. But also you understand each other, that's a plus :) But I'm married for 17 years with someone who doesn't stutter and it's okay :)