Stutter is a complication, but it's dwarfed by the amount of all the other potential complications in relationship matters. Don't fixate on it. It sounds like you're somewhat familiar with your stutter already, but perhaps you're still letting it surprise you (by e.g. expecting fluency or thinking what you're doing is supposed to help, where it doesn't). Have you ever visited a speech therapist? It might be of benefit to you.