I promise you that you care SO MUCH more about your stutter that most perspective SOs will (especially if they take the initiative to get to know you). Make the issue known early, and you may be surprised at how little it matters. However, your insecurity and sensitivity about your speech may be off-putting. And yes, this is totally a chicken-egg problem.