My older brother has a severe stutter and he is married and just had his first child!! :) He also had multiple girlfriends in high school and college. Self esteem issues are common with people who stutter (I stutter as well but mine is not as severe as my brothers). I'd recommend getting into therapy to work all this out. I am sure there is a women out there who will love your personality, but she is not going to love you putting yourself down.