My wife and I were going through our pre-marriage counseling through the church. I just met the priest and I stuttered, but then immediately said "sorry, I stutter." Right away he told me, do not ever apologize for that, this is who you are, you shouldn't feel sorry for it." If someone doesn't like hearing what you have to say, despite what it sounds like coming out, then that's their problem.