People won't notice or care about your speaking style. For example, I don't stutter much anymore, but no one really mentioned it so far.