It will only bother others if you let it bother you. People don't care about your speech nearly as much as you think.