That’s why you have to tell them that you don’t want your words to be taken differently whether you stutter or not. Maybe even tell them you sometimes stutter on jokes. Then just keep telling the joke until you get through to it.