Could be people that don't find it funny, or they think you're being sarcastic about having a stutter. Don't worry about it, just be aware some people take offense to off-color humor.