Sometimes humour that makes light of oneself, when done intelligently, can be a great icebreaker. I've noticed it makes people feel more at ease, especially with stuttering. However, you are right, overusing self deprecating humour is not good either.