Depends. I'd understand if a person with a lisp or something complains. But if someone says "Oooh I'm soooo bad at small talk" then yeah I'd get annoyed.