I've gotten that a lot, or "having a case of the Mondays?" or when people phone me and I stutter on the answer, they often ask if now's a good time or if they woke me up. At this point I kind of revel in the "No, I stutter" response and the awkward moments for the other person after it.