It's because stuttering is a huge stressor. We don't have the capacity to deal with much else (when it's worst). But it's not like the struggle is a constant. We know it varies on its own, and we also know it's possible to bring down via e.g. speech therapy. That way, it won't be such a huge stressor, which should make the phone situation a bit more comfortable.