That is because we use our right hemisphere of our brain to compensate for the faulty left side. The right side also deals with emotions so it can handle speech when you are alone OK but it overloads when you are around others (esp authority figures).