Plus, you're not going to go very far in most careers not speaking to the public. OP would really be limiting their potential and salary if they don't branch out and face the fear.