I so agree with this so much. Stick with the job. If I was in your position I would try to learn not to care what other people think (I realize that's not easy) and use this as a way to practice managing your speech. You will only get better if you practice managing it, however frustrating the situation might be you'll eventually get better. I tell myself that my self worth is not dependent on what other people think and intentionally put myself in harder situations.