I can’t say whether to stay or not, but working that job as someone that stutters is absolutely awesome. If you do decide to leave this job, go to another job that involves speaking with the public, but not as much. Then you can still be able to express yourself frequently with strangers, and strengthen yourself.