I work in medical records and have to be on the phone everyday. I would say to challenge yourself and stay with the job . The more practice you get, the more fluent you get. You can do it :)