Just say your not not confident talking on the phone just yet due to having a stammer, carry on as you are for a whole till maybe your more confident..