In the past if a person who I applied for a job for called and I did not want to deal with the phone I would just let them leave a message and then I would just go into the business either the same day or the next day and set up the interview. Talking face to face is just easier for me ( a lot less stuttering) Plus, it shows you really want the job if you go into the business after they call you to set up the interview. The luxury of doing that is not always there and sometimes it might even look bad on your part to do that, but if I could do I would do that to avoid the phone if I did not want to deal with it.