You way over thinking this! it could just be you need to concentrate more on the road than talking to your instructor. Were you trying to look at him as you talked? I have never lost focus on driving while talking to people because of my stutter