If you didn't stutter, he would have found something else to criticize. Actual decent people wouldn't be judgmental that way. You probably dodged a bullet