He prolly knows something is going on, maybe not specifically a stutter, but hes not clueless to it. If he hasnt backed off by now i think ur fine.