If you want to. “Sorry, I’ve always stuttered. It flares up when I’m nervous.” Or something of the sort. Or just let them figure it out for themselves. I don’t think it actually matters.