People care a lot less about your stutter than you think. That's something I've only recently realized. People care a lot more about all the baggage that comes along with it (anxiety, weirdness, etc.). If you already told him you stutter, then he won't react weirdly to you stuttering. People only get weirded out when you don't mention it. Go on that date, own your stutter, and just try to be present and have a good time. Best of luck