Coming from a guy who stutters, tell him early. Try not to make a big deal of it. I usually try to say "sorry, I stutter" with a smile when the first inevitable block comes. It often looses the tension which hopefully also let your shoulders drop abit too. Honestly, most people don't care. They are usually only uncomfortable if they see you are. Good luck on your date.