I say don’t say anything and just deal with it. I have a mild stutter too and have often contemplated telling people at my new jobs about it but I never do and things always turn out fine. People get used to me having a speech block here and there and people rarely ever call me out on it. It’s just one of those things that people accept and then they (and you) move on.