The bigger the deal you make it, the bigger the deal of telling him is. Just “heads up I do stutter, nothings wrong, just the way I talk”