Keep a close eye on him as he gets older, especially middle and highschool. Stutterers tend to get more self-conscious as they get into their teenage years. Great he doesn't think much of having a stutter and great you don't bring much attention to it. Maybe if speech therapy doesn't work or shows signs of improvement, consider talking with them to temporarily pause it until he is more receptive to it.