My stutter did not affect my nephew (so far). We live together and I stutter quite often with him (curiously, I was fluent with him when he was much younger). Don't worry!