Someone once told me “You only stutter because you lack confidence in yourself”

Someone once told me “You only stutter because you lack confidence in yourself” I’ve had confidence issues in the past, but I've gotten better. However, I still stutter. What do you guys think? Could it be deeper than that?