I totally agree with you that the fear of stuttering greatly contributes to a stutter itself. Being confident (and a fearlessness in what people will think if I stutter) can help reduce stuttering, improve confidence further thus reducing stuttering more etc. So practicing speaking is doing no harm at all but it’s practicing being in progressively more difficult situations that build confidence that will have lasting benefits.