I think the confidence thing will come and go. I seem to recall days when I had forgotten about my stutter and would engage socially as I wanted, then others I would hold back.