How do you build confidence and self-esteem with a stutter?

How do you build confidence and self-esteem with a stutter? I'm down in the dumps at the moment and completely at my wit's end. I could easily go days without uttering a word if given the chance. I wish this weren't the case. I long to be more outgoing, but I feel constrained. I wish I could stutter openly and not have a care in the world what others think. Am I afraid of being judged or looking stupid? My life is a mess at the moment so I'm just sitting in my room all day. It honestly feels like I'm sat on the sidelines watching everybody live their life. :(