How am I supposed to work on my confidence?

How am I supposed to work on my confidence? Seriously, I've seen a lot of people that they have overcome their stutter by just ignoring people's comments. But how am I ever gonna be self-confident? I can't ignore people's reaction to my face and noises when I stutter nor can I ignore the time I take to say a sentence.