Yea I've felt this way too. Kinda like stuttering is the weakest part of you and it's the limiting factor. Unless you find a way to reduce your stuttering to a point where it no longer becomes an issue, it will also spoil the progress you make in other aspects of life. That's just what I've kinda realised. People might say that I'm just thinking this way cause I want everything in my life to be perfect. But I don't think its wrong to seek the most out of life.