It’s called being a covert stutterer, and it’s definitely a more impactful aspect of stuttering. You may benefit from reading a recent post I made here.