While there's still not a clear answer as to what role the brain plays in stuttering, having a stutter definitely effects you, psychologically. Does your stutter effect your social life? Perhaps you've grown more reserved and that makes you feel like you don't "fit in". Just remember that your stutter doesn't define you, and the people in your life certainly don't think of your as different for it.