I second this, this has been my experience too. I think it helps that I only surround myself with friends who just see my stutter as part of me and feel pretty neutral about it too.