I think it's more of a selective confirmation loop. I stuttered a lot in high school and when I see friends I haven't seen in years, they don't even remember I stuttered until we met up again. Then they go back to not caring. I think you may be projecting your own feelings on to others.