Positive affirmation isn’t always positive

Positive affirmation isn’t always positive I’ve noticed this is a very common mindset “If people aren’t willing to be your friend or give you opportunities solely because of your stutter, then those are people you do not want to associate yourself with anyways. It’s a reflection of their poor character, not yours.” I get the sentimentality behind it, but don’t you think that’s not fair? Are we just supposed to just accept missing on potentially great people or opportunities because we stutter? Settle for less? What if we never do? I have little to no real friends in real life because I stutter.