If you said, "I have a stutter, and I really don't like when people use this phrase to express that their original point was final." ...then you would have gotten downvoted less. But it looks like you either posed on an argument thread...or you were part of an argument...and people could have just downvoted you because you were replying with a contrasting opinion to the guy who was "winning" the argument.