No, being disliked have nothing to do with your stutter. Its just probably in your head. I have a mild/small stutter and i have friends. I have a classmate who stutter and is disliked. They now make fun of him and bully him for his stutter, but i wouldn't say they hate him because of his stutter, its for other reasons but because of them they bully him for his stutter. Hope that makes sense