Yeah. There's also a historical factor too: in ancient times, stuttering probably was associated with some mental/physical impairment, thus it was easy to portrait people who stutter as "not normal" people.