The cause of this is probably that stuttering is a symptom of many other disorders/diseases as well; this makes it easier to assume a person with a stutter has some sort of limited mental capacity