I do not think that blame is the correct word. Some people just do not want to be with a person who stutters. Its their preference, and they are not shallow because of this unless they are mean about it of course.