It is an impediment in as much as having blemishes is an impediment to attractiveness. People are driven towards cosmetics to overcome this impediment to attractiveness. When for a person, having self confidence would have more overall benefit. Same for stuttering, having the confidence to be able to communicate even with a stutter will do more for a person.