That's right, saying that someone needs to just calm down or just be confident is implicitly saying that stuttering is their fault. It is harmful and its unfortunately pervasive in the stuttering community.