Yes. It's bad enough that there are so many misconceptions about stuttering in society. It's sad that even so many people who have a stutter think that it's confidence related. Like you said, it's basically a neurological disorder. And while anxiety or self-consciousness can impact or exacerbate stuttering, it is NOT the cause of it. Think of it this way, even Tourette's Syndrome becomes worse with anxiety. That is very common in many conditions even those which are not psychological in nature. The most important thing is to accept that you have a speech disorder. It's not in your control, it's okay to stutter.