Why do non stuttering people think this?

Why do non stuttering people think this? Whenever soemone hears me stutter, even the doctors and speech therapists, they all just say I'm anxious. Like yes, it could stem from that but stuttering also comes from the subconcious fear of getting scolded for doing something wrong.