Brain activity depends on external factors as well. Talking fluently by yourself (which some stutterers like myself don't do) doesn't mean that it's completely within your control. Even if it's not a physical imbalance, some psychological factors can't be changed either.