There’s “bad” as in the proportion of your speech that is affected by it, but then there’s “bad” relating to how it affects you. There are covert stutterers who very rarely stutter, but are deeply affected by it and feel their lives are ruined.