I wouldn't say it is objectively annoying to listen to. I actually like hearing it. Most of my friends are people who stutter and I genuinely love hearing their stutter and listening patiently.