My stutter is small enough to be judged as normal but big enough to be unlikable

My stutter is small enough to be judged as normal but big enough to be unlikable Does anyome experience this ? Like many times people judge me harsh as a non stutterer whenever i say something silly but i stutter enough so i cant make myself more likeable than my stuttering self