Stuttering itself is neutral, but different people react to it in different ways. I have heard experiences from men in this subreddit that echo both perspectives, some of their potential romantic partners have found stuttering to be cute, others have found it to be off-putting. I would assume that the stutterer's other characteristics may influence those reactions either way. Like everything else, the experiences of stuttering are not one-size-fits-all.