My past girlfriend used to say the same thing. I think some girls find it endearing because it’s a reminder of innocence in a guy. I wouldn’t take it the wrong way at all. Clearly it doesn’t bother her which is a great first step. If she starts saying things like “aww” while you stutter then that’s where I would draw the line, personally.