My wife didn't care when i meet her, and my previous gf's too. When they like you, they simply just don't notice it ( and someone might think its cute). But for someone big part of not stuttering might be their confidence, in this case go for whatever it helps to build your confidence - gym, clothes etc. And as someone mentioned here before - smiling helps, just smile when you start talking, it helps me a lot! I wish i knew this a lot earlier.