I do this. I'm about as covert as you can get. However, yeah sometimes it seems like I'm rude because I butt in at weird times because that's when I can get the word out. A good friend I've known for 10 years had no idea I stutter so I guess people just think I'm weird with my timing and maybe a bit rude?