I experience that too and i think its bcs i be using brain energy on dealing with the stutter rather than focusing on the conversation.