Talk when people aren't paying full attention

Talk when people aren't paying full attention When I say something and the people is not paying attention atm, the phrase goes perfect and then you thought "great i didn't stutter" and the persons says "what did you say?" and then i start stuttering when i try to say the exactly phrase. What's happening? Do I feel more confident to speak when people are not paying attention to me?