I didn't like discussing it for the longest time but I've worked through it. Now I make it clear that I'm open to questions about it and that I'm ok with repeating myself when necessary. Personally I think what you're describing may be some over thinking or over concern on your part, remember - most people don't take much notice, especially when the conversation is over.