To add on, even if you're neurotypical and have "no problems" to outsiders you may just be worried about saying the wrong thing, talking too much, or talking too little. There is literally so much (sub)conscious work that goes into a social situation. People are confusing and so no one can really guess what the other person thinks of them. I can totally see your POV though.