Of course, we can. The fact is that we need to constantly practice communicating, primarily with strangers, in order to master the art of fluency. I don't believe it is a neurological issue for the reason you stated in your post.