You summed this up very well. Anxiety, fear, doubt play a massive role in speaking. When you are more comfortable with getting judged or you know others won't judge you, you but a lot less pressure on yourself to speak fluently, so it comes out more naturally without the interference of fear, anxiety and doubt. Have you tried to work on the anxiety, fear, doubt aspect of speaking before?