I've had exactly the same experience, but it got better for me over time. Maybe try to get friends or family to call you unannounced every now and then? I'd also consider visiting small stores during low business hours, good for practicing to talk spontaniously!