IME it's fear. You may want to seek psychotherapy and maybe you and a therapist can figure out a way to tackle it. Try not to lose hope. It's hard trying to reverse decade(s) of behavior!