Speaking fluently would make me more carefree and remove lot of barriers and I would choose that every time and then try to build confidence myself, but since it's about confidence only then being carefree is the best choice.