That happens regardless of whether you strive for fluency or do nothing about it. That part of feeling down soon goes away over time.