Usually the looser your vocal cords are, the easier it is to speak. Maybe your vocal cords are tighter when you're loud making it harder to speak. I always try to speak softly, as this greatly helps my fluency. So yes, I experience this big time.