As a person who speaks 2 languages "fluently" when I do not stutter, I can say that you are expecting too much from yourself. You will stutter in your new language just like your native language, and you will start with incoherent speech. Keep hitting it. Eventually you will be as fluent as you are in your native language. Once you get there is all about fluency techniques.