It’s very common for your fluency to briefly change when in a significantly different environment (around different ppl). I suspect if you stayed with them for longer, it wouldn’t last.