I'm the same way. People can hardly notice my stutter in a professional or formal environment. It's when I'm around my family or friends that it comes out strongly.