From my experience and from talking to others who used to be terribly disfluent but have since gained near 100% fluency.. anxiety does have a pretty significant role. For me, I know I'd never stutter around my girlfriend but then put me in front of a crowd and ask me to introduce myself with all eyes pointed at me.. entirely different story.