My assumption is that the expressions we're using are tied to certain types or subtypes of communication, with different modes available to us (as a result of upbringing, learning, training, general social experience and such). Some expressions might carry meaning which puts them inside a type where we're less inclined to stutter on them in their typical use. Something like that. It's all very complex and variable, I'm sure.