Sounds like you really havn't came to terms with your stutter. You claim it isn't a problem but you cannot answer without saying what is easiest to say, not what is true. You don't have to talk to cab drivers or anyone else. Give them a couple of short answers and 99% of the time they will get the hint you are not in the mood for conversation.