I hate speaking with strangers who try to have a casual conversations, like a cab driver asking me random questions

I hate speaking with strangers who try to have a casual conversations, like a cab driver asking me random questions I'm extrovert, always have been but my stutter draws me strongly back from it. As a kid I was always afraid to stutter, I thought people would see me as something very weird even though I dreamed of having long conversations with my friends and family. I'm 25 now and stuttering is not something negative really, it's just a big obstacle I wish wasn't there and thanks to the obstacle I mostly don't take part in conversations I would take part in if I did not stutter. ​ I just came home from taking a cab. The driver asked me random questions and thanks to social anxiety I also sort of blackout with my memory so most of the time I have no idea what to reply it with. If I'm uncomfortable I often answer with whatever is the fastest or easiest to say, even if it's not true. If I'm comfortable I can take my time, but that's rare with strangers.