If it really distresses you you could always try writing down on your phone / piece of paper where you're going and show it to the bus driver