It also happens to me with the word no. I think it’s because I am naturally sensitive and not of a people-pleaser so I don’t like to say no to people. Also, saying no usually comes after someone catches me off guard, and it shocks me. Such as in your situation when you didn’t know the person was approaching you.