same problem, recently i used to say it more than 3 times in my head then say it very calmly to the particular person it need practice because you don't have control on the exact minute when you should say it, but will improve eventually. (When i say practice I don't mean you need a year, one week or less of focusing on this problem only will be game-changing)