Everything is a matter of perception. We all say "I didn't get much sleep last night" when we know there are people not sleeping because bombs are falling out of the sky or they live on an empty stomach. The human brain isn't made to keep everyone's situation in mind at all times. It'll be beneficial for your mental health in the long run to try and let that go.