Yeah definitely not ableist. It's like joking to ur friend about how they forgot something, doesn't mean ur making fun of people with Alzheimers.