This is not something that necessarily comes with having a stutter. If you literally can't form memories, you really should go see a doctor/specialist of some sort. It might be an indirect result of stuttering, but at any rate, it shouldn't be that way. See if you can bring that sort of stress down.