Assessing Episodic Memory in LLMs with Sequence Order Recall Tasks

Sequence Order Recall Tasks (SORT) evaluate memory for the temporal context of an experience: when information occurred and how events were ordered. The paper introduces Book-SORT and a human experiment validating the task on naturalistic long-term memory.

Recommended citation: Pink, M., Vo, V. A., Wu, Q., Mu, J., Turek, J. S., Hasson, U., Norman, K. A., Michelmann, S., Huth, A., & Toneva, M. (2024). "Assessing Episodic Memory in LLMs with Sequence Order Recall Tasks." arXiv:2410.08133. https://arxiv.org/abs/2410.08133