LMEB: Long-horizon Memory Embedding Benchmark

Embedding models are increasingly used as retrievers in memory-augmented systems, but are typically evaluated on traditional passage retrieval benchmarks. It remains unclear whether models that excel at passage retrieval can retrieve fragmented, context-dependent, and temporally distant memories. To address this gap, we introduce the Long-horizon Memory Embedding Benchmark (LMEB), comprising 22 English datasets and 193 zero-shot retrieval tasks across four memory types: episodic, dialogue, semantic, and procedural. We benchmark 30 embedding models ranging from 33M to 12B parameters. We find that no single model dominates across memory types and that evaluation scores on LMEB correlate onl...

<iframe src="https://silytics.si/embed/item/1fc02895-bc3c-4f94-8dd7-12f7f5ffbd84" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 19 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.