Blog

M-1 achieves state-of-the-art on BEAM at every scale, with a smaller model and fewer tokens

No other memory system holds the top score on both major benchmarks at every evaluated scale.

Jonathan Bree


M-1 (Mneme-1), now holds the top score on both major conversational memory benchmarks, LongMemEval and BEAM, at every evaluated scale. No other memory system has done this.


BEAM tests what happens when memory corpora get genuinely large: 100K, 1M, and 10M tokens. At 10M tokens, context windows cannot hold the corpus. The only path to a good score is retrieval that actually works.


M-1 scored 76.9% on BEAM-100K, 75.0% on BEAM-1M, and 68.0% on BEAM-10M, leading every other reported system at all three scales. As with our LongMemEval result, we used Gemini 3 Flash while every other system used Gemini 3 Pro, which is four to six times more expensive. M-1 also consumed approximately 20% fewer total tokens per query than the next best system.

M-1 (Gemini 3 Flash)
Hindsight (Gemini 3 Pro)
Honcho (Gemini 3 Pro)
30%41%52%63%74%85%100K1M10M

The competitive gap widens at the hardest scale: M-1 leads by 3.5 points at 100K and by 3.9 points at 10M. The gap getting larger when retrieval conditions are most challenging suggests that the architectural advantage becomes more pronounced, not less, as scale increases.


Benchmark

Scale

M-1 Score

Previous SOTA

LongMemEval

~115K tokens

96.4%

94.8% (Mem0)

BEAM-100K

100K tokens

76.9%

73.4% (Hindsight)

BEAM-1M

1M tokens

75.0%

73.9% (Hindsight)

BEAM-10M

10M tokens

68.0%

64.1% (Hindsight)


The consistency across different benchmarks and scales reinforces the finding from our earlier evaluation: retrieval architecture determines memory system quality more than model scale does. As context windows continue to grow, the case for precise retrieval only gets stronger, because a larger window gives you a larger container of text that the model cannot reliably reason through.


There is clearly more work to do, particularly on multi-session reasoning at extreme scale, which remains an open challenge for every memory system in the field. We will continue to share results as we improve.


Read the full research paper, methodology, and results here.