Unverified50% confidenceFactExact time
LongMemEval is a public benchmark for evaluating long-term memory systems, constructing chat histories of about 50 conversation segments, with questions divided into dimensions such as knowledge updates, temporal reasoning, multi-session reasoning, assistant memory and user memory, and judging performed by an LLM via semantic comparison based on the official prompt.
1
Sources
50%
Confidence
Long-term
Relevance
10/16/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedLong-term memory evaluation benchmarks (such as LongMemEval and the MemGPT benchmark) assess five dimensions: single-hop information extraction, cross-session reasoning, knowledge updating, temporal reasoning, and abstention judgment.80% similarUnverifiedConversational recall benchmarks such as LoCoMo and LongMemEval measure question-answering ability over conversation history, rather than whether memory has changed the actual behavior of tool-using agents.79% similarUnverifiedLongMemEval focuses on long-context memory retrieval, requiring models to precisely locate specific facts within dialogue histories of tens of thousands to hundreds of thousands of tokens.79% similarVerifiedSession Service manages short-term memory at the conversation level (message history, tool call results, and intermediate reasoning states), while Memory Bank provides long-term memory capabilities across sessions.73% similarUnverifiedProduction-grade agents need to distinguish between short-term memory (current session context) and long-term memory (cross-session user preferences and historical facts).72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1048409API
curl https://kongchang.com/api/v1/knowledge/claims/1048409MCP
get_claim(id=1048409)