Long-term memory and KV cache solve problems at different levels: KV cache is a short-term computational optimization during inference, and the cache becomes invalid once the conversation is reset; long-term memory, by contrast, must decide which information is worth writing to persistent storage, in what structure to organize it, and how to retrieve it and inject it into context in subsequent conversations.