PrefEval
A benchmark dataset for evaluating large language models' ability to memorize user preferences and perform personalized reasoning.
Timeline (last 90 days)
MemFold achieved the highest accuracy on every benchmark and every backbone model, tying only with the strongest baseline on a single cell of PrefEval.
MemFold achieves higher accuracy and lower overall cost on PersonaMem-128K, and ties with the strongest baseline on PrefEval.
MemFold's primary training scenario is persona-driven personalization tasks, but it can transfer to PrefEval and LongMemEval without target-domain training.
All Facts (3)
MemFold achieved the highest accuracy on every benchmark and every backbone model, tying only with the strongest baseline on a single cell of PrefEval.
50%UnverifiedMemFold achieves higher accuracy and lower overall cost on PersonaMem-128K, and ties with the strongest baseline on PrefEval.
50%UnverifiedMemFold's primary training scenario is persona-driven personalization tasks, but it can transfer to PrefEval and LongMemEval without target-domain training.
50%