[KongchangAI]
Benchmark

RMBench

A benchmark for evaluating memory-dependent capabilities in robot manipulation, testing how models utilize historical information.

Timeline (last 90 days)

Oct 21

On the memory-dependent scenario RMBench, UniWALM achieves a 34.5% success rate without any pretrained language or reasoning model, exceeding the 28.5% of Mem-0's keyframe-assisted setting.

Unverified50%
Oct 20

CondenseVLA achieves a 21.6% success rate on the memory-dependent RMBench benchmark.

Unverified50%
Oct 20

The 21.6% success rate on RMBench indicates that tasks relying on long-term memory or reasoning over multiple observations remain a weak point for CondenseVLA.

Unverified50%

All Facts (3)

Source Articles