OpenProblems
A benchmark dataset for evaluating the performance of research agents on open problems, covering a range of research tasks.
Timeline (last 90 days)
The SwarmRSI framework comprehensively sets new SOTA across 118 tasks on the three benchmarks OpenProblems, NatureBench and MLEBench Lite.
With DeepSeek V4 Pro as the backbone, SwarmRSI achieves an average score of 74.2 on OpenProblems, exceeding the previous SOTA of 67.1.
After switching to Gemini 3.1 Pro Preview, SwarmRSI's score on OpenProblems rises to 76.2.
All Facts (3)
The SwarmRSI framework comprehensively sets new SOTA across 118 tasks on the three benchmarks OpenProblems, NatureBench and MLEBench Lite.
50%UnverifiedWith DeepSeek V4 Pro as the backbone, SwarmRSI achieves an average score of 74.2 on OpenProblems, exceeding the previous SOTA of 67.1.
50%UnverifiedAfter switching to Gemini 3.1 Pro Preview, SwarmRSI's score on OpenProblems rises to 76.2.
50%