BenchmarkMMMU-Pro
MMMU-Pro
An enhanced version of the MMMU (Multimodal Understanding) benchmark, focused on evaluating large multimodal models on expert-level tasks that require joint visual and textual understanding.
Timeline (last 90 days)
Oct 15
GPQA Diamond, MMLU-Pro, Humanity's Last Exam, SWE-bench Verified, Terminal-Bench, MMMU-Pro, LEXam, and Open ASR Leaderboard are all official benchmarks marked by Hugging Face as official benchmark.
Unverified50%