BenchmarkMBPP Plus
MBPP+
An enhanced version of the MBPP benchmark used to evaluate the Python code generation capabilities of large language models. It features more rigorous test cases and broader functional coverage compared to the original benchmark.
Timeline (last 90 days)
Oct 12
Saluki scored 78.0 on MBPP+, 67.5 on multi-step causal reasoning, and 80.0 on AIME, retaining 82%–85% of the original model's mathematical reasoning capability.
Unverified50%