Each Resolve benchmark problem gives a Python function, one modification requirement, and two example inputs; the model can only return the rewritten function, and the hidden tests are divided into two groups, fail-to-pass and pass-to-pass, with the problem counted as solved only if both groups fully pass, and a single test failure zeroes the whole problem.