[KongchangAI]
Benchmark

Formal Conjectures

A formalized dataset containing publicly known mathematical conjecture problems, used to evaluate the ability of automated theorem proving systems to solve open problems.

Timeline (last 90 days)

Nov 17

Among 236 problems from Formal Conjectures, H1 using GPT 5.6 Sol solved 8 open conjectures, including variants of Erdos 138 and 337, 3 OEIS conjectures, the existence proof of the AME910 lattice in open quantum problem 35, and two conjectures from Written on the Wall 2.

Unverified50%
Nov 17

H1 discovered several formalization errors in Formal Conjectures, for example the formalization of the Poincare conjecture omitted an assumption, and H1 gave a counterexample to that incorrectly formalized proposition; these errors have been fixed upstream.

Unverified50%

All Facts (2)

Source Articles