Maze-Unique
Maze-Unique is a benchmark dataset for evaluating neural reasoning ability, consisting of maze puzzles that have a unique solution.
Timeline (last 90 days)
Sudoku-Extreme and Maze-Unique are "combinatorially solvable" closed-form puzzles: the state space is finite, the constraints are fully explicit, correctness can be verified exactly, and classical algorithms exist that can solve them efficiently.
When neural methods approach 100% accuracy on benchmarks such as Sudoku-Extreme and Maze-Unique, the benchmarks become saturated, making it difficult to distinguish the true reasoning ability of different methods.
All Facts (2)
Sudoku-Extreme and Maze-Unique are "combinatorially solvable" closed-form puzzles: the state space is finite, the constraints are fully explicit, correctness can be verified exactly, and classical algorithms exist that can solve them efficiently.
50%UnverifiedWhen neural methods approach 100% accuracy on benchmarks such as Sudoku-Extreme and Maze-Unique, the benchmarks become saturated, making it difficult to distinguish the true reasoning ability of different methods.
50%