HLE
A high-difficulty benchmark designed to evaluate AI model performance on expert-level academic tasks, assessing both the breadth and depth of a model's world knowledge.
Core Facts
Timeline (last 90 days)
GLM-5.3-Flash 在 DeepSWE v1.1 得63.4分，比 GLM-5.2 的46.2分提升17.2分；HLE 得55.3分。
High-Level Emulation (HLE) re-implements hardware functionality at a higher level of abstraction, whereas Low-Level Emulation (LLE) accurately simulates the behavior of every circuit in the original hardware on a cycle-by-cycle basis.
The Qwen4 preview version scored only 35.9 on the HLE reasoning leaderboard, losing to a competitor's enhanced version that scored 40.
AREX-2 achieved the following scores on deep research tasks: BrowseComp 84.0, HLE 52.6, GAIA 92.2, and DeepSearchQA 93.8
According to official statements, V4.1 Flash surpasses GPT-5.6 SOAR and Opus 5 on multiple benchmarks including Terminal Bench 2.1, DeepSWE 1.1, CyberGym, HLE, Automation Bench, and Agent's Last Exam.
On pure reasoning tasks, Qwen3 27B scores only 30.8 on HLE, notably behind Opus's score of 40.0.
On the HLE benchmark, COMED improved GPT-5.5's performance from 23.1% to 28.1%.
HLE (Humanity's Last Exam) is an extremely high-difficulty comprehensive knowledge test constructed by Scale AI in collaboration with numerous domain experts.
With context management enabled, Iris-mini achieves 82.2%, 84.8%, 86.9%, and 52.3% on BrowseComp, BrowseComp-ZH, DeepSearchQA, and HLE respectively.
DeepSeek V4.1 Flash scores lower than the previous version on GPQA, HLE, and other benchmarks.
2 more timeline events
All Facts (12)
DeepSeek V4.1 Flash scores lower than the previous version on GPQA, HLE, and other benchmarks.
75%UnverifiedQwen3.8-27B trails Claude Opus 4.6 on Terminal Bench, GPQA Diamond, and HLE benchmarks (73 vs 78.2, 89.2 vs 91.3, and 30.8 vs 40, respectively).
60%UnverifiedGLM-5.3-Flash 在 DeepSWE v1.1 得63.4分，比 GLM-5.2 的46.2分提升17.2分；HLE 得55.3分。
50%UnverifiedHigh-Level Emulation (HLE) re-implements hardware functionality at a higher level of abstraction, whereas Low-Level Emulation (LLE) accurately simulates the behavior of every circuit in the original hardware on a cycle-by-cycle basis.
50%UnverifiedThe Qwen4 preview version scored only 35.9 on the HLE reasoning leaderboard, losing to a competitor's enhanced version that scored 40.
50%UnverifiedAREX-2 achieved the following scores on deep research tasks: BrowseComp 84.0, HLE 52.6, GAIA 92.2, and DeepSearchQA 93.8
50%UnverifiedAccording to official statements, V4.1 Flash surpasses GPT-5.6 SOAR and Opus 5 on multiple benchmarks including Terminal Bench 2.1, DeepSWE 1.1, CyberGym, HLE, Automation Bench, and Agent's Last Exam.
50%UnverifiedOn pure reasoning tasks, Qwen3 27B scores only 30.8 on HLE, notably behind Opus's score of 40.0.
50%UnverifiedOn the HLE benchmark, COMED improved GPT-5.5's performance from 23.1% to 28.1%.
50%UnverifiedWith context management enabled, Iris-mini achieves 82.2%, 84.8%, 86.9%, and 52.3% on BrowseComp, BrowseComp-ZH, DeepSearchQA, and HLE respectively.
50%UnverifiedHLE (Humanity's Last Exam) is an extremely high-difficulty comprehensive knowledge test constructed by Scale AI in collaboration with numerous domain experts.
50%UnverifiedHLE (Humanity's Last Exam) is an extremely high-difficulty comprehensive reasoning benchmark jointly launched by Scale AI and multiple academic experts, covering dozens of disciplines including mathematics, physics, biology, philosophy, and law.
50%