[KongchangAI]
BenchmarkAnthropic内部基准

AECI

A proprietary benchmark suite used by Anthropic for internal model evaluation, covering dimensions such as reasoning, coding, long context and tool use. It sets pass-rate thresholds as the basis for dividing capability tiers and is not publicly released.

Timeline (last 90 days)

Nov 10

According to the Meter report, versions such as Model 2, Model 3 and Model 4 exist inside Anthropic, and Model 4 has already fully exceeded 50% on Anthropic's internal benchmark AECI.

Unverified50%
Nov 10

AECI is a proprietary benchmark set Anthropic uses for internal model evaluation; it is not publicly released and covers dimensions such as reasoning, coding, long context and tool use.

Unverified50%
Nov 8

METR released an independent evaluation of Anthropic, stating that its models' capability improvement on well-defined tasks is about twice the previous rate from March 2024 to October 2025, and that AECI benchmark scores have been growing at 1.9 times the previous rate since October 2025.

Unverified60%
Nov 7

Meter's assessment found that the rate of capability improvement of Anthropic's models on well-defined tasks (such as tasks related to the AI R&D process) has reached about twice that of some previous historical interval, and the current rate may be closer to 1.3 to 3 times the historical rate.

Unverified50%

All Facts (4)

Source Articles