Unverified50% confidenceFactExact time
The evaluation method is three plain-text tasks corresponding to each skill, with each task answered both with and without the skill, each set repeated 3 to 10 times, and each answer scored 5 times.
1
Sources
50%
Confidence
Long-term
Relevance
10/19/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe tester lists three limitations: each skill has only three plain-text tasks written by the testing party; tool calls, media generation and deployment services were not tested; and there is only a single judge model.71% similarUnverifiedA single evaluation result (such as a 98% score) is based on a specific set of tasks, and performance gaps between models may differ on other tasks such as complex reasoning, long-text processing, and multi-turn dialogue.70% similarUnverifiedThe test designed 50 automatically verifiable tasks, divided into five categories: multi-step math computation, extracting JSON from order notes, classifying support tickets, conditional filtering and sorting, and strict-format writing, with 10 questions per category, each with a standard answer.70% similarUnverifiedThe recommended model selection approach is to test each model with three typical real-world tasks, recording whether each can be completed, how many revision rounds were needed, how long it took, and the total cost.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1065273API
curl https://kongchang.com/api/v1/knowledge/claims/1065273MCP
get_claim(id=1065273)