Unverified50% confidenceBenchmarkExact time
In the expert listening evaluation, participants' preference rate was 49.3% for symbolic-planning outputs, 34.6% for non-planning generation, and the remaining about 16% had no preference.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/14/2026
First Seen
Valid until: 1/12/2027
Sources
Related Entities
Related Claims
UnverifiedWhen using the multi-agent verification process, MARCH's accuracy was suppressed to 4.4%, whereas when the same model was directly asked which solution was better, accuracy reached 43.7%.66% similarUnverifiedFormat effect: with the same content changed to Markdown format, 4 of 5 evaluators preferred Markdown over plain text at rates of 73% to 97%, while two human annotators had only a 57% preference rate on 30 sample pairs.66% similarUnverifiedIn 10%–25% of cases, reasoning about the hypothetical grader pulled the agent's work away from the user's original specification.66% similarUnverifiedFor inference serving, a patch that is functionally correct but causes a 30% drop in throughput is actually unacceptable, and performance should be incorporated as an evaluation dimension.64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1029289API
curl https://kongchang.com/api/v1/knowledge/claims/1029289MCP
get_claim(id=1029289)