Unverified50% confidenceBenchmarkExact time
On an internal benchmark of 2,843 multilingual customer service tickets, THX-01 achieved 98.4% accuracy, an ECE of 0.003, and a measured latency of approximately 10ms, outperforming TypeSafe Jev 1.13 (97.4% accuracy, ECE 0.007, latency 331ms).
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/12/2026
First Seen
Valid until: 1/10/2027
Sources
Related Entities
Related Claims
UnverifiedLaya achieves only 0.45 accuracy on the MASSIVE dataset covering 13 languages and only 0.425 on Banking77, while JAF reports 0.87 on the same tasks.69% similarUnverifiedIn Microsoft's internal evaluation covering 36 benchmarks and nearly 150,000 questions, Decision-1 ranked first with an average accuracy of 83.5%, surpassing Jev 1.13.0 (82.3%), Quyet-1.0-Large (81.9%), and GPT-6 Luna Decisions (79.4%).67% similarUnverifiedMicrosoft reported that Decision-1 achieved the highest accuracy in a comparison across 36 benchmarks covering nearly 150,000 questions, and claimed its P50 latency is approximately 35 times faster than GPT-6 Sol.65% similarUnverifiedIn the DistilBERT-to-DistilBERT configuration on the SST-2 dataset, the reliability-gated method achieved 88.800±0.532%, RAPID achieved 88.685±0.462%, both improving approximately 1.4 percentage points over the baseline of 87.271±0.162%65% similarUnverifiedIn a model comparison test, qwen2.5:3b correctly understood pace, produced 0 hallucinated place names, had a length error of 0.3%, peak memory of 259 MB, and took 106 seconds.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1005019API
curl https://kongchang.com/api/v1/knowledge/claims/1005019MCP
get_claim(id=1005019)