Unverified50% confidenceFactExact time
The strict exact-match metric requires that the set of root causes predicted by the model be exactly identical to the ground-truth set, with any over-reporting or under-reporting judged as wrong; 0.8519 means that about 85% of recorded-segment root cause combinations were fully hit.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
11/13/2026
First Seen
Valid until: 2/11/2027
Sources
Related Entities
Related Claims
Unverified13 matched document pairs are enough for the paired test to reach 80% statistical power at the 5% significance level, for detecting whether a certain set was trained on.71% similarUnverifiedIn imbalanced classification problems, a model can achieve very high accuracy even by predicting all samples as the majority class, so it is necessary to shift to more discriminative metrics such as precision-recall curves, F1 score, Matthews correlation coefficient, or AUC-ROC70% similarUnverifiedA single "trusted source" prompt caused 7 out of 8 tested models to reverse between 45% and 88% of their correct answers.69% similarUnverifiedRanked by question difficulty, persistence rate was 91.4% on the 60 questions that all models answered correctly, but only 73.5% on the 52 questions that at least one model got wrong, indicating that sycophancy tracks uncertainty.69% similarUnverifiedManual evaluation of a subsample of the BharatSynthQA dataset showed that 89.83% of the questions were correctly constructed.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1166355API
curl https://kongchang.com/api/v1/knowledge/claims/1166355MCP
get_claim(id=1166355)