Unverified50% confidenceFactExact time
The evaluation metric is the mutual 10-nearest-neighbor matching rate between description embeddings and DINOv2 embeddings on 1000 photos in the test set, with random guessing at 0.010.
1
Sources
50%
Confidence
Long-term
Relevance
11/2/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe accuracy data in the test has an error margin of approximately ±8–10 percentage points at n=100 sample size (based on a 95% confidence-level binomial confidence interval).70% similarUnverifiedIn the Phase 1 post-hoc comparison, SAGE's evaluation results were compared against 105 human reviews from the original competition, yielding an ordinal consistency of kappa = 0.29, which falls in the "fair" range.68% similarUnverifiedThe scoring method was a weighted detection score: clearly describing a bug earned full marks, merely mentioning it earned half marks, and missing it earned no marks; an independent AI Agent scored all nine reports without knowing the experimenter's scores, with differences of no more than half a point.67% similarUnverified在5%显著性水平下测试100个随机因子，期望会有5个看起来显著（多重假设检验问题）67% similarUnverifiedThe probe uses the paired-comparison statistic P: 10 no-harm scores are paired with 10 harm scores to form 100 pairs, and P is the proportion of pairs in which the harm version scores higher (ties count as half a pair); P≤0.20 or P≥0.80 is judged as leakage.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1127610API
curl https://kongchang.com/api/v1/knowledge/claims/1127610MCP
get_claim(id=1127610)