Unverified50% confidenceBenchmarkExact time
On the scientific claim verification benchmark, Qwen3 8B achieves the highest Macro-F1 (0.7937), Llama 3.1 8B reaches 0.7204, Mistral 7B reaches 0.6388, and the NLI baseline (DeBERTa-v3-base-mnli-fever-anli) reaches only 0.3157.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
11/3/2026
First Seen
Valid until: 2/1/2027
Sources
Related Entities
Related Claims
UnverifiedThe original Qwen3.5-0.8B has NLL of 2.905585 and PPL of 18.2759; Qwengram-0.8B has NLL of 2.853786 and PPL of 17.3534.74% similarUnverifiedAfter adopting a conservative fusion rule (outputting Support or Contradict only when the NLI and LLM judgments agree, and otherwise outputting Not Enough Evidence), Macro-F1 dropped to 0.7392 (Qwen3), 0.6730 (Llama 3.1) and 0.5991 (Mistral), all lower than the scores achieved when each was used alone.73% similarUnverifiedThe dataset covers four open-weight models — Qwen2.5-7B, Mistral-7B-v0.3, Phi-3.5-mini, and Qwen2.5-1.5B — with 30 trajectories each.71% similarUnverifiedIn the BioPhys-Bridge evaluation, Qwen3.7-Max's evidence ID F1 score is 0.316.69% similarUnverifiedOpen-source models scored lower: Qwen3 235B scored 11/12, both sizes of Gemma 4 scored 9/12, DeepSeek R1 scored 7/12, and GLM-5 scored 5/12.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1130817API
curl https://kongchang.com/api/v1/knowledge/claims/1130817MCP
get_claim(id=1130817)