Unverified50% confidenceBenchmarkExact time
On the Qwen3-14B and Gemma4-12B backbones, GUIDER outperforms CRPO, MRPO and FaithMed on the out-of-domain benchmarks AMEGA-LLM, RealMedQA and CancerGUIDE.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/30/2026
First Seen
Valid until: 1/28/2027
Sources
Related Entities
Related Claims
UnverifiedOn the BFCL tool-calling test, SmolLM3-3B scores 0.945, slightly above Gemma 4 E2B's 0.927, but the difference is not significant; Qwen3-4B (0.940), Qwen3-1.7B (0.935), Qwen2.5-1.5B (0.910), and Granite 3.3 2B (0.920) are all at the same level as Gemma.63% similarUnverifiedOpen-source models scored lower: Qwen3 235B scored 11/12, both sizes of Gemma 4 scored 9/12, DeepSeek R1 scored 7/12, and GLM-5 scored 5/12.60% similarUnverifiedThe test covered 8 local models: Qwen3's 0.6B, 1.7B, 4B, 8B, and 14B, as well as Gemma3's 1B, 4B, and 12B, all deployed via Ollama with thinking mode disabled.60% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1114143API
curl https://kongchang.com/api/v1/knowledge/claims/1114143MCP
get_claim(id=1114143)