Unverified50% confidenceBenchmarkExact time
In the HumanEval pass@1 comparison, phi-1-small (350M parameters) reached 45%, while Keera fine-tuned (97.5M parameters) reached 5.5%.
1
Sources
50%
Confidence
Long-term
Relevance
10/18/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedOn HumanEval, Keera's pretrained model achieved pass@1 of 3/164 (1.8%), and after fine-tuning 9/164 (5.5%).74% similarUnverifiedA 360M-parameter code model trained by the trifero.ai lab under Strife Technologies initially reported 26.8% pass@1 on HumanEval, and after removing instruction data overlapping with the benchmark, the true number was 22.6%.69% similarUnverified初版 Codex 采用约120亿参数规模，在 HumanEval 基准测试中达到 28.8% 的 pass@1 通过率66% similarUnverifiedThe original Codex achieved a pass@1 score of 28.8% on the HumanEval benchmark, whereas using GPT-3 directly yielded only 0%.65% similarUnverifiedThe best-performing model achieved 38.7% on pass@3, but only 5.9% on pass^3.63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1057721API
curl https://kongchang.com/api/v1/knowledge/claims/1057721MCP
get_claim(id=1057721)