Unverified75% confidenceFactTime unknown
K2-Vendor-Verifier使用固定输入测试集覆盖代码生成、推理、对话等多种任务类型进行验证
1
Sources
75%
Confidence
Long-term
Relevance
6/1/2026
First Seen
Sources
Kimi K2官方验证工具K2-Vendor-Verifier:一键检测API供应商模型精度
githubMoonshotAI
Related Entities
Related Claims
Unverifiedpass@k指标假设验证器能准确判断答案正确与否,在代码任务之外构建可靠的自动化验证器可能引入误差,且在推理逻辑连贯性评估上存在盲区67% similarUnverifiedK2-Vendor-Verifier通过logprobs、token级别一致性等指标来量化模型精度差异66% similarUnverified系统在测试点生成后和用例生成阶段均内置自动评审机制,并保留人工评审接口64% similarUnverified在k折交叉验证中,每一折的验证子集需保持原始状态,增强操作只能在对应训练子集上执行64% similarUnverified该提示词体系在国赛C题和电工杯B题上进行了实际测试验证63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/29551API
curl https://kongchang.com/api/v1/knowledge/claims/29551MCP
get_claim(id=29551)