[KongchangAI]
Unverified50% confidenceBenchmarkExact time

使用llama.cpp运行IQ3_XXS量化模型时,输出速度仅为15 tok/s,提示处理为100-120 tok/s,而自研引擎将同样量化提升到约65 tok/s输出、430 tok/s提示处理,接近4倍性能提升

1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
9/24/2026
First Seen
Valid until: 12/23/2026

Sources

Related Entities

Related Claims

Cite This Claim

Stable URI
https://kongchang.com/claim/948578
API
curl https://kongchang.com/api/v1/knowledge/claims/948578
MCP
get_claim(id=948578)