Unverified50% confidenceFactExact time
all-MiniLM-L6-v2 is an open-source sentence vector model with 384 dimensions, a model size of approximately 80 MB, and can complete single-item encoding on a standard CPU with millisecond-level latency.
1
Sources
50%
Confidence
Long-term
Relevance
10/2/2026
First Seen
Sources
Related Entities
Related Claims
Unverifieddecode阶段的生成速度近似等于内存带宽÷模型大小，例如在内存带宽273GB/s的M4 Pro上运行4GB的Q4量化7B模型理论最大生成速度约68 tokens/s72% similarUnverified现代处理器L1缓存大小通常为32-64KB，延迟约4个时钟周期72% similarUnverifiedall-MiniLM-L6-v2 将文本压缩成 384 维稠密向量，模型体积约 80MB，底层基于 BERT 精简变体 MiniLM 通过知识蒸馏训练71% similarPartially VerifiedFor the 4-bit quantized version of a 7B parameter model, at least 8GB of memory and a modern multi-core CPU are typically required for smooth operation, with inference speeds of approximately 10–30 tokens per second70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/967188API
curl https://kongchang.com/api/v1/knowledge/claims/967188MCP
get_claim(id=967188)