Unverified50% confidenceFactExact time
Using the BAAI/bge-small-en-v1.5 model to generate 384-dimensional vectors, disk usage is about 33MB, running purely on CPU with no API key required.
1
Sources
50%
Confidence
Long-term
Relevance
10/17/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedRunning a 4-bit quantized version of TinyLlama-1.1B requires at least approximately 600 MB of memory, exceeding the hardware ceiling of most consumer-grade routers.70% similarUnverifiedall-MiniLM-L6-v2 is an open-source sentence vector model with 384 dimensions, a model size of approximately 80 MB, and can complete single-item encoding on a standard CPU with millisecond-level latency.70% similarUnverifiedQuantprobe claims to enable a machine with only 6GB of VRAM and 16GB of RAM to run 30B-class models at 22 tokens/s.68% similarUnverifieddecode阶段的生成速度近似等于内存带宽÷模型大小，例如在内存带宽273GB/s的M4 Pro上运行4GB的Q4量化7B模型理论最大生成速度约68 tokens/s68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1054542API
curl https://kongchang.com/api/v1/knowledge/claims/1054542MCP
get_claim(id=1054542)