Unverified50% confidenceFactExact time
Oído's int4 variant can be compressed to a size of 8.3 MB.
1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedQ3_K_M compresses each weight to approximately 3 bits, reducing the weight size of a 27B model to approximately 12–13 GB.73% similarUnverifiedUnder hardware conditions of 16 GB of memory, only models within 5 GB can be accommodated, so the developer used the Qwen 2.5 7B 4-bit quantized model, which is approximately 4.8 GB in size, with an 8K context window.71% similarUnverified开发者提供五种量化格式：INT8 ConvRot(4.5GB)、FP8 E4M3(4.2GB)、bf16(8.3GB)、NVFP4(2.9GB)、MXFP8(4.7GB)70% similarUnverifiedA 70B model can be compressed to approximately 35GB at INT4 precision.70% similarVerifiedEven compressing the weights to 214GB using 4-bit quantization still far exceeds the capacity of a single 48GB GPU.70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1001253API
curl https://kongchang.com/api/v1/knowledge/claims/1001253MCP
get_claim(id=1001253)