Unverified50% confidenceFactExact time
三个状态的信息熵为log₂(3)≈1.58比特,因此三元量化也被称为1.58-bit量化
1
Sources
50%
Confidence
Long-term
Relevance
8/5/2026
First Seen
Sources
Related Claims
Unverified1.58-bit refers to each weight occupying an average of log₂(3) ≈ 1.58 bits, because ternary weights (−1, 0, +1) have 3 possible states.77% similarPartially VerifiedWhen using the base-2 logarithm, the unit of entropy is bits, and when using the natural logarithm, the unit is nats.68% similarUnverifiedSince 2024, 1-bit quantization (such as the BitNet series) has entered academic attention, compressing weights to ternary values {-1, 0, +1}, and it is currently still in the research stage66% similarUnverifiedBitNet探索的极端量化(如2-bit或1.58-bit三值量化)在某些场景下也能保持较好性能65% similarUnverifiedQ3 quantization means each parameter is stored using approximately 3 bits61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/692440API
curl https://kongchang.com/api/v1/knowledge/claims/692440MCP
get_claim(id=692440)