Unverified50% confidenceFactExact time

The theoretical entropy of three equally probable values is approximately log₂(3) ≈ 1.585 bits, which is the origin of the number "1.58-bit".

1

Sources

50%

Confidence

Long-term

Relevance

9/16/2026

First Seen

Sources

Breaking the 1.58-Bit Barrier: How Ternary LLMs Approach the Information-Theoretic Limit

Related Entities

信息熵concept 1.58-bitconcept

Related Claims

UnverifiedBitNet b1.58采用三值量化，每个权重取-1、0或+1三个值，即log₂(3)≈1.58 bit68% similar Unverified常用的量化校准算法包括MinMax、Entropy（基于KL散度）和Percentile三种58% similar Unverified4-bit量化只能表示16个离散值，1-bit只有2个，三元量化（-1/0/+1）只有3个可能值57% similar UnverifiedKoch雪花曲线的分形维数约为1.26，精确值为log4/log357% similar

Cite This Claim

Stable URI

https://kongchang.com/claim/927932

API

curl https://kongchang.com/api/v1/knowledge/claims/927932

MCP

get_claim(id=927932)