Unverified50% confidenceDecision RuleExact time
In Dreamer V1, the KL divergence term is used to constrain the distance between the posterior distribution q(z_t|h_t,o_t) and the prior distribution p(z_t|h_t); if the KL weight is too large, the posterior is forced to approach the prior, causing the latent variables to lose observational information (information loss), and if the weight is too small, the transition model cannot generate meaningful imagined trajectories from the prior (posterior collapse).
1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedIn Dreamer reproduction practice, the stochastic component of the latent state requires appropriate KL constraints: too strong loses information, too weak leads to posterior collapse; the imagination trajectory length and batch size together determine gradient quality, and both need to be adjusted according to the task.77% similarPartially VerifiedKL divergence D(p,q) describes how many extra bits are wasted when using an incorrect distribution q to encode data that actually follows distribution p, compared to using the correct distribution p.69% similarUnverified从KL散度角度看,每一代合成数据与真实分布之间的散度都在单调递增,且误差会在迭代中累积68% similarUnverifiedQuantization error has a non-uniform distribution characteristic; the Q/K/V matrices of the attention mechanism and the last few layers are more sensitive to quantization.66% similarUnverified该测试采用KL散度(KLD)作为客观量化指标,衡量量化后输出分布与BF16参考分布的偏离程度,KLD越低说明量化造成的信息损失越小66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1011063API
curl https://kongchang.com/api/v1/knowledge/claims/1011063MCP
get_claim(id=1011063)