Unverified50% confidenceFactExact time
Training with bfloat16 caused the model to collapse.
1
Sources
50%
Confidence
Long-term
Relevance
11/3/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe strategy of slowly fading out the rule-based tower failed; training collapsed immediately once the assistance disappeared.65% similarUnverified指令衰减(Instruction Decay)是指当上下文窗口逐渐被填满时,模型对早期系统指令或用户要求的遵循程度明显下滑63% similarUnverifiedThe 32k vocabulary collapsed at the 50M scale because its embedding matrix occupied nearly half of the model parameters and could not be adequately trained within 1,000 training steps.63% similarUnverifiedTraining the student model with pixel-level loss functions (L1+MSE) caused the output images to appear gray and flat, resembling an average of all possible results—a classic failure mode of regression-based losses on generative tasks.62% similarUnverifiedBehavior Cloning (BC) suffers from the covariate shift problem: during training the model only sees the state distribution of expert trajectories, and at deployment small errors can drive the robot into states not covered by the training set, leading to cascading failures.61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1129329API
curl https://kongchang.com/api/v1/knowledge/claims/1129329MCP
get_claim(id=1129329)