Unverified50% confidenceSolutionExact time
SFT微调有效但导致小模型通用知识下降,即灾难性遗忘现象,因小模型容量瓶颈突出
1
Sources
50%
Confidence
Long-term
Relevance
8/29/2026
First Seen
Sources
Related Entities
Related Claims
Unverified跳过或简化校准步骤往往是低比特量化后模型质量大幅下滑的主因74% similarUnverified当模型超出显存容量时,系统被迫在显存与系统内存之间反复搬运数据,导致灾难性性能下降72% similarUnverified模型错误可归因于知识缺失、推理能力不足或指令跟随偏差,分别对应补充预训练数据、引入思维链训练数据和优化SFT数据分布等修复路径72% similarUnverified模型微调(Fine-tuning)面临成本高、更新慢、存在灾难性遗忘风险等问题70% similarUnverifiedRNN存在两大缺陷:无法并行计算导致速度慢,以及长距离依赖信息衰减的健忘问题70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/819750API
curl https://kongchang.com/api/v1/knowledge/claims/819750MCP
get_claim(id=819750)