Unverified50% confidenceFactExact time
DistilRoBERTa是RoBERTa的蒸馏版本，参数量减少40%但保留97%的性能
1
Sources
50%
Confidence
Long-term
Relevance
8/22/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedDistilBERT reduces BERT's parameter count by 40% through distillation, increases inference speed by 60%, and incurs only approximately 3% performance loss75% similarUnverifiedDistilBERT compresses BERT's size by 40% while retaining 97% of its performance.70% similarVerifiedModel distillation can compress parameter count to 1/10 of the original while retaining 70–80% of the original performance.63% similarVerifiedIf the accuracy per step is 95%, after 20 steps the overall accuracy will drop to approximately 36%.62% similarUnverifiedDistilBERT将参数量压缩至6600万（原版1.1亿），推理速度提升60%，精度损失不足3%61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/787175API
curl https://kongchang.com/api/v1/knowledge/claims/787175MCP
get_claim(id=787175)