Unverified50% confidenceBenchmarkExact time
This Born-measurement Transformer achieves accuracy on the e-SNLI task comparable to a softmax Transformer of the same scale (76.98±0.17% vs 76.62±0.36%).
1
Sources
50%
Confidence
Long-term
Relevance
11/4/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedFixed-precision Transformer refers to a Transformer in which model weights and activations are quantized to a finite bit width (such as 8-bit or 4-bit), rather than the traditional 32-bit floating-point representation.70% similarUnverifiedTransformer invariants include shape invariants, numerical properties (such as the sum of each row of softmax output always equaling 1 and attention weights being non-negative), and equivariance/invariance.68% similarUnverifiedGrokking现象最早由Power等人在2022年的论文中报告,小型Transformer在模运算任务上训练准确率达到100%后,验证准确率在成千上万额外训练步骤后突然跃升至完美62% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1134207API
curl https://kongchang.com/api/v1/knowledge/claims/1134207MCP
get_claim(id=1134207)