Expired50% confidenceFactExact time
The Universal Transformer was proposed in 2018 and repeatedly applies the same Transformer block to the input sequence.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
7/2/2026
First Seen
Valid until: 9/30/2026(expired)
Sources
Related Claims
UnverifiedTransformer于2017年提出后被快速引入时序预测领域76% similarUnverifiedSwitch Transformer, proposed in 2021, simplified the number of experts routed to per token to 1.75% similarUnverifiedTransformers库的前身名为pytorch-pretrained-bert，于2018年前后发布74% similarVerifiedThe Transformer architecture was proposed in 2017 and has largely supplanted RNNs in the NLP domain.71% similarVerifiedGoogle's Switch Transformer, released in 2021, applied MoE at scale to Transformer language models, expanding model capacity to the trillion-parameter level.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/42797API
curl https://kongchang.com/api/v1/knowledge/claims/42797MCP
get_claim(id=42797)