Unverified50% confidenceReleaseExact time
Switch Transformer was released in 2021, and Mixtral 8×7B was released in 2023.
1
Sources
50%
Confidence
Long-term
Relevance
9/15/2026
First Seen
Sources
Related Entities
Related Claims
Unverified"A Mathematical Framework for Transformer Circuits" was published in 2021.73% similarUnverifiedThe Universal Transformer was proposed in 2018 and repeatedly applies the same Transformer block to the input sequence.72% similarUnverifiedSwitch Transformer, proposed in 2021, simplified the number of experts routed to per token to 1.71% similarUnverifiedTransformers库的前身名为pytorch-pretrained-bert，于2018年前后发布71% similarUnverifiedVision Transformer (ViT) emerged in 2020, marking the entry of Transformers into the field of computer vision.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/922945API
curl https://kongchang.com/api/v1/knowledge/claims/922945MCP
get_claim(id=922945)