Verified65% confidenceFactTime unknown
Meta's LLaMA series, Google's Gemma, Mistral AI's Mistral/Mixtral, and Alibaba's Qwen series are all supported in Transformers.
3
Sources
65%
Confidence
Long-term
Relevance
6/1/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedGoogle 的 Switch Transformer（2021）和 Mistral 的 Mixtral 8x7B（2023）都采用了稀疏 MoE 架构，即每次前向传播只激活少数几个专家67% similarUnverifiedGoogle's Switch Transformer and Mixtral 8x7B are classic representatives of the MoE architecture, and Qwen3, DeepSeek-V3, and others also adopt this architecture.65% similarUnverifiedSwitch Transformer and the Mixtral series have widely adopted the MoE architecture.63% similarUnverifiedSince its first release in 2023, the Qwen series has gone through multiple iterations and adopts a Transformer decoder-only architecture.60% similarVerifiedQwen (Tongyi Qianwen) is developed by Alibaba Cloud and is based on the Transformer Decoder architecture.60% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/32162API
curl https://kongchang.com/api/v1/knowledge/claims/32162MCP
get_claim(id=32162)