Unverified50% confidenceFactExact time
Gating projections are key components in the feed-forward network (FFN) or gated linear unit (GLU) structure of Transformer blocks; taking SwiGLU as an example, the FFN contains three matrices: the gate projection, the up projection and the down projection.
1
Sources
50%
Confidence
Long-term
Relevance
11/10/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedP³-WAM is a unified architecture containing three complementary modes—Perceive, Predict and Plan—that share the same video diffusion Transformer backbone.57% similarUnverifiedHuawei's Pangu-Weather adopts a 3D Swin Transformer architecture.57% similarUnverifiedVLM连接层设计包括线性投影、MLP投影器、交叉注意力(如Flamingo的Perceiver Resampler)或Q-Former(如BLIP-2)55% similarUnverifiedLLaVA、InstructBLIP、Qwen-VL等主流多模态架构采用冻结或微调视觉编码器+线性投影+文本LLM的三段式结构55% similarUnverifiedTransformer架构被引入视觉生成(如Vision Transformer、DiT架构),使模型能更好理解图像不同区域间的全局关系,适用于多模态场景中文本token和图像token的统一处理55% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1157637API
curl https://kongchang.com/api/v1/knowledge/claims/1157637MCP
get_claim(id=1157637)