[KongchangAI]
Unverified50% confidenceFactExact time

Gating projections are key components in the feed-forward network (FFN) or gated linear unit (GLU) structure of Transformer blocks; taking SwiGLU as an example, the FFN contains three matrices: the gate projection, the up projection and the down projection.

1
Sources
50%
Confidence
Long-term
Relevance
11/10/2026
First Seen

Sources

Related Entities

Related Claims

Cite This Claim

Stable URI
https://kongchang.com/claim/1157637
API
curl https://kongchang.com/api/v1/knowledge/claims/1157637
MCP
get_claim(id=1157637)