Unverified50% confidenceFactExact time

SwiGLU was proposed by Google researcher Noam Shazeer in 2020, combining the Swish activation function with GLU.

1

Sources

50%

Confidence

Long-term

Relevance

8/29/2026

First Seen

Sources

Training 3 LLMs from Scratch for $750: A Developer's Hands-On Retrospective

Related Entities

SwiGLUconcept Noam Shazeerperson Googlecompany

Related Claims

UnverifiedSGLang由UC Berkeley团队主导开发，是目前与vLLM并列的两大主流开源LLM推理框架之一55% similar Verified思维链（Chain-of-Thought）提示技术由Google Research于2022年提出55% similar Unverified2017年 Shazeer 等人发表于谷歌的《Outrageously Large Neural Networks》首次将门控MoE机制引入LSTM语言模型54% similar

Cite This Claim

Stable URI

https://kongchang.com/claim/819740

API

curl https://kongchang.com/api/v1/knowledge/claims/819740

MCP

get_claim(id=819740)