Unverified50% confidenceFactExact time
BERT appeared in 2018, and the GPT series was released between 2018 and 2024; these pre-trained language models transformed the technology stack that NLP practitioners must master.
1
Sources
50%
Confidence
Long-term
Relevance
8/17/2026
First Seen
Sources
文科生转型NLP：跨专业读计算语言学硕士值得吗？
Related Claims
UnverifiedBERT was proposed by Google in 2018 and is a bidirectional encoder; GPT was proposed by OpenAI in 2018 and is an autoregressive decoder.76% similarUnverifiedThe emergence of BERT and GPT in 2018 initiated the pre-training + fine-tuning paradigm75% similarVerifiedBERT's bidirectional encoding capability stems from the masked language model (MLM) objective used during its pre-training phase, which contrasts with the unidirectional autoregressive pre-training of the GPT series.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/762703API
curl https://kongchang.com/api/v1/knowledge/claims/762703MCP
get_claim(id=762703)