Expired50% confidenceFactExact time
Google released BERT in 2018, marking the beginning of the pre-training era.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
7/2/2026
First Seen
Valid until: 9/30/2026(expired)
Sources
Related Claims
VerifiedBERT was introduced by Google in 2018, a pioneering work in pre-trained language models, and was the first to adopt a bidirectional encoder architecture, setting new records on 11 NLP benchmark tests.73% similarUnverifiedSentencePiece由Google于2018年推出，支持无监督训练，无需预先进行空格分词，Google的T5、LLaMA等模型均采用其Unigram语言模型算法70% similarUnverifiedBERT was proposed by Google in 2018 and is a pre-trained language model based on the Transformer architecture.70% similarUnverifiedFederated learning was proposed by Google in 2016, originally to address privacy issues in model training on mobile devices.68% similarUnverifiedBERT was released by Google in 2018, employing bidirectional pre-training that randomly masks 15% of words via a masked language model and requires their restoration.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/41325API
curl https://kongchang.com/api/v1/knowledge/claims/41325MCP
get_claim(id=41325)