Unverified50% confidenceFactExact time
XLM-RoBERTa is a multilingual pre-trained language model released by Facebook AI, with the large version having about 560 million parameters; BGE-M3 is a multilingual embedding model released by the Beijing Academy of Artificial Intelligence with about 570 million parameters; multilingual-e5-large-instruct is a multilingual instruction-tuned version of Microsoft's E5 series with about 560 million parameters.
1
Sources
50%
Confidence
Long-term
Relevance
11/10/2026
First Seen
Sources
Related Entities
Related Claims
Unverified2006年Google翻译初始系统使用了一个在数万亿词文本上训练的5-gram语言模型,这很可能是世界上第一次万亿token规模的语言模型训练68% similarUnverifiedMeta's MMS (Massively Multilingual Speech) project has already covered pre-trained models for more than 1,100 languages.66% similarUnverifiedModern multilingual models such as mT5, BLOOM, and the Llama series are jointly trained on text in hundreds of languages, building cross-lingual semantic maps through shared vocabularies and cross-lingual attention mechanisms.65% similarUnverifiedBERT 在英文维基百科和 BookCorpus(共约 33 亿词)上进行了掩码语言模型(MLM)预训练65% similarUnverifiedQwen的参数规模从70亿到数千亿不等,训练数据涵盖中英文及多语言语料64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1153289API
curl https://kongchang.com/api/v1/knowledge/claims/1153289MCP
get_claim(id=1153289)