Unverified50% confidenceFactExact time
BERTimbau is a pretrained BERT model for Brazilian Portuguese, trained by the neuralmind team on large Portuguese corpora such as BrWaC, and comes in Base (about 110 million parameters) and Large (about 330 million parameters) versions.
1
Sources
50%
Confidence
Long-term
Relevance
11/11/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedBERT采用双向编码器架构,通过掩码语言模型预训练,随机遮盖15%的token并预测它们61% similarUnverifiedBERT-base 拥有约 1.1 亿参数,采用掩码语言模型(MLM)和下一句预测(NSP)两种自监督预训练目标,MLM 随机遮蔽输入文本中 15% 的词元60% similarUnverifiedThe process from training to inference of large models includes three stages: pre-training, fine-tuning, and inference.59% similarUnverifiedPretraining experiments were conducted on dense models with 160M and 400M parameters and on a MoE model with 135M activated parameters and 1B total parameters.58% similarUnverified2022年DeepMind发表了Chinchilla论文《Training Compute-Optimal Large Language Models》,由Jordan Hoffmann等人撰写,指出在给定计算预算下参数量与训练数据量需保持合理配比57% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1158015API
curl https://kongchang.com/api/v1/knowledge/claims/1158015MCP
get_claim(id=1158015)