Unverified50% confidenceFactExact time
config.json shows num_hidden_layers=40, compress_ratios with length 43 (three more than the number of layers), num_attention_heads=64, num_key_value_heads=1, head_dim=512, sliding_window=128, max_position_embeddings=1,048,576, kv_source_layer_ids=[2,8,14,20], and index_topk=512.
1
Sources
50%
Confidence
Long-term
Relevance
10/18/2026
First Seen
Sources
Related Entities
Related Claims
Cite This Claim
Stable URI
https://kongchang.com/claim/1061802API
curl https://kongchang.com/api/v1/knowledge/claims/1061802MCP
get_claim(id=1061802)