[KongchangAI]
Unverified50% confidenceFactExact time

config.json shows num_hidden_layers=40, compress_ratios with length 43 (three more than the number of layers), num_attention_heads=64, num_key_value_heads=1, head_dim=512, sliding_window=128, max_position_embeddings=1,048,576, kv_source_layer_ids=[2,8,14,20], and index_topk=512.

1
Sources
50%
Confidence
Long-term
Relevance
10/18/2026
First Seen

Sources

Related Entities

Related Claims

Cite This Claim

Stable URI
https://kongchang.com/claim/1061802
API
curl https://kongchang.com/api/v1/knowledge/claims/1061802
MCP
get_claim(id=1061802)