DeepSeek Flash 1017

A sparse mixture-of-experts (MoE) large language model released by DeepSeek, with 284B total parameters and 13B activated per token. It uses hybrid sparse plus quantized attention (HSQ-A) to compress the KV-cache and supports million-token-level long-context inference on a single GPU.