DFlash
A speculative decoding acceleration paradigm in which an independent small draft model proposes blocks of candidate tokens in batches, and the main model then verifies them in parallel in a single forward pass, accepting matching portions and resampling non-matching portions. It can achieve a relatively high speedup ratio.
Timeline (last 90 days)
Nemotron 3.5 Bolt comes with a LiLiCorr drafter for speculative decoding, implemented via DFlash, with 7 speculative tokens by default in the vLLM configuration.
Qwen3.8-27B是稠密模型，全部270亿参数参与每个token的计算，依靠MTP头预测后续token并在单次前向中验证；Ornith 1.5采用MoE架构，每token仅激活约30亿参数，配合DFlash由小型草稿模型提议token块再由主模型校验。
MiMo-V2.6 has a built-in DFlash speculative decoding mechanism that can draft 7 tokens per step.
DFlash and DSpark have made targeted optimizations in draft generation efficiency and hardware adaptation, and may outperform classic solutions under specific models and workloads.
Speculative decoding has spawned multiple variants including Medusa (multi-head prediction), EAGLE (generating drafts using hidden states from early layers of the main model), and DFlash (hybrid layout optimization).
All Facts (6)
MTP与DFlash在架构上有本质不同，但都属于投机解码技术谱系
85%UnverifiedNemotron 3.5 Bolt comes with a LiLiCorr drafter for speculative decoding, implemented via DFlash, with 7 speculative tokens by default in the vLLM configuration.
50%UnverifiedQwen3.8-27B是稠密模型，全部270亿参数参与每个token的计算，依靠MTP头预测后续token并在单次前向中验证；Ornith 1.5采用MoE架构，每token仅激活约30亿参数，配合DFlash由小型草稿模型提议token块再由主模型校验。
50%UnverifiedMiMo-V2.6 has a built-in DFlash speculative decoding mechanism that can draft 7 tokens per step.
50%UnverifiedDFlash and DSpark have made targeted optimizations in draft generation efficiency and hardware adaptation, and may outperform classic solutions under specific models and workloads.
50%UnverifiedSpeculative decoding has spawned multiple variants including Medusa (multi-head prediction), EAGLE (generating drafts using hidden states from early layers of the main model), and DFlash (hybrid layout optimization).
50%