Speculative Sampling

An inference acceleration technique in which a small draft model generates multiple candidates in parallel, which are then verified in parallel by a target model. An accept-reject mechanism ensures that the output distribution matches the target model exactly; the approach is widely applied to accelerate inference in large language models and diffusion models.