Concept核采样 / top-p / nucleus sampling
Top-p Sampling
An LLM decoding strategy that samples the next token from the smallest set of tokens whose cumulative probability reaches a threshold p, balancing the diversity and coherence of generated text.
An LLM decoding strategy that samples the next token from the smallest set of tokens whose cumulative probability reaches a threshold p, balancing the diversity and coherence of generated text.