Conceptnucleus sampling / 核采样
Top-P
大语言模型的采样参数,从概率最高的词开始累加直到累积概率达到P值,只从该子集中采样
Core Facts
All Facts (2)
Verified
Top-P (nucleus sampling) samples from the smallest set of tokens whose cumulative probability exceeds the threshold P, while Top-K selects only from the K candidates with the highest probabilities.
80%UnverifiedCoze's Top-P nucleus sampling mechanism starts from the highest-probability words and accumulates probabilities until the cumulative probability reaches the set P value, sampling only from those words.
60%