Concept
top_k
A sampling parameter in the decoding stage of large language models that directly truncates to the k candidates with the highest probabilities, controlling the degree of concentration in the output.
A sampling parameter in the decoding stage of large language models that directly truncates to the k candidates with the highest probabilities, controlling the degree of concentration in the output.