Concepteffective branching factor
Effective Branching Factor
A concept in information theory and language modeling referring to the number of nearly equally plausible candidates at the next token position given a context. It is approximated by the entropy of the distribution and affects the acceptance rate of speculative decoding.
Timeline (last 90 days)
Oct 25
Effective branching factor is a concept in information theory and language modeling, referring to the number of nearly equally reasonable candidates at the next token position given the context, approximately characterized by the entropy of the distribution.
Unverified50%