Pre-fill
A technique of pre-populating the opening content before the model generates a reply, forcing the model to continue from a specified position. It is used to eliminate redundant prefixes and to ensure that output formats are parseable.
Core Facts
Timeline (last 90 days)
The Pre-fill technique is to pre-fill content (such as a left curly brace) at the starting position of the model's answer, forcing the model to continue from that opening, thereby avoiding superfluous preamble output.
All Facts (2)
The Prefill phase is a compute-intensive operation, while the Decode phase is a memory-bandwidth-intensive operation.
90%UnverifiedThe Pre-fill technique is to pre-fill content (such as a left curly brace) at the starting position of the model's answer, forcing the model to continue from that opening, thereby avoiding superfluous preamble output.
50%