On-Demand Loading
A context management strategy that does not preload all materials at the outset but instead acquires them on demand through search, file reading, or tool calls when the model determines they are needed, drawing on the idea of lazy evaluation from software engineering.
Timeline (last 90 days)
Lazy loading (Lazy Loading / Just-in-Time Retrieval) is a context strategy that does not stuff all relevant material into the window in advance, but instead retrieves it via search, file reading, tool calls, and other means when the model determines it is needed.
The cost of lazy loading is increased interaction rounds and latency, so a trade-off must be made between "preloading" and "on-demand retrieval."
All Facts (2)
Lazy loading (Lazy Loading / Just-in-Time Retrieval) is a context strategy that does not stuff all relevant material into the window in advance, but instead retrieves it via search, file reading, tool calls, and other means when the model determines it is needed.
50%UnverifiedThe cost of lazy loading is increased interaction rounds and latency, so a trade-off must be made between "preloading" and "on-demand retrieval."
50%