Long Decode
A large-model decoding feature that supports an extremely long output window, allowing a model to output up to 1M tokens in a single response. Fully exploiting it requires framework-level support, such as continuationToken or the Interactions API.
Timeline (last 90 days)
Long Decode allows output of up to 1M tokens, making it one of the implementations with the largest output window among current frontier models.
The Interactions API supports a large number of new features, and can directly handle Long Decode in background mode.
Both paths for LangChainJS to adapt to Long Decode (continuationToken and Interactions API) depend on issue 11879 landing first, and the project's current priority is to release that fix as soon as possible.
All Facts (3)
Long Decode allows output of up to 1M tokens, making it one of the implementations with the largest output window among current frontier models.
50%UnverifiedThe Interactions API supports a large number of new features, and can directly handle Long Decode in background mode.
50%UnverifiedBoth paths for LangChainJS to adapt to Long Decode (continuationToken and Interactions API) depend on issue 11879 landing first, and the project's current priority is to release that fix as soon as possible.
50%