ProductBatch API
OpenAI Batch API
A batch inference API service provided by OpenAI that allows developers to package large numbers of requests for asynchronous processing. Compared to the synchronous API, it offers lower cost and higher throughput, making it suitable for large-scale batch processing scenarios such as content moderation and data annotation.
Timeline (last 90 days)
Oct 11
The OpenAI Batch API is a reasonable default when applications are built around OpenAI request shapes and structured output tooling, but applications are responsible for mapping output records back to the frozen list.
Unverified50%