OpenAI introduced the Structured Outputs feature in 2024, embedding JSON Schema constraints into the autoregressive sampling process and setting the probability of invalid tokens to negative infinity via logit masking, ensuring output format validity at the source