Unverified50% confidenceFactExact time
GBNF 通过在每个 Token 生成步骤对 logits 进行掩码过滤，强制模型只能生成符合预定义语法规则的 Token 序列
1
Sources
50%
Confidence
Long-term
Relevance
7/14/2026
First Seen
Sources
本地7B量化模型信息抽取：难点分析与工程优化策略
Related Claims
Unverified自回归解码具有串行特性，每个Token的生成依赖前一个Token，难以并行69% similarUnverifiedConstrained Decoding computes the set of valid tokens at each token step of autoregressive generation based on a finite state machine or context-free grammar and renormalizes the probabilities, mathematically guaranteeing that the output conforms to the target schema.68% similarUnverifiedOutlines pre-compiles constraints into an FSM before inference and performs an offline mapping between the tokenizer vocabulary and each state of the FSM; during inference, hard constraints are enforced by setting the logits of illegal tokens to negative infinity (logits masking).66% similarUnverifiedThe core method of grammar-constrained decoding is to use a context-free grammar (CFG) to filter out illegal token options during the model's token-by-token output generation, setting the logits of illegal tokens to negative infinity.64% similarUnverifiedOutlines constructs a Finite State Machine (FSM) that dynamically masks tokens at each generation step that would render the format invalid, allowing the model to sample only from the subset of legal tokens.64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/504272API
curl https://kongchang.com/api/v1/knowledge/claims/504272MCP
get_claim(id=504272)