arxivcs.LG2026-07-08
Constrained Decoding for Diffusion Language Models via Efficient Inference over Finite Automata
Constrained decoding is essential for serving LLMs, ensuring that generated outputs follow specific structures such as JSON schema-formatted function calls. Existing systems are designed for autoregressive models and assume left-to-right generation, masking out invalid next token…