Nitin Kedia

Sangam: Efficiently Serving Diffusion LLMs with the AR Stack

Nitin Kedia, Saurabh Agarwal, Myungjin Lee, Aditya Akella

Diffusion language models (dLLMs) generate text by iteratively denoising a masked response and can commit multiple output positions per model invocation. Their bidirectional attention prevents exact autoregressive-style KV caching, since committing one position shifts the KV acti…Read more