arxivcs.DCcs.LG2026-07-08
CTA-Pipelining: A Latency-Oriented Spatial Scaling Method for Multi-GPU Systems
Tingkai Liu, Muralidhar Andoorveedu, Sanjoy Das, Sanjay Patel, Volodymyr Kindratenko
The evolution of compute infrastructure has transformed multi-GPU systems into tightly integrated shared-memory structures. However, current software still mostly treats these coherent interconnects simply as high-speed networks. Simultaneously, the demand for serving Large Langu…