arxivcs.ITcs.LG2026-07-22
Pipelined Gradient Coding
In large-scale machine learning, distributed training commonly involves multiple workers evaluating the gradients of the model on different dataset partitions. A common challenge is the presence of straggling workers, which may significantly slow down training. Traditional gradie…