Ori Cohen

MoX: Efficient MoE Routing on Direct-Connect Topologies

Ori Cohen, Jakob Krebs, Daniel Amir, Mark Silberstein

Optically switched networks suit the regular communication of dense ML models, but MoE introduces sparse, runtime-dependent traffic. We show that efficient offline-optimized routing enables efficient MoE training and inference on direct-connect topologies without the need for MoE…Read more