SiP Architecture For Accelerating Collective Communication in Distributed Deep Learning
- Resource Type
- Conference
- Authors
- Wu, Zhenguo; Dai, Liang Yuan; Zhu, Ziyi; Novick, Asher; Glick, Madeleine; Bergman, Keren
- Source
- 2023 Optical Fiber Communications Conference and Exhibition (OFC) Optical Fiber Communications Conference and Exhibition (OFC), 2023. :1-3 Mar, 2023
- Subject
- Communication, Networking and Broadcast Technologies
Photonics and Electrooptics
Deep learning
Optical switches
Bandwidth
Silicon photonics
Optical fiber communication
- Language
We present a silicon photonic architecture for accelerating collective communications in distributed deep learning. We demonstrate a 22% job completion time improvement in a small-scale testbed and 1.4 to 5.9× improvement in large-scale simulations.