Synthesized Collective Communication Library (SCCL)
The Synthesized Collective Communication Library is a tool for synthesizing collective algorithms tailored to a particular hardware topology. This project creates high-performance collective communication algorithms for the uncommon interconnect topologies connecting AI accelerators inside servers.…