Uses of Interface
ai.beestream.jitnn.dist.Collective

Packages that use Collective
Package
Description
Several devices: collectives (all-reduce, broadcast, reduce-scatter, all-gather) among ranks, staged through the host (HostCollective) or run by NCCL on NVIDIA GPUs (NcclCollective), and ProcessGroup, which runs one rank per device.
Neural-network modules after PyTorch's torch.nn: Module and Sequential, linear and convolution layers, pooling, normalisation, attention, embeddings, recurrent layers (LSTM, GRU), graph convolution, activations, and data-parallel training (DataParallel).