Class ProcessGroup

java.lang.Object
ai.beestream.jitnn.dist.ProcessGroup

public final class ProcessGroup extends Object
Runs one rank per device in this process: rank firstRank + r is a thread whose plans run on devices[r] (see Engine.onDevice(String, Supplier)), and all ranks share one Collective. Several ranks may name the same device (not with NCCL). With a collective that spans several processes (NcclCollective(String, int, int, String...)), each process runs its own ranks.