Class ProcessGroup
java.lang.Object
ai.beestream.jitnn.dist.ProcessGroup
Runs one rank per device in this process: rank firstRank + r is a thread whose plans run on
devices[r] (see
Engine.onDevice(String, Supplier)), and all ranks share one Collective. Several
ranks may name the same device (not with NCCL). With a collective that spans several processes
(NcclCollective(String, int, int, String...)), each process runs its own
ranks.-
Method Summary
Modifier and TypeMethodDescriptionstatic <T> List<T> run(String[] devices, Collective collective, BiFunction<Integer, Collective, T> body) Runsbody(rank, collective)on every rank and returns the ranks' results in rank order.static <T> List<T> run(String[] devices, BiFunction<Integer, Collective, T> body)
-
Method Details
-
run
public static <T> List<T> run(String[] devices, Collective collective, BiFunction<Integer, Collective, T> body) Runsbody(rank, collective)on every rank and returns the ranks' results in rank order. -
run
-