Commit 79b9a64a authored by Ayush Dubey's avatar Ayush Dubey Committed by TensorFlower Gardener
Browse files

Add support for ncclAllGather in NcclManager. 

The rank provided by the user is important, because order matters in
ncclAllGather.  Data from rank `i` is put at offset `i*sendcount` in the recv
buffer.  So, this change includes a small modification to how ranks are handled
internally in NcclManager.

PiperOrigin-RevId: 233461740
parent 8367a997
Show whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Please to comment