Commit 681f6a6a authored by Ayush Dubey's avatar Ayush Dubey Committed by TensorFlower Gardener
Browse files

Add a CollectiveReduce implementation that uses NCCL. 

This change adds an implementation of the CollectiveImplementationInterface
that uses NCCL for all-reduce.  The main bits include setting up a NCCL
communicator key during collective param resolution, and calling the relevant
functionality in NcclManager.

PiperOrigin-RevId: 229277364
parent b30d3f5a
Show whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Please to comment