Enable user to choose between all-reduce implementations in
MultiWorkerMirroredStrategy.
Possible choices: AUTO, RING - which uses `common_runtime/ring_reducer.{cc,h}`,
and NCCL - which uses Nvidia NCCL for all-reduce.
PiperOrigin-RevId: 236000699
Loading
Please sign in to comment