Enable user to choose all-reduce algorithm for multi-worker MirroredStrategy.
Currently, MirroredStrategy defaults to "pscpu/pscpu" when run for multiple workers. This change enables passing in a MultiWorkerAllReduce object to MirroredStrategy, which would allow the user to specify one of the many all-reduce specs that MirroredStrategy supports. PiperOrigin-RevId: 217785932
Loading
Please sign in to comment