Commit d7cde5bd authored by Yuefeng Zhou's avatar Yuefeng Zhou Committed by TensorFlower Gardener
Browse files

Local collective all reduce with eager mode: wraps invocations to collective... 

Local collective all reduce with eager mode: wraps invocations to collective allreduce into a defun; Only broadcast send/recv initial values on the first replica of each worker.

PiperOrigin-RevId: 228598348
parent 00a074f8
Show whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Please to comment