Commit f085b878 authored by A. Unique TensorFlower's avatar A. Unique TensorFlower Committed by TensorFlower Gardener
Browse files

Add collective all_gather method to unofficial python interface. 

Initial implementation is by ring-algorithm.
Intended use is via distribution strategies.

The implementation of all-gather is very similar to that of all-reduce,
so common code is factored out into ring_alg.{h,cc}.

PiperOrigin-RevId: 233775623
parent 6baa1f85
Expand all Show whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Please to comment