Commit a335040d authored by A. Unique TensorFlower's avatar A. Unique TensorFlower Committed by TensorFlower Gardener
Browse files

Fix loss reductions to correctly divide by global batch size 

when using a tf.distribute.Strategy, instead of less-reliable division
by the number of replicas in optimizers.

RELNOTES: Bug fix: loss and gradients should now more reliably be
correctly scaled w.r.t. the global batch size when using a
tf.distribute.Strategy.
PiperOrigin-RevId: 232400597
parent be6d1285
Show whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Please to comment