Commit 828dfee5 authored by Igor Saprykin's avatar Igor Saprykin Committed by TensorFlower Gardener
Browse files

Average the loss across `replicate_model_fn`'s towers. 

This avoids the need for users to add `loss = loss / num_of_towers` code and is in more in line with the current best practices.

I verified this by running cnn_mnist.

PiperOrigin-RevId: 178963334
parent 57600a8d
Show whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Please to comment