Commit 8c835bec authored by A. Unique TensorFlower's avatar A. Unique TensorFlower Committed by TensorFlower Gardener
Browse files

Explicitly place local_step variable on worker's local device (was defaulting to PS).

The local step is used by the ConditionalAccumulators to check gradients for staleness and optionally discard them.

This fixes the issue if that the local step is increased by one worker and a backup worker pushes a stale gradient to a ConditionalAccumulator, then the gradient will be accepted (and hence, training won't be synchronous anymore.)

PiperOrigin-RevId: 156417310
parent 3a667647
Loading
Loading
Loading
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please to comment