Commit c2255b0f authored by Jing Li's avatar Jing Li Committed by TensorFlower Gardener
Browse files

Rewrite Adam and LazyAdam optimizer to take global step for computing beta1... 

Rewrite Adam and LazyAdam optimizer to take global step for computing beta1 and beta2 accumulators, instead of having the optimizer instance to keep its own independent beta1 and beta2 accumulators as non-slot variables.

PiperOrigin-RevId: 224948020
parent 68834966
Show whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Please to comment