Add support for ResourceVariables in Shampoo optimizer.
Updates Shampoo default matrix size to ones that work better on TPUs. Change norm to use the F norm. PiperOrigin-RevId: 207967042
Loading
Please sign in to comment
Updates Shampoo default matrix size to ones that work better on TPUs. Change norm to use the F norm. PiperOrigin-RevId: 207967042