Adds a fisher block for fully connected recurrent layers.
`FullyConnectedSeriesFB` uses an approximation to the Fisher information matrix designed for RNNs. This CL also adds support for dtypes other than `float32` to `fisher_factors`. PiperOrigin-RevId: 177558080
Loading
Please sign in to comment