Change implementation of DistributedValues to be a device map and
tuple of values instead of a dict mapping devices to values. Values in a DistributedValues object are now indexed by replica id. Lays the groundwork for supporting multiple logical devices (model parallelism). PiperOrigin-RevId: 226108301
Loading
Please sign in to comment