Dynamic dimension inference
DynamicDimensionInference analyzes each HLO instruction in a graph and inferences which dimensions are dynamic and which scalar instructions represent the runtime real size of those dynamic dimensions. Note: This CL only implements the skeleton that has enough support for dynamic batch for Resnet50. More supports for other models will be added incrementally later. PiperOrigin-RevId: 224218787
Loading
Please sign in to comment