Mark the Arg and RetVal ops as inexpensive.
This change avoids gratuitous context switches at the beginning of a step (for each fed value) and end of a step (for each fetched value). These OpKernels are trivial, so the cost of executing it inline is typically smaller than waking up another thread to perform the work. PiperOrigin-RevId: 179933412
Loading
Please sign in to comment