Commit 819e55e2 authored by A. Unique TensorFlower's avatar A. Unique TensorFlower Committed by TensorFlower Gardener
Browse files

Add AdaptiveSharedBatchScheduler queue option batch_timeout_micros which... 

Add AdaptiveSharedBatchScheduler queue option batch_timeout_micros which forces the batch to wait for some time before being scheduled. This can improve performance by limiting the scheduling of almost empty batches.

PiperOrigin-RevId: 231250232
parent 33f28b7d
Show whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Please to comment