Commit 1e5854fb authored by A. Unique TensorFlower's avatar A. Unique TensorFlower Committed by TensorFlower Gardener
Browse files

Adds a mechanism for adaptive shared batch scheduler that the earliest closed... 

Adds a mechanism for adaptive shared batch scheduler that the earliest closed batches are scheduled immediately if batch_thread_pool_ has an idle thead.

This helps to prevent overloads when traffic suddenly increase from very low to high.

PiperOrigin-RevId: 206077249
parent 19e4d68c
Show whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Please to comment