UPSTREAM: rcu: Disable laziness if lazy-tracking says so
During suspend, we see failures to suspend 1 in 300-500 suspends. Looking closer, it appears that asynchronous RCU callbacks are being queued as lazy even though synchronous callbacks are expedited. These delays appear to not be very welcome by the suspend/resume code as evidenced by these occasional suspend failures. This commit modifies call_rcu() to check if rcu_async_should_hurry(), which will return true if we are in suspend or in-kernel boot. [ paulmck: Alphabetize local variables. ] Ignoring the lazy hint makes the 3000 suspend/resume cycles pass reliably on a 12th gen 12-core Intel CPU, and there is some evidence that it also slightly speeds up boot performance. Fixes: 3cb278e7 ("rcu: Make call_rcu() lazy to save power") Signed-off-by:Joel Fernandes (Google) <joel@joelfernandes.org> Signed-off-by:
Paul E. McKenney <paulmck@kernel.org> (cherry picked from commit cf7066b9) Bug: 258241771 Signed-off-by:
Joel Fernandes <joelaf@google.com> Reviewed-on: https://chromium-review.googlesource.com/c/chromiumos/third_party/kernel/+/4909179 Reviewed-by:
Vineeth Pillai <vineethrp@google.com> Reviewed-by:
Ross Zwisler <zwisler@google.com> Reviewed-by:
Sean Paul <sean@poorly.run> Signed-off-by:
Qais Yousef <qyousef@google.com> Change-Id: I4cfe6f43de8bae9a6c034831c79d9773199d6d29
Loading
Please sign in to comment