rcu: Expedite first two FQS scans under callback-overload conditions
authorPaul E. McKenney <paulmck@kernel.org>
Sun, 23 Feb 2020 04:07:09 +0000 (20:07 -0800)
committerPaul E. McKenney <paulmck@kernel.org>
Mon, 27 Apr 2020 18:01:16 +0000 (11:01 -0700)
commit1fca4d12f46371a34bf90af87f49548dd026c3ca
tree311125bf4cec30f94fb44dc3e00ffa9bda81432a
parent53965dbe5396d2945c7cf53c77c7b5532b08791c
rcu: Expedite first two FQS scans under callback-overload conditions

Even if some CPUs have excessive numbers of callbacks, RCU's grace-period
kthread will still wait normally between successive force-quiescent-state
scans.  The first two are the most important, as they are the ones that
enlist aid from the scheduler when overloaded.  This commit therefore
omits the wait before the first and the second force-quiescent-state
scan under callback-overload conditions.

This approach was inspired by a discussion with Jeff Roberson.

Signed-off-by: Paul E. McKenney <paulmck@kernel.org>
kernel/rcu/tree.c
kernel/rcu/tree.h