rcu: Make synchronize_rcu_expedited() fast path update .expedited_sequence
authorPaul E. McKenney <paulmck@kernel.org>
Fri, 5 Aug 2022 00:43:53 +0000 (17:43 -0700)
committerPaul E. McKenney <paulmck@kernel.org>
Wed, 31 Aug 2022 12:09:21 +0000 (05:09 -0700)
commit43ff97cc997f5641127152f97e1fd0fc9fa060f6
tree4be741bede892f05f21368a97b33fe830a3e29ea
parente8755d2bde7c296026fe5d47f1b75c7b19ba46fd
rcu: Make synchronize_rcu_expedited() fast path update .expedited_sequence

This commit causes the early boot single-CPU synchronize_rcu_expedited()
fastpath to update the rcu_state structure's ->expedited_sequence
counter.  This will allow the full-state polled grace-period APIs to
detect all expedited grace periods without the need to track the special
combined polling-only counter, which is another step towards removing
the ->rgos_polled field from the rcu_gp_oldstate, thereby reducing its
size by one third.

Signed-off-by: Paul E. McKenney <paulmck@kernel.org>
kernel/rcu/tree_exp.h