rcu: Add full-sized polling for cond_sync_exp_full()
authorPaul E. McKenney <paulmck@kernel.org>
Thu, 4 Aug 2022 22:23:26 +0000 (15:23 -0700)
committerPaul E. McKenney <paulmck@kernel.org>
Wed, 31 Aug 2022 12:08:08 +0000 (05:08 -0700)
commit8df13f01608ea48712956c0b1afce35bdba5a1c5
tree1c314dfa1966d725a1dee5eee326bc69eba6444c
parentb6fe4917ae4353b397079902cb024ae01f20dfb2
rcu: Add full-sized polling for cond_sync_exp_full()

The cond_synchronize_rcu_expedited() API compresses the combined expedited and
normal grace-period states into a single unsigned long, which conserves
storage, but can miss grace periods in certain cases involving overlapping
normal and expedited grace periods.  Missing the occasional grace period
is usually not a problem, but there are use cases that care about each
and every grace period.

This commit therefore adds yet another member of the full-state RCU
grace-period polling API, which is the cond_synchronize_rcu_exp_full()
function.  This uses up to three times the storage (rcu_gp_oldstate
structure instead of unsigned long), but is guaranteed not to miss
grace periods.

Signed-off-by: Paul E. McKenney <paulmck@kernel.org>
include/linux/rcutiny.h
include/linux/rcutree.h
kernel/rcu/rcutorture.c
kernel/rcu/tree_exp.h