irq_work: Fix irq_work_claim() memory ordering
authorFrederic Weisbecker <frederic@kernel.org>
Fri, 8 Nov 2019 16:08:56 +0000 (17:08 +0100)
committerIngo Molnar <mingo@kernel.org>
Mon, 11 Nov 2019 08:03:31 +0000 (09:03 +0100)
commit25269871db1ad0cbbaafd5098cbdb40c8db4ccb9
tree4c8022165bdc48b42d3c62991640a84b3a4ff8f4
parent153bedbac2ebd475e1c7c2d2fa0c042f5525927d
irq_work: Fix irq_work_claim() memory ordering

When irq_work_claim() finds IRQ_WORK_PENDING flag already set, we just
return and don't raise a new IPI. We expect the destination to see
and handle our latest updades thanks to the pairing atomic_xchg()
in irq_work_run_list().

But cmpxchg() doesn't guarantee a full memory barrier upon failure. So
it's possible that the destination misses our latest updates.

So use atomic_fetch_or() instead that is unconditionally fully ordered
and also performs exactly what we want here and simplify the code.

Signed-off-by: Frederic Weisbecker <frederic@kernel.org>
Cc: Linus Torvalds <torvalds@linux-foundation.org>
Cc: Paul E . McKenney <paulmck@linux.vnet.ibm.com>
Cc: Peter Zijlstra <peterz@infradead.org>
Cc: Thomas Gleixner <tglx@linutronix.de>
Link: https://lkml.kernel.org/r/20191108160858.31665-3-frederic@kernel.org
Signed-off-by: Ingo Molnar <mingo@kernel.org>
kernel/irq_work.c