io_uring: fix memory ordering when SQPOLL thread goes to sleep
authorAlmog Khaikin <almogkh@gmail.com>
Mon, 21 Mar 2022 09:00:59 +0000 (11:00 +0200)
committerJens Axboe <axboe@kernel.dk>
Mon, 21 Mar 2022 12:33:29 +0000 (06:33 -0600)
commit649bb75d19c93f5459f450191953dff4825fda3e
tree6fbdce114ff684f42607f4145e086bbb9a2d3fa9
parentf63cf5192fe3418ad5ae1a4412eba5694b145f79
io_uring: fix memory ordering when SQPOLL thread goes to sleep

Without a full memory barrier between the store to the flags and the
load of the SQ tail the two operations can be reordered and this can
lead to a situation where the SQPOLL thread goes to sleep while the
application writes to the SQ tail and doesn't see the wakeup flag.
This memory barrier pairs with a full memory barrier in the application
between its store to the SQ tail and its load of the flags.

Signed-off-by: Almog Khaikin <almogkh@gmail.com>
Link: https://lore.kernel.org/r/20220321090059.46313-1-almogkh@gmail.com
Signed-off-by: Jens Axboe <axboe@kernel.dk>
fs/io_uring.c