io_uring/sqpoll: fix io-wq affinity when IORING_SETUP_SQPOLL is used
authorJens Axboe <axboe@kernel.dk>
Sun, 13 Aug 2023 17:05:36 +0000 (11:05 -0600)
committerJens Axboe <axboe@kernel.dk>
Wed, 16 Aug 2023 19:40:28 +0000 (13:40 -0600)
commitebdfefc09c6de7897962769bd3e63a2ff443ebf5
treea70556ba92be56e756410d5e9871c24f1fe1ea24
parentd246c759c47eafe4688613e89b337e48c39c5968
io_uring/sqpoll: fix io-wq affinity when IORING_SETUP_SQPOLL is used

If we setup the ring with SQPOLL, then that polling thread has its
own io-wq setup. This means that if the application uses
IORING_REGISTER_IOWQ_AFF to set the io-wq affinity, we should not be
setting it for the invoking task, but rather the sqpoll task.

Add an sqpoll helper that parks the thread and updates the affinity,
and use that one if we're using SQPOLL.

Fixes: fe76421d1da1 ("io_uring: allow user configurable IO thread CPU affinity")
Cc: stable@vger.kernel.org # 5.10+
Link: https://github.com/axboe/liburing/discussions/884
Signed-off-by: Jens Axboe <axboe@kernel.dk>
io_uring/io-wq.c
io_uring/io-wq.h
io_uring/io_uring.c
io_uring/sqpoll.c
io_uring/sqpoll.h