io_uring: optimize io_uring_task layout
authorPavel Begunkov <asml.silence@gmail.com>
Mon, 20 Jun 2022 14:27:35 +0000 (15:27 +0100)
committerJens Axboe <axboe@kernel.dk>
Mon, 25 Jul 2022 00:39:15 +0000 (18:39 -0600)
commit4a0fef62788b69df09267c8e3f3f11d4bb9d50e7
treeac71025cad11239d4ecc1c31bb8c2af811954fb2
parentbce5d70cd64a5d48aff613334b8a5fac450b9753
io_uring: optimize io_uring_task layout

task_work bits of io_uring_task are split into two cache lines causing
extra cache bouncing, place them into a separate cache line. Also move
the most used submission path fields closer together, so there are hot.

Cc: stable@vger.kernel.org # 5.15+
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
io_uring/tctx.h