io_uring: merge conditional unlock flush helpers
authorPavel Begunkov <asml.silence@gmail.com>
Fri, 23 Jun 2023 11:23:31 +0000 (12:23 +0100)
committerJens Axboe <axboe@kernel.dk>
Fri, 23 Jun 2023 14:19:40 +0000 (08:19 -0600)
commitc98c81a4ac37b651be7eb9d16f562fc4acc5f867
tree2af5fdc7cc2c86020c16e89588c66c2cb288e334
parent0fdb9a196c6728b51e0e7a4f6fa292d9fd5793de
io_uring: merge conditional unlock flush helpers

There is no reason not to use __io_cq_unlock_post_flush for intermediate
aux CQE flushing, all ->task_complete should apply there, i.e. if set it
should be the submitter task. Combine them, get rid of of
__io_cq_unlock_post() and rename the left function.

This place was also taking a couple percents of CPU according to
profiles for max throughput net benchmarks due to multishot recv
flooding it with completions.

Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
Link: https://lore.kernel.org/r/bbed60734cbec2e833d9c7bdcf9741aada5d8aab.1687518903.git.asml.silence@gmail.com
Signed-off-by: Jens Axboe <axboe@kernel.dk>
io_uring/io_uring.c