sbitmap: fix missed wakeups caused by sbitmap_queue_get_shallow()
authorOmar Sandoval <osandov@fb.com>
Thu, 10 May 2018 00:16:31 +0000 (17:16 -0700)
committerJens Axboe <axboe@kernel.dk>
Thu, 10 May 2018 17:27:36 +0000 (11:27 -0600)
commita327553965dede92587e6ccbe7df98dba36edcea
treefe246813d7d48402820808661697ff3f544ed484
parentbd7d4ef6a4c9b3611fa487a0065bf042c71ce620
sbitmap: fix missed wakeups caused by sbitmap_queue_get_shallow()

The sbitmap queue wake batch is calculated such that once allocations
start blocking, all of the bits which are already allocated must be
enough to fulfill the batch counters of all of the waitqueues. However,
the shallow allocation depth can break this invariant, since we block
before our full depth is being utilized. Add
sbitmap_queue_min_shallow_depth(), which saves the minimum shallow depth
the sbq will use, and update sbq_calc_wake_batch() to take it into
account.

Acked-by: Paolo Valente <paolo.valente@linaro.org>
Signed-off-by: Omar Sandoval <osandov@fb.com>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
include/linux/sbitmap.h
lib/sbitmap.c