RDMA/rtrs-srv: Replace atomic_t with percpu_ref for ids_inflight
authorMd Haris Iqbal <haris.iqbal@cloud.ionos.com>
Fri, 28 May 2021 11:30:11 +0000 (13:30 +0200)
committerJason Gunthorpe <jgg@nvidia.com>
Fri, 28 May 2021 23:52:58 +0000 (20:52 -0300)
commit0cdfb3b20797804ae835d7a325b08d8523794089
treeccfdc325591867027803365ebff65dd440d8ec91
parent41db63a7efe1c8c2dd282c1849a6ebfbbedbaf67
RDMA/rtrs-srv: Replace atomic_t with percpu_ref for ids_inflight

ids_inflight is used to track the inflight IOs. But the use of atomic_t
variable can cause performance drops and can also become a performance
bottleneck.

This commit replaces the use of atomic_t with a percpu_ref structure. The
advantage it offers is, it doesn't check if the reference has fallen to 0,
until the user explicitly signals it to; and that is done by the
percpu_ref_kill() function call. After that, the percpu_ref structure
behaves like an atomic_t and for every put call, checks whether the
reference has fallen to 0 or not.

rtrs_srv_stats_rdma_to_str shows the count of ids_inflight as 0
for user-mode tools not to be confused.

Fixes: 9cb837480424e ("RDMA/rtrs: server: main functionality")
Link: https://lore.kernel.org/r/20210528113018.52290-14-jinpu.wang@ionos.com
Signed-off-by: Md Haris Iqbal <haris.iqbal@ionos.com>
Signed-off-by: Jack Wang <jinpu.wang@ionos.com>
Signed-off-by: Gioh Kim <gi-oh.kim@ionos.com>
Signed-off-by: Jason Gunthorpe <jgg@nvidia.com>
drivers/infiniband/ulp/rtrs/rtrs-srv-stats.c
drivers/infiniband/ulp/rtrs/rtrs-srv.c
drivers/infiniband/ulp/rtrs/rtrs-srv.h