PCI: qcom-ep: Make use of the cached dev pointer