slimbus: ngd: set correct device for pm