vfio/mdev: Follow correct remove sequence