drm/amdgpu fix incorrect sysfs remove behavior for xgmi