iommu/vt-d: fix shift-out-of-bounds in bug checking