vga_switcheroo: Remove assumptions about registration/unregistration ordering