xhci: cleanup xhci_hub_control port references