usb: move children to struct usb_port