tegra: usb: move controller init into start_port