fsl/usb: Workaround for USB erratum-A005275