usb: cdns3: improve handling of unaligned address case