usb: musb: musbhsdma: drop the controller check in dma_controller_destroy()