arm: vybrid: Drop enabling GPIO, SPI and UART in legacy mode