Blackfin: drop CONFIG_SPI handling in board init