ASoC: Fix SND_SOC_ALL_CODECS imply SPI fallout