alsa: Fix crash when loading bare ALSA sink/source