ASoC: core: lock client_mutex while removing link components