ASoC: topology: Unify kcontrol removal code