module-switch-on-connect: Don't switch unlinked sink input and source outputs