splitmuxsrc: Fix extra unref handling queries