inputselector: Keep a ref of the currently active sinkpad around