compositor: Move input devices to their own event loop