dbus: Fix cleanup when removing signal listeners