pinctrl: armada-37xx: Fix spurious irq management