clk: kill off set_irq_flags usage