soundwire: peripheral: remove useless ops pointer