v4l2: Do not renegotiate if only framerate changed