net: ravb: Fix possible hang if RIS2_QFF1 happen