net: ravb: Keep reverse order of operations in ravb_remove()