Revert erase relations before checking whether we already added it