resolver: Make sure we do not use already removed timer