Ensure g_timeout_add source can be removed safely