Allow to add idler even if adaptor paused