avviddec: Fix pool reallocation logic