videodecoder: Only keep track of timestamps if the subclass is parsing data