rmdec: when using INT4 deinterleaving, error out if sub_packet_h <= 1.
authorRonald S. Bultje <rsbultje@gmail.com>
Tue, 21 Feb 2012 18:36:27 +0000 (10:36 -0800)
committerRonald S. Bultje <rsbultje@gmail.com>
Wed, 22 Feb 2012 17:17:27 +0000 (09:17 -0800)
commite30b3e59a4f3004337cb1623b2aac988ce52b93f
treeea397dc8de54b6b9bad4a68a783b1e013f81cf75
parent58700edb94a3ddd7267fd7430d19b4a7e2a6b82b
rmdec: when using INT4 deinterleaving, error out if sub_packet_h <= 1.

We read sub_packet_h / 2 packets per line of data (during deinterleaving),
which equals zero if sub_packet_h <= 1, thus causing us to not read any
data, leading to an infinite loop.

Found-by: Mateusz "j00ru" Jurczyk and Gynvael Coldwind
CC: libav-stable@libav.org
libavformat/rmdec.c