omxvideoenc: include vertical padding in nFilledLen when copying
authorGuillaume Desmottes <guillaume.desmottes@collabora.co.uk>
Thu, 5 Jul 2018 13:13:47 +0000 (15:13 +0200)
committerGuillaume Desmottes <guillaume.desmottes@collabora.co.uk>
Thu, 5 Jul 2018 14:08:03 +0000 (16:08 +0200)
commit1e9d7a6a236939228efa22e0f0ace0a7f7328639
tree959dee4da91e6eb55c1246f7c23f1454c791bec5
parentc8969b0dbec565f388c35f6d5eb43bc463d6348a
omxvideoenc: include vertical padding in nFilledLen when copying

According to the OMX spec (3.1.3.7.1) nFilledLen is meant to include any
padding. We use to include the horizontal one (stride) but not the
vertical one if nSliceHeight is bigger than the actual height.

The calculated nFilledLen was wrong as it didn't include the padding
between planes.

https://bugzilla.gnome.org/show_bug.cgi?id=796749
omx/gstomxvideoenc.c