moved scaling from dequantization to inverse transform for T8x8
authorYaowu Xu <yaowu@google.com>
Tue, 14 Feb 2012 15:40:26 +0000 (07:40 -0800)
committerYaowu Xu <yaowu@google.com>
Thu, 16 Feb 2012 15:03:55 +0000 (07:03 -0800)
commit454c7abc1ae56134019f2a26fac6db9bcb1627d4
tree205e4671a434cf6cb2a4790238c84598b99dfbca
parent0930dde2496e911d24c930751b08c71ae722bd89
moved scaling from dequantization to inverse transform for T8x8

Previously, the scaling related to extended quantize range happens in
dequantization stage, which implies the coefficients form forward
transform are in different scale(4x) from dequantization coefficients
This worked fine when there was not distortion computation done based
on 8x8 transform, but it completely wracked the distortion estimation
based on transform coefficients and dequantized transform coefficients
introduced in commit f64725a00 for macroblocks using 8x8 transform.
This commit fixed the issue by moving the scaling into the stage of
inverse 8x8 transform.

TODO: Test&Verify the transform/quantization pipeline accuracy.

Change-Id: Iff77b36a965c2a6b247e59b9c59df93eba5d60e2
vp8/common/idctllm.c
vp8/decoder/dequantize.c
vp8/encoder/encodemb.c
vp8/encoder/onyx_if.c
vp8/encoder/quantize.c
vp8/encoder/rdopt.c