[optimzer/layers] Gradient dimension should match weight dim
authorParichay Kapoor <pk.kapoor@samsung.com>
Thu, 16 Jul 2020 11:39:29 +0000 (20:39 +0900)
committerJijoong Moon <jijoong.moon@samsung.com>
Thu, 16 Jul 2020 12:12:16 +0000 (21:12 +0900)
commit7b39bd4309450dbefb92667a1465783d2c6ba528
tree365dd8e2eb987dd4f250ef8b9fb8c50a521bd2d6
parented175d5cce79f133e551c49b0722151df5765d09
[optimzer/layers] Gradient dimension should match weight dim

Gradient dimension should match weight dimension
Currently optimizer applies averaging of gradients, which is not correct
Apply averaging of gradients before calling applyGradients

Resolves #280

Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
nntrainer/src/bn_layer.cpp
nntrainer/src/conv2d_layer.cpp
nntrainer/src/fc_layer.cpp
nntrainer/src/optimizer.cpp