[weight-decay] Bug fix for weight decay with adam
authorParichay Kapoor <pk.kapoor@samsung.com>
Fri, 18 Feb 2022 11:01:58 +0000 (20:01 +0900)
committerJijoong Moon <jijoong.moon@samsung.com>
Mon, 21 Feb 2022 13:44:22 +0000 (22:44 +0900)
commit19b72d162dbb3d7f01a8703cd6ddb17062014082
tree5c79af6e887b68448017ade8c78c078eccaa1d3f
parent5be51b5eb4ea6e30e4a1baa5d33b835e95760e4c
[weight-decay] Bug fix for weight decay with adam

weight decay should be applied before calling the optimizer
this was not detected earlier as it was tested with sgd

Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
nntrainer/models/neuralnet.cpp
nntrainer/tensor/weight.h