projects / platform / core / ml / nntrainer.git / commit
? search:
summary | shortlog | log | commit | commitdiff | tree
(parent: e7aebbc) | patch
[weight] Support weight decay
authorParichay Kapoor <pk.kapoor@samsung.com>
Mon, 24 Jan 2022 03:58:43 +0000 (12:58 +0900)
committerJijoong Moon <jijoong.moon@samsung.com>
Wed, 9 Feb 2022 09:34:12 +0000 (18:34 +0900)
commit7fecf186ffe2e6841744cd03a632e7c8a52e360f
treefc59030693786ccb12c8ca05ba0efe7dfba685f1tree | snapshot
parente7aebbc54f8d2df9d99fa6f6e8e826fc7da844efcommit | diff
[weight] Support weight decay

Add support for weight decay property which will enable decay of weights
with each applying of the gradient.
Weight decay can be enabled individually for both weight and bias.
This is kept separate from regularizer as they both behave differently.

Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
nntrainer/layers/common_properties.cpp diff | blob | history
nntrainer/layers/common_properties.h diff | blob | history
nntrainer/layers/layer_impl.cpp diff | blob | history
nntrainer/layers/layer_impl.h diff | blob | history
nntrainer/layers/lstmcell_core.cpp diff | blob | history
nntrainer/layers/lstmcell_core.h diff | blob | history
nntrainer/tensor/weight.cpp diff | blob | history
nntrainer/tensor/weight.h diff | blob | history
nntrainer/utils/node_exporter.cpp diff | blob | history
nntrainer/utils/node_exporter.h diff | blob | history
Domain: Machine Learning / ML Framework;