[layers] Support for weight decay to layers
authorParichay Kapoor <pk.kapoor@samsung.com>
Mon, 24 Jan 2022 09:54:32 +0000 (18:54 +0900)
committerJijoong Moon <jijoong.moon@samsung.com>
Wed, 9 Feb 2022 09:34:12 +0000 (18:34 +0900)
commit62ab2b4e3adc8714482afec7c7fa191ce63b5455
tree8f15647da69728d834e69fd6246e500b7cbc069f
parent7fecf186ffe2e6841744cd03a632e7c8a52e360f
[layers] Support for weight decay to layers

Add support for weight decay to the layers with weights.
Further update the requestWeight API of the layer context to accept
weight decay, and update the usage at manager.

Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
19 files changed:
nntrainer/graph/network_graph.cpp
nntrainer/layers/bn_layer.cpp
nntrainer/layers/centroid_knn.cpp
nntrainer/layers/conv2d_layer.cpp
nntrainer/layers/embedding.cpp
nntrainer/layers/fc_layer.cpp
nntrainer/layers/gru.cpp
nntrainer/layers/grucell.cpp
nntrainer/layers/layer_context.h
nntrainer/layers/lstm.cpp
nntrainer/layers/lstmcell.cpp
nntrainer/layers/mol_attention_layer.cpp
nntrainer/layers/rnn.cpp
nntrainer/layers/rnncell.cpp
nntrainer/layers/zoneout_lstmcell.cpp
nntrainer/tensor/manager.cpp
nntrainer/tensor/tensor_wrap_specs.h
nntrainer/tensor/weight.cpp
nntrainer/tensor/weight.h