[ Mixed Tensor ] add tensor type property in initContext
authorjijoong.moon <jijoong.moon@samsung.com>
Thu, 27 Jul 2023 00:14:57 +0000 (09:14 +0900)
committerJijoong Moon <jijoong.moon@samsung.com>
Mon, 21 Aug 2023 06:29:23 +0000 (15:29 +0900)
commitde01a32b8083b77d99097c527d5460ec7118f6eb
treec0ac23bc733a87e6f51ab7ca5addfda1d43c3235
parentc07372c35508cc287e2b89f8dc63880257dc85df
[ Mixed Tensor ] add tensor type property in initContext

This PR add the tensor type (Format, Weight Tensor DataType,
Activation Tensor DataType) in initContext.
- Remove the tensor type variables and setter, getter member function
in layer, layer_devel, loss layer etc.
- add tensor type setter in initContext
- set the var_grad ( input & ouput ) Tensor Type according to model
Tensor Data Type.
- Add ModelTensorTypeInfo : eg. FP16_FP16 ( Weight FP16, Activation
FP16 )

**Self evaluation:**
1. Build test:  [X]Passed [ ]Failed [ ]Skipped
2. Run test:  [X]Passed [ ]Failed [ ]Skipped

Signed-off-by: jijoong.moon <jijoong.moon@samsung.com>
33 files changed:
api/ccapi/include/layer.h
nntrainer/graph/network_graph.cpp
nntrainer/graph/network_graph.h
nntrainer/layers/fc_layer.cpp
nntrainer/layers/layer_context.cpp
nntrainer/layers/layer_context.h
nntrainer/layers/layer_devel.h
nntrainer/layers/layer_node.cpp
nntrainer/layers/layer_node.h
nntrainer/layers/loss/loss_layer.h
nntrainer/models/model_common_properties.h
nntrainer/models/neuralnet.cpp
nntrainer/models/neuralnet.h
nntrainer/tensor/manager.h
nntrainer/utils/base_properties.h
test/unittest/layers/layers_common_tests.h
test/unittest/layers/layers_golden_tests.cpp
test/unittest/layers/unittest_layers_attention.cpp
test/unittest/layers/unittest_layers_batch_normalization.cpp
test/unittest/layers/unittest_layers_concat.cpp
test/unittest/layers/unittest_layers_convolution1d.cpp
test/unittest/layers/unittest_layers_convolution2d.cpp
test/unittest/layers/unittest_layers_dropout.cpp
test/unittest/layers/unittest_layers_fully_connected.cpp
test/unittest/layers/unittest_layers_gru.cpp
test/unittest/layers/unittest_layers_grucell.cpp
test/unittest/layers/unittest_layers_layer_normalization.cpp
test/unittest/layers/unittest_layers_lstm.cpp
test/unittest/layers/unittest_layers_lstmcell.cpp
test/unittest/layers/unittest_layers_multi_head_attention.cpp
test/unittest/layers/unittest_layers_positional_encoding.cpp
test/unittest/layers/unittest_layers_rnn.cpp
test/unittest/layers/unittest_layers_rnncell.cpp