jijoong.moon [Thu, 22 Apr 2021 00:41:18 +0000 (09:41 +0900)]
[ TIME DIST ] add example
Describe a commit content (Until 80 colums per line) in detail ASAP.
**Changes proposed in this PR:**
- Added TOC generator for README.md
Resolves:
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: jijoong.moon <jijoong.moon@samsung.com>
jijoong.moon [Thu, 22 Apr 2021 00:38:57 +0000 (09:38 +0900)]
[ TIME DIST ] Forwarding Implementation
This commit includes
. Implementation of Forwarding Implementation of Time Dist Layer
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: jijoong.moon <jijoong.moon@samsung.com>
jijoong.moon [Mon, 12 Apr 2021 04:54:58 +0000 (13:54 +0900)]
[ TIME DIST ] Implement Initialization of Time Dist Layer
This commit includes,
- Time Dist Layer initialization
- Some modification of network graph
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: jijoong.moon <jijoong.moon@samsung.com>
Jihoon Lee [Thu, 29 Apr 2021 03:50:37 +0000 (12:50 +0900)]
[Fix] Reorder error in layernode
This patch fixes trivial build warning which is treated as error.
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Jihoon Lee [Thu, 22 Apr 2021 08:23:07 +0000 (17:23 +0900)]
[Competibility] Change test reference value
This patch change tolerance for the `model->getValidationLoss` which
affects in i586
resolves #1125
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
hyeonseok lee [Wed, 28 Apr 2021 08:01:41 +0000 (17:01 +0900)]
Handle Undecieded issue
Init variables in constructor
resolve: 460230
Signed-off-by: hyeonseok lee <hs89.lee@samsung.com>
Parichay Kapoor [Wed, 28 Apr 2021 01:59:14 +0000 (10:59 +0900)]
[doxygen] Var_Grad doxygen fix
Added doxygen fix for var_grad
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Jihoon Lee [Fri, 9 Apr 2021 08:55:03 +0000 (17:55 +0900)]
[Exporter] Add exporter test to prop test
This patch adds exporter test to prop test to ensure that it is working
fine.
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Jihoon Lee [Fri, 9 Apr 2021 07:13:20 +0000 (16:13 +0900)]
[Exporter] Add string vector exporter
This patch adds string vector exporter implementation
Exporter will iterate through props (`iterate_props`) and will pass a
generic lambda to be called.
Later, We can retrieve the result by `get_result` if needed.
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Juyeong Lee [Tue, 27 Apr 2021 11:07:42 +0000 (20:07 +0900)]
[Docs] Fix doxygen
- Fix some doxygen errors
- Fix author email typo
Signed-off-by: Juyeong Lee <2jy22@naver.com>
hyeonseok lee [Wed, 21 Apr 2021 07:26:14 +0000 (16:26 +0900)]
[README] Replace nnsuite to nnstreamer
Since web page of TAOS-CI has been changed replace nnsuite to nnstreamer
Signed-off-by: hyeonseok lee <hs89.lee@samsung.com>
Parichay Kapoor [Mon, 26 Apr 2021 04:45:46 +0000 (13:45 +0900)]
[test] Doxygen fix
Added doxygen fix for the unittests.
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Parichay Kapoor [Thu, 8 Apr 2021 10:30:22 +0000 (19:30 +0900)]
[graph] Update graph node
Update graph node to use the updated LayerNode
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Jihoon Lee [Fri, 9 Apr 2021 04:57:56 +0000 (13:57 +0900)]
[Test/Props] Add basic property tests
This patch adds basic property test to demonstrate specification and
cover some test cases
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Jihoon Lee [Fri, 9 Apr 2021 04:05:29 +0000 (13:05 +0900)]
[Props] Add base properties
Add base properties to be used for the property implementation
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Jihoon Lee [Fri, 9 Apr 2021 02:46:22 +0000 (11:46 +0900)]
[Android/mk] Fix includes
This patch adds utils to the include header so to pass android build
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Jihoon Lee [Thu, 8 Apr 2021 12:12:22 +0000 (21:12 +0900)]
[Serializer] Add exporter to export node
This patch adds exporter to export node. This exploits visitor pattern
because, exporting need templated function to be executed, but virtual
functions does not allow templated function.
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
hyeonseok lee [Thu, 8 Apr 2021 12:15:05 +0000 (21:15 +0900)]
[Addition_layer] Set output to zero in forward
Before adding inputs output should be set zero
Self evaluation:
Build test: [X]Passed [ ]Failed [ ]Skipped
Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: hyeonseok lee <hs89.lee@samsung.com>
Juyeong Lee [Tue, 27 Apr 2021 08:04:06 +0000 (17:04 +0900)]
Fix indent in the SPDX identifier
Change tab indents to spaces in the SPDX identifier.
Resolves #1083
Signed-off-by: Juyeong Lee <2jy22@naver.com>
Jihoon Lee [Thu, 8 Apr 2021 11:08:31 +0000 (20:08 +0900)]
[Ini/Serialize] Implement logic to serialize
This patch implements general concept of serializing a node.
Below is the plan to implement this logic
0. Implement logic to serialize [*]
1. Add export api
2. Add exporter
3. Add export test
4. Implement properties
5. combine with export
6. Add extra test
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
jijoong.moon [Mon, 5 Apr 2021 12:25:00 +0000 (21:25 +0900)]
[ TIME DIST ] Modify graph to recognize time distribute layer
if time distributed layer has activation, we have to add time
distributed layer for activation, and if it need to realize loss
layer, we also add the time distribute layer for loss.
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: jijoong.moon <jijoong.moon@samsung.com>
Jihoon Lee [Thu, 8 Apr 2021 10:24:01 +0000 (19:24 +0900)]
[Ini] Remove IniTestWrapper
This patch removes initestwrapper in favor of nntrianer::iniwrapper
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
hyeonseok lee [Wed, 21 Apr 2021 13:36:23 +0000 (22:36 +0900)]
[Preprocess] Set default trainable to false
**Changes Proposed**
- Set default trainable to `false` for preprocess layer
- Register preprocess layer to the app context
- Add validate test
resolves #1129
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: hyeonseok lee <hs89.lee@samsung.com>
hyeonseok lee [Thu, 22 Apr 2021 05:49:50 +0000 (14:49 +0900)]
[Unittest] Added doxygen tag
1. Added missing doxygen tag
2. remove unused function parameter
Self evaluation:
Build test: [X]Passed [ ]Failed [ ]Skipped
Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: hyeonseok lee <hs89.lee@samsung.com>
Jihoon Lee [Thu, 8 Apr 2021 10:06:28 +0000 (19:06 +0900)]
[Ini] Propose ini wrapper 2
Propose ini wrapper in nntrainer, most codes are from
`nntrainer_test_util.cpp`.
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Jihoon Lee [Thu, 22 Apr 2021 06:30:40 +0000 (15:30 +0900)]
[Android] Fix android build
**Changes proposed in this PR:**
- Add link option to android.mk to deal with gpu delegate added in
prebuilt tflite library
- Add doxygen, change defaulted ctor that was causing warning
- Add new warning flags regarding the error
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
hyeonseok lee [Wed, 14 Apr 2021 02:37:43 +0000 (11:37 +0900)]
Handle Uninitialized scalar variable issue
Set default recurrent_activation_type in parameter
resolves: 1224616, 1224617
Signed-off-by: hyeonseok lee <hs89.lee@samsung.com>
Jihoon Lee [Fri, 9 Apr 2021 02:33:46 +0000 (11:33 +0900)]
[Fix] Multiout layer calcDerivative initialize
This patch fixes multiout layer to initialize for calcDerivative
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
hyeonseok lee [Thu, 8 Apr 2021 12:33:15 +0000 (21:33 +0900)]
[manager] disable inference_memory_opt
Enable inference_inout_memory_opt in inference could make a problem
Cause: If the networks are not flatten which means have a cycle, some of output of layer should be preserved.
For example, in resnet there is a residual output and if the opt is enabled this data could be corrupted.
See Also #1094
Self evaluation:
Build test: [X]Passed [ ]Failed [ ]Skipped
Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: hyeonseok lee <hs89.lee@samsung.com>
Jihoon Lee [Thu, 8 Apr 2021 08:43:42 +0000 (17:43 +0900)]
[Ini] Propose ini wrapper
This patch adds `IniSection` which was often used inside unittest.
Most codes are taken from the test directly.
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Parichay Kapoor [Mon, 5 Apr 2021 04:18:27 +0000 (13:18 +0900)]
[graph] Add node the graph of layers
Create class for the graph of layers which will represent nodes
This class also represents the object which will be created with APIs from now.
The actual class object resides inside this layer node object.
Properties for this layer node will be intercepted by the layer node object,
and properties of the graph node will be set in the layer node.
Others will be passed down to the layer node.
See Aso #986
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Parichay Kapoor [Mon, 5 Apr 2021 04:17:57 +0000 (13:17 +0900)]
[Graph] Add interface for graph node
Add interface for the graph node.
Graph will use this interface.
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Jihoon Lee [Wed, 7 Apr 2021 06:27:38 +0000 (15:27 +0900)]
[Loader] Remove functions which has been moved
Remove functions that has been moved to `ini_interpreter`
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Jihoon Lee [Wed, 7 Apr 2021 04:28:35 +0000 (13:28 +0900)]
[Loader] Use ini interpreter for the graph
This patch substitues graph parsing part to use interpreter.
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Jihoon Lee [Mon, 5 Apr 2021 12:12:35 +0000 (21:12 +0900)]
[IniInterpreter] Add test setup
This patch add a test setup to test interpreter.
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Jihoon Lee [Mon, 5 Apr 2021 09:56:45 +0000 (18:56 +0900)]
[IniInterpreter] Add ini backbone deserialization
**Changes proposed in this PR:**
- Add ini backbone deserialization support
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Jihoon Lee [Mon, 5 Apr 2021 07:59:55 +0000 (16:59 +0900)]
[IniInterpreter] Add section2layer
This patch add plain `section2layer`.
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Jihoon Lee [Mon, 5 Apr 2021 07:11:03 +0000 (16:11 +0900)]
[Ini] Implement ini deserializer
This patch implements ini deserializer as well as changing the interface
signature to get filepath.
Many NYI parts will be implemented soon.
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
jijoong.moon [Mon, 5 Apr 2021 04:12:45 +0000 (13:12 +0900)]
[ TIME DIST ] Implement initialization
This commit includes,
- Implementation of Time Distribute Layer Initialization.
Resolves:
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: jijoong.moon <jijoong.moon@samsung.com>
jijoong.moon [Thu, 1 Apr 2021 07:42:42 +0000 (16:42 +0900)]
[ TIME DIST ] Add skeleton Code for Time Distribution Layer
This includes
. Skeleton Code for Time Distribution Layer
Resolves:
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: jijoong.moon <jijoong.moon@samsung.com>
jijoong.moon [Thu, 1 Apr 2021 07:42:42 +0000 (16:42 +0900)]
[ TIME DIST ] Add skeleton Code for Time Distribution Layer
This includes
. Skeleton Code for Time Distribution Layer
Resolves:
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: jijoong.moon <jijoong.moon@samsung.com>
jijoong.moon [Thu, 1 Apr 2021 02:37:21 +0000 (11:37 +0900)]
[ LSTM ] Layer forwarding implementation
This commit includes:
. implementation of lstm forwarding implementation
Resolves:
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: jijoong.moon <jijoong.moon@samsung.com>
jijoong.moon [Thu, 1 Apr 2021 02:35:34 +0000 (11:35 +0900)]
[ RNN ] Fix the bug when getting input data
This commit fix:
Using wrong tensor to get input vector.
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: jijoong.moon <jijoong.moon@samsung.com>
jijoong.moon [Wed, 31 Mar 2021 12:48:25 +0000 (21:48 +0900)]
[ LSTM ] Layer Initialization
This commit includes
. LSTM Layer initialization
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: jijoong.moon <jijoong.moon@samsung.com>
hyeonseok lee [Tue, 6 Apr 2021 12:29:31 +0000 (21:29 +0900)]
Handle Missing break in switch issue
Added break which was omitted
resolve: 1224463
Signed-off-by: hyeonseok lee <hs89.lee@samsung.com>
hyeonseok lee [Tue, 6 Apr 2021 11:53:56 +0000 (20:53 +0900)]
Handle Uninitialized scalar field issue
Added default constructor to initialize scalar field
resolves: 1216569, 1216584
Signed-off-by: hyeonseok lee <hs89.lee@samsung.com>
hyeonseok lee [Tue, 6 Apr 2021 11:52:14 +0000 (20:52 +0900)]
Handle Unchecked return value issue
Added if statement to check return value
resolve: 1216589
Signed-off-by: hyeonseok lee <hs89.lee@samsung.com>
Jihoon Lee [Fri, 2 Apr 2021 08:17:56 +0000 (17:17 +0900)]
[Compiler] Alternate GraphRepresentation
This patch alternates graph representation and move interpreter to a new
file
v2.
Also change documentation setup
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Jihoon Lee [Thu, 1 Apr 2021 10:36:08 +0000 (19:36 +0900)]
[Compiler] Add Graph Representation
This patch adds graph representation and it's interface
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Jihoon Lee [Thu, 1 Apr 2021 10:32:20 +0000 (19:32 +0900)]
[Compiler] Declare interface
This patch declares interface of compiler / interpreter
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Jihoon Lee [Thu, 1 Apr 2021 10:31:21 +0000 (19:31 +0900)]
[Compiler] Add concept of the compiler
This patch adds a concept of the compiler and class declaration.
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Jihoon Lee [Thu, 1 Apr 2021 08:05:58 +0000 (17:05 +0900)]
[Compiler/skeleton] Set up compiler source files
This patch setup compiler source files
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
jijoong.moon [Thu, 25 Mar 2021 07:39:47 +0000 (16:39 +0900)]
[ RNN ] Backwarding Implementation
This commit includes calculate gradient and derivatives of RNN Layer.
Resolves:
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: jijoong.moon <jijoong.moon@samsung.com>
Jihoon Lee [Tue, 30 Mar 2021 06:48:49 +0000 (15:48 +0900)]
[Deps] Add iniparser dependency version
From SRI-D it was reported that iniparser 3.x is not compatible.
This patch adds a version check for the iniparser
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Parichay Kapoor [Mon, 29 Mar 2021 11:34:49 +0000 (20:34 +0900)]
[c-api] c-api depends only on cc-api
Update c-api implementation to only depend on cc-api
Also add some minor additional functions in the cc-api
to support the c-api functionality.
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Parichay Kapoor [Mon, 29 Mar 2021 11:42:29 +0000 (20:42 +0900)]
[dataset] Update dataset cc-api
Update dataset cc-api to match with the c-api
Also remove extra redundant functionality
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Parichay Kapoor [Mon, 29 Mar 2021 10:18:45 +0000 (19:18 +0900)]
[model/API] Sync model cc API with c API
Sync the cc-API of model with the c-API
Some unnecessary functions have been removed.
Some others have been renamed.
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Parichay Kapoor [Fri, 26 Mar 2021 06:33:50 +0000 (15:33 +0900)]
[layer] Update layer cpp API
Update layer cpp API to match the c-api interface.
Move pluggableLayer related stuff to layer_internal.
See Also #986
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Parichay Kapoor [Fri, 26 Mar 2021 05:04:50 +0000 (14:04 +0900)]
[graph] Remove graph edges after compile
This patch removes edges from the graph after compiling to
save the memory. This graph can be reconstructed by adding those edges
again from the information in the layers themselves.
See also #986
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Parichay Kapoor [Fri, 26 Mar 2021 04:54:23 +0000 (13:54 +0900)]
[graph] Update setting output layers in graph + bug fix
Update setting output layers in graph to a unified location.
The graph is first made with just input layers.
Output layers are set at the end for the completeness at
one go than adding at each realization to avoid more errors.
Also, added a bug fix where the last layer in the model
is not the last layer in the ini file. Now the last layer
is not the last layer in the adj but the layer without any
output_layers.
See also #986
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Parichay Kapoor [Tue, 30 Mar 2021 05:09:31 +0000 (14:09 +0900)]
[model/ini] Update ini loader for model
Update ini loader for model to support more properties
than the ones which are hardcoded.
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Parichay Kapoor [Tue, 30 Mar 2021 02:06:04 +0000 (11:06 +0900)]
[ini] Add backward compatibility for optimizer
Added backward compatibility for optimizers.
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Parichay Kapoor [Fri, 26 Mar 2021 05:41:39 +0000 (14:41 +0900)]
[unittest] Added unittest for train without optimizer
Added unittest for training without optimizer and some
corresponding fixes.
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Parichay Kapoor [Fri, 19 Mar 2021 11:38:16 +0000 (20:38 +0900)]
[optimizer] Add optimizer section to INI
Add a new optimizer section to INI
This is essential to allow custom optimizers as the
properties of optimizers needs to be iterables.
Currently, optimizer needs to specified in the model, which
along being not the best design, limits the properties to
be set for the optimizer as the model loader has to know
which properties are for optimizer and which for model.
This patch separates the optimizer as a new section and updates
the unittests.
Note that this removes the default optimizer from adam. Now, it is
necessary for an optimizer to be defined in the model file, if to be used for training.
For inference, model can be defined without an optimizer.
Updated documentation for the changes made.
See also #986
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Jaeyun [Wed, 31 Mar 2021 06:11:32 +0000 (15:11 +0900)]
[Test/Util] use exit in script
'return' in script is not available, call 'exit' instead.
Signed-off-by: Jaeyun <jy1210.jung@samsung.com>
jijoong.moon [Wed, 31 Mar 2021 11:33:52 +0000 (20:33 +0900)]
[ LSTM ] Add Skeleton LSTM Layer Class
This PR includes skeleton code of lstm layer
Resolves:
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: jijoong.moon <jijoong.moon@samsung.com>
Jihoon Lee [Tue, 30 Mar 2021 05:48:40 +0000 (14:48 +0900)]
[Pooling2D] Change warning to error at init
For global_* pooling change warning to error for some parameter check
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Jihoon Lee [Mon, 29 Mar 2021 08:41:53 +0000 (17:41 +0900)]
[Pooling2D] Rework global max pooling
**Changes proposed in this PR:**
- Rework global max pooling to work with lambda function
- Remove switch cases for the main loop in pooling
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Jihoon Lee [Thu, 25 Mar 2021 13:14:44 +0000 (22:14 +0900)]
[Pooling2d] Rework Average Pooling
This patch refactors average pooling layer to not rely
on the pooling loop.
From this patch, max_idx is used to remember number of
effective elements used for the average calculation
Also add some checks on the `initailize`,
Also global average pooling is merged to average pooling
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Jihoon Lee [Thu, 25 Mar 2021 11:08:24 +0000 (20:08 +0900)]
[Pooling2d] Rework pooling to avoid padding
This patch
1. set up scaffolding for the pooling to reuse some loop.
2. initialize index vector when setting batch (fixes a hidden
bug)
3. implements max pooling without additional memory allocation
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Jihoon Lee [Mon, 29 Mar 2021 12:49:44 +0000 (21:49 +0900)]
[Pooling2D/Test] Add model tests
Add model test for various types of pooling2d
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
hyeonseok lee [Tue, 30 Mar 2021 04:51:54 +0000 (13:51 +0900)]
Handle BAD_OVERRIDE issue
Match type signatures with nntrainer::Optimizer by adding const
resolves: 458424, 458425
Self evaluation:
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: hyeonseok lee <hs89.lee@samsung.com>
Jihoon Lee [Mon, 22 Mar 2021 06:53:00 +0000 (15:53 +0900)]
[rpm] Fix nnstreamer dependency
This patch resolves nnstreamer dependency problem. Thus making rpm to
enable plugin related test.
This patch is wating for nnstreamer/api#21
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Parichay Kapoor [Tue, 30 Mar 2021 02:35:44 +0000 (11:35 +0900)]
[graph] Bug fix for no loss
Added bug fix for handling the scenario when there is no loss
specified. The issue was the difference in ordering of the loss
types in the parser and loss type enums.
This patch fixes it. Further, graph now simply returns if no loss found.
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
hyeonseok lee [Tue, 30 Mar 2021 03:48:16 +0000 (12:48 +0900)]
Handle Unchecked return value issue
Added return value of remove function
resolves: 1222078, 1223055
Signed-off-by: hyeonseok lee <hs89.lee@samsung.com>
Parichay Kapoor [Tue, 30 Mar 2021 03:42:00 +0000 (12:42 +0900)]
[graph/ini] Support for default input_layers
This patch adds support for default input_layers
If no input_layers is specified, the layer above
the current layer in the ini file or the previously
adding layer in the model becomes the input layer for the current layer.
However, this connection is only made if the current layer
has no input layers.
Resolves #1046
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Jihoon Lee [Thu, 25 Mar 2021 04:17:16 +0000 (13:17 +0900)]
[Conv2d/Test] Add conv2d multistride test
This patch enables conv2d uneven multistride test where some part of
images are dropped
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Jihoon Lee [Thu, 25 Mar 2021 04:15:19 +0000 (13:15 +0900)]
[Conv2d] Rework calcDerivative
**Changes proposed in this PR:**
- Rework conv2d::calcDerivative to enable calculating derivative when
some last strides are dropped.
- Disable channelmode im2col (commented because it is in the critical
path)
- Minor optimization on conv2d::forward
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
Jihoon Lee [Wed, 24 Mar 2021 07:19:48 +0000 (16:19 +0900)]
[Conv] Check conv2d restriction
This patch moves conv2d checks to the initialization.
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
jijoong.moon [Wed, 24 Mar 2021 01:35:58 +0000 (10:35 +0900)]
[ RNN ] Set tanh as an default activation function
Set the tanh as an default activation function
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: jijoong.moon <jijoong.moon@samsung.com>
jijoong.moon [Wed, 24 Mar 2021 11:06:48 +0000 (20:06 +0900)]
[ RNN ] Fix Tensor copy bug and set proper initialization
This commit includes
. Fix Tensor copy. using getSharedDataTensor from hidden and input
. set proper hidden initialization depending on traning and inference
. Fix proper calculation of hidden
. Remove setActivation
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: jijoong.moon <jijoong.moon@samsung.com>
jijoong.moon [Mon, 22 Mar 2021 12:28:34 +0000 (21:28 +0900)]
[ RNN ] support various activation function
In this PR, various activation functions are supported using ActiFunc
Class.
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: jijoong.moon <jijoong.moon@samsung.com>
jijoong.moon [Fri, 19 Mar 2021 08:34:34 +0000 (17:34 +0900)]
[ RNN ] Implementaion of forwarding
- Implementation of RNN forwarding.
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: jijoong.moon <jijoong.moon@samsung.com>
jijoong.moon [Thu, 18 Mar 2021 03:54:37 +0000 (12:54 +0900)]
[ RNN ] Add initialization of RNN
Add Initialization of RNN Layer
- Set dimension and Weight
- Add Unittest for initialization
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: jijoong.moon <jijoong.moon@samsung.com>
Parichay Kapoor [Thu, 18 Mar 2021 11:39:59 +0000 (20:39 +0900)]
[optimizer] Refactor optimizers
refactor optimizers to update to the new design. Now there are
two internal optimizer headers -
1. opitmizer_devel - which is used external of the optimizer. The
interface provided here must be sufficient to use the optimizer by
the models or other classes.
2. optimizer_impl - which also follows the same interface but provides
implementations for some more functions as well as some more member
variables.
optimizer.h in the API is a subset of the optimizer_devel which is the
exposed API for an external user to use.
optimizer_devel.h is the API which a user must implement when creating
their own optimizer.
optimizer_impl.h provides another class which a custom optimizer implementer
can extend for their ease.
These classes follow the below design
optimizer.h (ml::train::Optimizer) <- optimizer_devel.h (nntrainer::Optimizer)
<- optimizer_impl.h (nntrainer::OptimizerImpl)
Further, model, graph, and all other classes contains objects of type nntrainer::Optimizer
The c++ API is also reduced to match with the C API.
Once all the c++ APIs are matched with c API, then we can move more functions
from *_devel.h files to *.h files.
See also #986
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Parichay Kapoor [Thu, 18 Mar 2021 10:15:39 +0000 (19:15 +0900)]
[model-loader] Empty backbone now gives error
Added a check in model-loader where empty backbone now gives error.
For some reason, even the negative testcases for this scenario were made like
positive test cases. Updated them as well.
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Parichay Kapoor [Wed, 17 Mar 2021 04:19:12 +0000 (13:19 +0900)]
[graph] Bug fix for name update
Bug fix for name updates when new layers are being
added in the graph. Earlier, the names were modified only
for the first entry but this can be a problem later.
Further this imposed restrictions on the order of the use of
updateNameInLayers() and addLayerNode().
Now, with this patch, the names are updated for all layers
except self. Further, the names are updated for all occurences
than just the first layer. This resolves both the issues mentioned
above.
Added some comments and checks for the ith variable before accesing it.
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Parichay Kapoor [Tue, 16 Mar 2021 11:04:56 +0000 (20:04 +0900)]
[graph] Cleanup the graph
Cleanup redundant member variables from graph
Rename some of the functions. Some others to be modified
have been added as TODO.
getters have modified to work better.
Some redundant members have been removed from layer_internal as well.
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Parichay Kapoor [Tue, 16 Mar 2021 10:11:06 +0000 (19:11 +0900)]
[graph] Add compiled status to graph
Add compiled status to graph
Compiling multiple times or modifying the graph after compilation
is erronous. Getting sorted list before completing the compilation
is also an error.
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Parichay Kapoor [Tue, 16 Mar 2021 07:05:02 +0000 (16:05 +0900)]
[graph] Bug fixes in layer realizations
Add bug fixes for layer realizations for making the graph
Many scenarios were missed about creating connections for the graph
which this patch fixes.
Further, this patch reduce the isCompilable() checks as the first
layer cant be determined till the topologicalSort() of the graph is done.
Added checkCompiledGraph() where first layer and some more checks like
types are checked.
See Also #986
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Parichay Kapoor [Tue, 16 Mar 2021 05:16:05 +0000 (14:16 +0900)]
[graph] Move compile to graph
The compile has moved to graph and easier API exposed to model.
Also many public exposed functions reduced.
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
Parichay Kapoor [Tue, 16 Mar 2021 03:28:09 +0000 (12:28 +0900)]
[graph] Remove layers from graph
Update graph to remove layers and have a single data structure
for maintainence purposes. Now, adj represents the nodes list
which is unsorted. Sorted list of nodes is available after topological
sort in Sorted.
Additional Bug fixes:
- getSortedLayerNode was giving out wrong indices, its fixed now
- topological sort now empties sorted list before adding new elements
- other minor fixes to make adj replace layers
**Self evaluation:**
1. Build test: [x]Passed [ ]Failed [ ]Skipped
2. Run test: [x]Passed [ ]Failed [ ]Skipped
Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
jijoong.moon [Mon, 22 Mar 2021 12:25:20 +0000 (21:25 +0900)]
[ ActFunc ] Separate Activation Function from Activation Layer
In order to use Activation function method in other Layer, it is
better to make sepearte the activation function definition and Layer.
In this PR, new ActiFunc Class is introduced and midified the
activation layer to use it.
RNN Layer also use this as an private variable.
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: jijoong.moon <jijoong.moon@samsung.com>
hyeonseok lee [Tue, 23 Mar 2021 09:05:41 +0000 (18:05 +0900)]
[tensor_filter_nntrainer] Set custom deleter to unique_ptr
g_new() should match with g_malloc instread delete
Refer to https://developer.gnome.org/glib/stable/glib-Memory-Allocation.html
It handles HEAP_INCOMPATIBLE.FREE issue
resolves: 458008, 458009
Signed-off-by: hyeonseok lee <hs89.lee@samsung.com>
Jihoon Lee [Tue, 23 Mar 2021 05:35:56 +0000 (14:35 +0900)]
[TestHub] Produce xml output for gtest
As xml output is needed for the testhub, this patch add generation for
the meson test
**Self evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test: [X]Passed [ ]Failed [ ]Skipped
Signed-off-by: Jihoon Lee <jhoon.it.lee@samsung.com>
hyeonseok lee [Mon, 22 Mar 2021 06:25:37 +0000 (15:25 +0900)]
Handle uncaught exception issue
Added try catch statement
resolves: 1143556, 1144840
Signed-off-by: hyeonseok lee <hs89.lee@samsung.com>
hyeonseok lee [Mon, 22 Mar 2021 03:26:16 +0000 (12:26 +0900)]
Handle Large stack use(STACK_USE) issue
Coverity warns that in embedded application stack overflow may occur.
Because featureVector size(1080000) is bigger than maximum stack size(250000).
So define featureVector at the global area.
resolves: 1216560, 1216582
Signed-off-by: hyeonseok lee <hs89.lee@samsung.com>
hyeonseok lee [Mon, 22 Mar 2021 03:17:35 +0000 (12:17 +0900)]
Handle Not restoring ostream format(STREAM_FORMAT_STATE) issue
Restore outputstream adjustflag to standard stream
resolve: 1222083
Signed-off-by: hyeonseok lee <hs89.lee@samsung.com>
hyeonseok lee [Mon, 22 Mar 2021 01:50:13 +0000 (10:50 +0900)]
Handle Uninitialized scalar field(UNINIT_CTOR) issue
Set member variable buffer_size, buffer_axis in constructor
resolve: 1216586
Signed-off-by: hyeonseok lee <hs89.lee@samsung.com>
hyeonseok lee [Fri, 19 Mar 2021 06:56:28 +0000 (15:56 +0900)]
Handle Unchecked return value(CHECKED_RETURN) issues
Added check the return value
resolves: 1222078, 1222441
Signed-off-by: hyeonseok lee <hs89.lee@samsung.com>