platform/upstream/nnstreamer.git
18 months ago[EDGE] Add MQTT data transmission test
gichan [Wed, 15 Mar 2023 08:15:47 +0000 (17:15 +0900)]
[EDGE] Add MQTT data transmission test

Add run test for MQTT data transmission of edgesrc/sink.

Signed-off-by: gichan <gichan2.jang@samsung.com>
18 months ago[test] Add test for tensor_mux with 20 sinkpads
Yongjoo Ahn [Thu, 9 Feb 2023 12:50:26 +0000 (21:50 +0900)]
[test] Add test for tensor_mux with 20 sinkpads

- Add a testcase of tensor_mux with 20 sinkpads

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
18 months ago[common] Fix gst_tensors_config_from_structure to support extra tensors
Yongjoo Ahn [Thu, 9 Feb 2023 13:00:47 +0000 (22:00 +0900)]
[common] Fix gst_tensors_config_from_structure to support extra tensors

- if num_tensors is larger than NNS_TENSOR_SIZE_LIMIT, create extra info
  in the tensors info

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
18 months ago[common] Update gst_tensor_time_sync_buffer_from_collectpad to support extra tensors
Yongjoo Ahn [Thu, 9 Feb 2023 12:46:33 +0000 (21:46 +0900)]
[common] Update gst_tensor_time_sync_buffer_from_collectpad to support extra tensors

- Fix the api to collect buffer from pads more than NNS_TENSOR_SIZE_LIMIT.
- This api currently used in the tensor_mux and tensor_merge.

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
18 months ago[tensor_mux] Free tensors_config in finalize function.
Yongjoo Ahn [Thu, 9 Feb 2023 12:45:45 +0000 (21:45 +0900)]
[tensor_mux] Free tensors_config in finalize function.

- Free configured tensors_config in the finalization.

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
18 months ago[datareposrc] Add start/stop-sample-index and epochs property
hyunil park [Fri, 10 Feb 2023 09:16:51 +0000 (18:16 +0900)]
[datareposrc] Add start/stop-sample-index and epochs property

- Add start-sample-index and stop-sample-index for setting
  range of files or samples to read (set none, set both, or set one)
- Add epochs property to set number of repetitions,
  datareposrc read range of files or samples for epochs
- Add gst_base_src_set_live and move start function to create function.
  a. datareposrc can get media type and size after set_caps(), but
     set_caps is completed after PAUSED_TO_PLAYING.
  b. filling the buffer should be pending until set_caps().
  c. datareposrc is a live source.

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
19 months ago[tensor_trainer] Modify query caps to support negotiation with fixed caps of peers
hyunil park [Mon, 30 Jan 2023 02:16:06 +0000 (11:16 +0900)]
[tensor_trainer] Modify query caps to support negotiation with fixed caps of peers

- Support negotiation without tensor_converter
- Modify Example launch line

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
19 months ago[datareposrc] Add supportable caps and function to read file
hyunil park [Wed, 8 Feb 2023 06:37:30 +0000 (15:37 +0900)]
[datareposrc] Add supportable caps and function to read file

- Add supportable caps
  other/tensors, video/x-raw, audio/x-raw, text/x-raw, application/octet-stream
  image/png, image/jpeg, image/tiff, image/gif

- Add get_caps and set_caps function for caps negotiation

- Get media mimetype and media size after set_caps
  a. get video size (Byte/frame)
  b. get audio size (Bps)
  c. get tensor type size

- Add function to read file from the MLOps Data repository
  a. In case of tensors, tensors data are added to a single gstbuffer.
  b. In case of image files, a image file is added to a single gstbuffer,
     Images are numbered files
  c. In other cases, data of size calculated in set_caps is added to a singgle gstbuffer

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
19 months ago[tensor_trainer] Add epochs property
hyunil park [Thu, 5 Jan 2023 07:13:12 +0000 (16:13 +0900)]
[tensor_trainer] Add epochs property

- Add epochs property to inform the total amount of data subplugin can receive
- tensor_trainer should receive total number of samples (num-training-samples + num-validation-samples) * epochs
- Change data type of some properties from uint to int64
- Modify Example launch

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
19 months ago[Tests] Move generateTest script to non-optional test directory
Alexi Birlinger [Wed, 12 Apr 2023 07:58:50 +0000 (09:58 +0200)]
[Tests] Move generateTest script to non-optional test directory

Script 'generateTest.py' location induces ssat test failures for platform not supporting
Pytorch as meson build set nnstreamer_filter_pytorch only if 'pytorch_support_is_available'
flag is true.

Move 'generateTest.py' script to nnstreamer_converter directory as this test suite is
installed by default. This location has been selected for two main reasons:
    - nnstreamer_converter is using this script
    - another script used in the same way was already located in this directory

Signed-off-by: Alexi Birlinger <alexi.birlinger@nxp.com>
19 months ago[test] Fix unittest_sink with recent change in GstTensorsInfo
Yongjoo Ahn [Thu, 9 Feb 2023 12:38:32 +0000 (21:38 +0900)]
[test] Fix unittest_sink with recent change in GstTensorsInfo

- Add init and free of tensors_info in the callback

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
19 months ago[test] Add and fix tensor info tests using extra info
Yongjoo Ahn [Tue, 7 Feb 2023 07:11:49 +0000 (16:11 +0900)]
[test] Add and fix tensor info tests using extra info

- Add test for new utils which handle extra info
- Fix tests that check NNS_TENSOR_SIZE_LIMIT in get/parse type/dim/name
  of tensor_info

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
19 months ago[common] Add utils for extra info in tensors_info
Yongjoo Ahn [Tue, 7 Feb 2023 07:08:48 +0000 (16:08 +0900)]
[common] Add utils for extra info in tensors_info

- Add create and free APIs for extra info
- `gst_tensors_info_extra_create (GstTensorsInfo *info)
- `gst_tensors_info_extra_free (GstTensorsInfo *info)
- Fix get/parse utils for type, dim, name of tensor_info

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
19 months ago[common] Add extra tensorInfo for 16+th tensors
Yongjoo Ahn [Tue, 7 Feb 2023 04:57:37 +0000 (13:57 +0900)]
[common] Add extra tensorInfo for 16+th tensors

- Add a pointer of GstTensorInfo in GstTensorsInfo struct. And name it
  as "extra"

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
19 months ago[Tizen] allowed elements - datarepo
Jaeyun Jung [Fri, 14 Apr 2023 07:03:38 +0000 (16:03 +0900)]
[Tizen] allowed elements - datarepo

Update the list of allowed elements - add datareposrc/sink in Tizen.

Signed-off-by: Jaeyun Jung <jy1210.jung@samsung.com>
19 months ago[datareposink] Create datareposink initial element
hyunil park [Thu, 30 Mar 2023 07:07:05 +0000 (16:07 +0900)]
[datareposink] Create datareposink initial element

- Create datareposink initial version
- Add location property to set the path for saving a file
- Add basic file writing functionality

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
19 months ago[transform] add per-channel op w/ORC
byunghun [Tue, 11 Apr 2023 05:35:14 +0000 (14:35 +0900)]
[transform] add per-channel op w/ORC
add if statement to support tensor transform arithmetic orc op w/ORC

Signed-off-by: byunghun <byungs286@gmail.com>
19 months ago[Subplugin/TRIx] rank limit accepted/tizen/unified/20230413.123717
Jaeyun Jung [Thu, 6 Apr 2023 11:19:02 +0000 (20:19 +0900)]
[Subplugin/TRIx] rank limit

Check rank limit (max rank in trix-engine is 4 but nnstreamer is 8)

Signed-off-by: Jaeyun Jung <jy1210.jung@samsung.com>
19 months ago[Util] add structure in caps for backward compatibility
Yelin Jeong [Thu, 26 Jan 2023 01:40:42 +0000 (10:40 +0900)]
[Util] add structure in caps for backward compatibility

This patch adds structure in caps for backward compatibility.
_get_tensor(s)_caps returns caps which have both 4,8 rank dimension.

Signed-off-by: Yelin Jeong <yelini.jeong@samsung.com>
19 months ago[transform] increase rank for tensor_transform
Yelin Jeong [Thu, 29 Dec 2022 01:55:26 +0000 (10:55 +0900)]
[transform] increase rank for tensor_transform

This patch increases rank to 8 for tensor_transform.
- change regex pattern
- add test cases using transpose, dimchg

Signed-off-by: Yelin Jeong <yelini.jeong@samsung.com>
19 months ago[tizensensor] Increase TizenSensorSpec dimension
Yelin Jeong [Thu, 29 Dec 2022 01:48:58 +0000 (10:48 +0900)]
[tizensensor] Increase TizenSensorSpec dimension

This patch increases TizenSensorSpec's dimension to 8.

Signed-off-by: Yelin Jeong <yelini.jeong@samsung.com>
19 months ago[Tests] Add tests for increasing rank
Yelin Jeong [Thu, 29 Dec 2022 01:45:16 +0000 (10:45 +0900)]
[Tests] Add tests for increasing rank

This patch changes hardcoded ranks and adds higher rank testdata.

Signed-off-by: Yelin Jeong <yelini.jeong@samsung.com>
19 months ago[tensor] increase NNS_TENSOR_RANK_LIMIT
Yelin Jeong [Tue, 27 Dec 2022 09:46:11 +0000 (18:46 +0900)]
[tensor] increase NNS_TENSOR_RANK_LIMIT

This patch increases NNS_TENSOR_RANK_LIMIT to 8

Signed-off-by: Yelin Jeong <yelini.jeong@samsung.com>
19 months ago[tensor_trainer] Determined g_cond_wait by train_complete when receive EOS
hyunil park [Wed, 4 Jan 2023 09:43:48 +0000 (18:43 +0900)]
[tensor_trainer] Determined g_cond_wait by train_complete when receive EOS

- To avoid dead lock, g_cond_wait is determined by train_complete value of
GstTensorTrainerFrameworkInfo when receive EOS

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
19 months ago[GithubAction] Remove ubuntu 18.04 build
gichan [Tue, 4 Apr 2023 02:50:53 +0000 (11:50 +0900)]
[GithubAction] Remove ubuntu 18.04 build

Remove ubuntu 18.04 build since this distro has benn deprecated.
refer:
Annotations
2 errors and 5 warnings
build (ubuntu-18.04)
The ubuntu-18.04 environment is deprecated, consider switching to ubuntu-20.04 or ubuntu-22.04 (ubuntu-latest). For more details, see https://github.com/actions/runner-images/issues/6002
build (ubuntu-18.04)
GitHub Actions has encountered an internal error when running your job.

Signed-off-by: gichan <gichan2.jang@samsung.com>
19 months ago[filter] Fix the wrong index in tflite filter
Yelin Jeong [Thu, 23 Mar 2023 08:49:55 +0000 (17:49 +0900)]
[filter] Fix the wrong index in tflite filter

This patch fixes the wrong start index in tflite filter.
If rank starts from 0, some dimension info can be ignored.

Signed-off-by: Yelin Jeong <yelini.jeong@samsung.com>
19 months ago[Common] hide struct for extra tensor
Jaeyun Jung [Tue, 21 Mar 2023 06:31:13 +0000 (15:31 +0900)]
[Common] hide struct for extra tensor

Hide data structure (header in memory block) for extra tensor.

Signed-off-by: Jaeyun Jung <jy1210.jung@samsung.com>
19 months ago[CodeClean] function to add extra tensor
Jaeyun Jung [Mon, 20 Mar 2023 09:44:58 +0000 (18:44 +0900)]
[CodeClean] function to add extra tensor

Code clean and fix svace issue,
1. update util function name and remove unnecessary function.
2. unmap gst-memory if failed to handle extra tensor.

Signed-off-by: Jaeyun Jung <jy1210.jung@samsung.com>
20 months ago[Query] Remove UDP connection type from tensor_query. accepted/tizen/unified/20230321.123201
gichan [Wed, 15 Mar 2023 08:23:05 +0000 (17:23 +0900)]
[Query] Remove UDP connection type from tensor_query.

Remove UDP connection type because we don't have plan to support it for
tensor query.

Signed-off-by: gichan <gichan2.jang@samsung.com>
20 months ago[API][trainer] Rename some variable to use nouns instead of verbs
hyunil park [Thu, 2 Mar 2023 06:11:24 +0000 (15:11 +0900)]
[API][trainer] Rename some variable to use nouns instead of verbs

- Rename 'train' and 'valid' to 'training' and 'validation'

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
20 months ago[datareposrc] Create datareposrc initial element
hyunil park [Mon, 30 Jan 2023 10:59:35 +0000 (19:59 +0900)]
[datareposrc] Create datareposrc initial element

- Create datareposrc initial version

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
20 months ago[tensor_trainer] Change the condition for generating the output tensor
hyunil park [Tue, 27 Dec 2022 06:31:57 +0000 (15:31 +0900)]
[tensor_trainer] Change the condition for generating the output tensor

- An output tensor is created when there is a epoch result
- Remove push_output property
- output type is changed to float64
- Add gst_buffer_unref() in chain function to unref input gstbuffer

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
20 months ago[build] Fix gbs.conf for tizen repos
Yongjoo Ahn [Tue, 21 Feb 2023 03:48:33 +0000 (12:48 +0900)]
[build] Fix gbs.conf for tizen repos

- Change latest -> reference to fix CI build failure

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
21 months ago[test] Add simple unittest using "extra tensors" APIs accepted/tizen/unified/20230215.155633
Yongjoo Ahn [Mon, 30 Jan 2023 11:56:49 +0000 (20:56 +0900)]
[test] Add simple unittest using "extra tensors" APIs

- Add a simple TC which push and get 20 tensors.
- Note that the pipeline used in this TC does not care about the caps or negotiation.

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
21 months ago[trivial] Check gst-indent to nnstreamer_plugin_api
Yongjoo Ahn [Thu, 9 Feb 2023 12:30:33 +0000 (21:30 +0900)]
[trivial] Check gst-indent to nnstreamer_plugin_api

- Run gst-indent to nnstreamer_plugin_api.h and
  nnstreamer_plugin_api_impl.c

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
21 months ago[common] Add API which appends a GstMemory into given GstBuffer
Yongjoo Ahn [Thu, 9 Feb 2023 12:11:10 +0000 (21:11 +0900)]
[common] Add API which appends a GstMemory into given GstBuffer

- Add a function to check whether the given memory has extra tensors.
- Add an API which appends given GstMemory into given GstBuffer.
  It append the memory into the last block of buffer with given tensor
  info in extra tensor scenario.

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
21 months ago[num_tensors] Add APIs for GstTensorExtraInfo
Yongjoo Ahn [Mon, 30 Jan 2023 11:52:42 +0000 (20:52 +0900)]
[num_tensors] Add APIs for GstTensorExtraInfo

- Add an init API `gst_tensors_extra_init`
- Add an API `gst_tensors_get_nth_memory` which returns GstMemory from given GstBuffer with index larger than 16.

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
21 months ago[num_tensors] Add header structure for 16+th tensors.
Yongjoo Ahn [Mon, 30 Jan 2023 11:49:51 +0000 (20:49 +0900)]
[num_tensors] Add header structure for 16+th tensors.

- Those tensors would be packed into 16th GstMemory in a GstBuffer.
- Define NNS_TENSOR_SIZE_EXTRA_LIMIT as 200

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
21 months ago[Test] Fix the test failure
Sangjung Woo [Wed, 8 Feb 2023 05:30:38 +0000 (14:30 +0900)]
[Test] Fix the test failure

After upgrading the version of GStreamer to 1.22.0, the test case of the
Tizen sensor filter failed. This is mainly because gst_parse_launch()
can return a non-NULL value even though the error is set. So error
should be checked first before using the return value of
gst_parse_launch(). This code fixes this bug.

Signed-off-by: Sangjung Woo <sangjung.woo@samsung.com>
21 months ago[tensor_converter] Remove a seemingly unnecessary caps attribute views=1
Torsten Schulz [Fri, 13 Jan 2023 01:47:56 +0000 (17:47 -0800)]
[tensor_converter] Remove a seemingly unnecessary caps attribute views=1

This fix makes tensor_converter compatible with vaapih264dec and adds a WARNING if incoming video caps views>1.

The need for this workaround and warning has been surfaced because of
a bug in vaapih264hdec https://gitlab.freedesktop.org/gstreamer/gstreamer/-/issues/1712
which provides `video/x-raw, ... multiview-mode=(string)mono, ... views=(int)2`.
The caps restriction of `views=(int)1` prohibits the successful negotiation.

This has been tested with a mono video but not with a truly
stereoscopic video which might need further handling in the buffer
processing.

Signed-off-by: Torsten Schulz <torsten.schulz@gmail.com>
21 months ago[tensor_trainer] Rename callback parameter name
hyunil park [Fri, 20 Jan 2023 02:22:39 +0000 (11:22 +0900)]
[tensor_trainer] Rename callback parameter name

- Change 'train' and 'invoke' to 'start' and 'push_data' respectively
- Rename function releated to callback
- fix typo

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
21 months ago[tensor_trainer] Fixed output tensor's dimension and type
hyunil park [Mon, 26 Dec 2022 06:22:31 +0000 (15:22 +0900)]
[tensor_trainer] Fixed output tensor's dimension and type

Remove the properties that determines the output tensor's caps

- Remove output and outputtype property
- Add initialization of output tensor's dimension and type
- output dimension is 1:1:4:1, '4' has the value of loss, accuracy,
  val_loss, val_accuracy
- output type is float16
- Modify example launch line and log

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
21 months ago[tensor_trainer] Change tensor_trainer from GstBaseTransfrom to GstElement
hyunil park [Thu, 15 Dec 2022 07:00:06 +0000 (16:00 +0900)]
[tensor_trainer] Change tensor_trainer from GstBaseTransfrom to GstElement

- A deleted GstBaseTransfrom's inheritance and used GstElement to push
  GstBuffer only when necessary.
- Add event and query function for caps negotiation
- Add chain function for handling input buffer
- Remove virtual function of GstBaseTransfrom

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
21 months ago[tensor_trainer] Add train_complete_cond signal
hyunil park [Tue, 13 Dec 2022 05:46:25 +0000 (14:46 +0900)]
[tensor_trainer] Add train_complete_cond signal

- Add signal for waitng model train complete

Tensor trainer need to wait when receive EOS event before model training is complete,
subplugin should send signal when model train is complete

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
21 months ago[tensor_trainer] Apply tensor trainer sub-plugin structure
hyunil park [Thu, 1 Dec 2022 08:56:57 +0000 (17:56 +0900)]
[tensor_trainer] Apply tensor trainer sub-plugin structure

- Apply GstTensorTrainerProperties for internal data required by sub-plugin
- Apply GstTensorTrainerFramework for sub-plugin definition
- Apply trainer subpluginType(NNS_SUBPLUGIN_TRAINER) to get, register and
  unregister subplugin
- Add model-save-path property to set path for saving trained model

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
21 months ago[tensor_trainer] Add properties for training in sub-plugin
hyunil park [Mon, 31 Oct 2022 04:59:29 +0000 (13:59 +0900)]
[tensor_trainer] Add properties for training in sub-plugin

- Add model-config to set model configuration file,
  it is used to configure the model to be trained in framework
- Add push-output to push output tensors, default value is false
- Add num-inputs to set how many inputs are received,
  an input in a tensor can have one or more features data
- Add num-labels to set how many labels are received,
  a label in a tensor can have one or more classes data
- Add num-training-samples to set how many samples are taken for training model
- Add num-validation-samples to set how many samples are taken for validation model

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
21 months ago[tensor_trainer] Create tensor_trainer initial element
hyunil park [Fri, 28 Oct 2022 00:09:07 +0000 (09:09 +0900)]
[tensor_trainer] Create tensor_trainer initial element

- Add basic function (event handler, finalize, start, stop, change state, property)
- Add property (framework, input, output, inputtype and outputtype)
- Add caps negotiation (transform_caps, fixate_caps and set_caps)
- Add checking pipeline's input tensor info and tensor's set property values
- Add finding framework and sub-plugin
- Add calling invoke function in transfrom function

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
21 months ago[API][trainer] Packaging nnstreamer_plugin_api_trainer.h into debian accepted/tizen/unified/20230131.162133
hyunil park [Wed, 25 Jan 2023 02:18:43 +0000 (11:18 +0900)]
[API][trainer] Packaging nnstreamer_plugin_api_trainer.h into debian

- Packaing header file to nnstreamer-single-dev.install

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
21 months ago[API][trainer] Change type of train_complete to int
hyunil park [Wed, 25 Jan 2023 01:57:05 +0000 (10:57 +0900)]
[API][trainer] Change type of train_complete to int

- Sub-plugin using c++ cannot access this type

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
21 months ago[API][trainer] Change callback parameter name of GstTensorTrainerFramework
hyunil park [Wed, 18 Jan 2023 04:23:32 +0000 (13:23 +0900)]
[API][trainer] Change callback parameter name of GstTensorTrainerFramework

- Change 'train' and 'invoke' to 'start' and 'push_data' respectively

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
22 months ago[Query] Prevent overwriting of the query server caps accepted/tizen/unified/20230118.172039
gichan [Fri, 6 Jan 2023 04:52:02 +0000 (13:52 +0900)]
[Query] Prevent overwriting of the query server caps

Add new function to set query server caps.
This patch prevents the race condition of the query server caps.

Signed-off-by: gichan <gichan2.jang@samsung.com>
22 months ago[API][trainer] Add number of epoch and epoch count
hyunil park [Thu, 5 Jan 2023 05:13:00 +0000 (14:13 +0900)]
[API][trainer] Add number of epoch and epoch count

- Add num_epochs to inform the total amount of data than sub-plugin can receive
- Add epoch count to provide currently epoch information for sub-plugin to tensor_trainer

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
22 months ago[API][trainer] Add train_complete to GstTensorTrainerFrameworkInfo
hyunil park [Wed, 4 Jan 2023 09:30:16 +0000 (18:30 +0900)]
[API][trainer] Add train_complete to GstTensorTrainerFrameworkInfo

To abvoid dead lock, g_cond_wait is determined by train_complete value
when receive EOS.

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
22 months ago[API] Add nnstreamer_plugin_api_trainer.h to spec for rpm packaging
hyunil park [Mon, 26 Dec 2022 08:28:14 +0000 (17:28 +0900)]
[API] Add nnstreamer_plugin_api_trainer.h to spec for rpm packaging

Add header to nnstreamer.spec for rpm packaging

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
22 months ago[API] Add structure for tensor_trainer's sub-plugin
hyunil park [Wed, 30 Nov 2022 04:31:03 +0000 (13:31 +0900)]
[API] Add structure for tensor_trainer's sub-plugin

- Create nnstreamer_plugin_api_trainer.h
- Add GstTensorTrainerFramework to define tensor_trainer sub-plugin
- Add GstTensorTrainerProperties to send tensor_trainer properties
- Add GstTensorTrainerFrameworkInfo to get framework information

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
22 months ago[fix][tensor_filter] Fix the first output with garbage value with tflite
Yongjoo Ahn [Tue, 3 Jan 2023 08:27:55 +0000 (17:27 +0900)]
[fix][tensor_filter] Fix the first output with garbage value with tflite

- The output buffer address may change after the first invoke.
- To handle this case, Memcpy the output from tflite interpreter
  at the first invoke.

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
22 months agoFilter/Meson: Move 'filter-snpe-list' to the build directory
Wook Song [Tue, 27 Dec 2022 04:35:50 +0000 (13:35 +0900)]
Filter/Meson: Move 'filter-snpe-list' to the build directory

This patch moves the 'filter-snpe-list' file generated during the build
time from the source directory to the build directory.

Signed-off-by: Wook Song <wook16.song@samsung.com>
22 months agoDist/Tizen: Define a macro that designates build directory
Wook Song [Tue, 27 Dec 2022 08:12:23 +0000 (17:12 +0900)]
Dist/Tizen: Define a macro that designates build directory

This patch replaces the hard-coded 'build' directory with a macro
designating the build directory.

Signed-off-by: Wook Song <wook16.song@samsung.com>
22 months ago[test] Add testcases for tensor_mux and tensor_merge with num_tensors=16
Yongjoo Ahn [Thu, 29 Dec 2022 08:31:30 +0000 (17:31 +0900)]
[test] Add testcases for tensor_mux and tensor_merge with num_tensors=16

- Add simple testcases for tensor_mux and tensor_merge when the
  num_tensors equals 16

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
22 months ago[fix] Fix NNS_TENSOR_SIZE_LIMIT check in collectpad
Yongjoo Ahn [Tue, 27 Dec 2022 04:56:10 +0000 (13:56 +0900)]
[fix] Fix NNS_TENSOR_SIZE_LIMIT check in collectpad

- Fix assertion checking the NNS_TENSOR_SIZE_LIMIT

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
22 months agoFilter/API: Fix wrong indentation accepted/tizen/unified/20230103.164729
Wook Song [Mon, 26 Dec 2022 04:16:29 +0000 (13:16 +0900)]
Filter/API: Fix wrong indentation

This is a trivial patch that fixes the wrong indentation.

Signed-off-by: Wook Song <wook16.song@samsung.com>
22 months agoFilter/API: Update out-of-date comments
Wook Song [Mon, 26 Dec 2022 03:32:26 +0000 (12:32 +0900)]
Filter/API: Update out-of-date comments

This patch updates out-of-date comments which have not followed the
changes in tensor_filter.c and tensor_filter_common.c.

Signed-off-by: Wook Song <wook16.song@samsung.com>
22 months agoFilter/API: Correct a typo
Wook Song [Mon, 26 Dec 2022 03:26:29 +0000 (12:26 +0900)]
Filter/API: Correct a typo

This patch corrected a type in the GstTensorFilterFramework's version
field.

Signed-off-by: Wook Song <wook16.song@samsung.com>
22 months ago[Join] Fix join run tesh pipeline.
gichan [Fri, 23 Dec 2022 06:12:51 +0000 (15:12 +0900)]
[Join] Fix join run tesh pipeline.

Fix join runTesh pipeline.
 - Increase the number of buffers : Before the multifilesink saves four files, the pipeline receives the EOS and stops. This is prevented by increasing the number of buffers.
 - Change tensor mux sync mode: Set the buffer used for comparison used by tensor_if slowly enough and sync on this buffer.
 - Enable timestamp.

Signed-off-by: gichan <gichan2.jang@samsung.com>
22 months agoGitHub/Actions: Enable binary tests defined in the meson script
Wook Song [Fri, 23 Dec 2022 02:21:38 +0000 (11:21 +0900)]
GitHub/Actions: Enable binary tests defined in the meson script

This patch makes the unit test cases defined in the meson build script
run.

Signed-off-by: Wook Song <wook16.song@samsung.com>
22 months agoGitHub/Actions: Use a matrix strategy in the workflow for Ubuntu
Wook Song [Mon, 5 Dec 2022 07:07:12 +0000 (16:07 +0900)]
GitHub/Actions: Use a matrix strategy in the workflow for Ubuntu

As 'ubuntu-latest' is currently migrating from 20.04 to 22.04 [1], this
patch uses a matrix strategy in our CI/CD workflow for Ubuntu.

[1] https://github.com/actions/runner-images#ongoing-migrations

Signed-off-by: Wook Song <wook16.song@samsung.com>
22 months ago[tests] change hardcoded dimension compare to use NNS_TENSOR_RANK_LIMIT
Yelin Jeong [Wed, 21 Dec 2022 08:26:36 +0000 (17:26 +0900)]
[tests] change hardcoded dimension compare to use NNS_TENSOR_RANK_LIMIT

This patch changes to use NNS_TENSOR_RANK_LIMIT instead of hardcoded dimension.
It will be used for increasing NNS_TENSOR_RANK_LIMIT

Signed-off-by: Yelin Jeong <yelini.jeong@samsung.com>
22 months ago[decoder] Support scaled-output model for yolov5 bounding box decoder
Yongjoo Ahn [Fri, 16 Dec 2022 07:12:58 +0000 (16:12 +0900)]
[decoder] Support scaled-output model for yolov5 bounding box decoder

- The yolov5 models released by github.com/ultralytics/yolov5 have
  different output semantics:
   - the output of tfliteand tf models should be scaled to input image
     size.
   - torchscript and others return scaled output value.
- This patch support those two semantics by add option3:
  - option1=yolov5 ...  option3=0 ... (default) for tflite models
  - option1=yolov5 ...  option3=1 ... for other models

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
22 months ago[decoder] Update yolov5 decoder parameters
Yongjoo Ahn [Fri, 16 Dec 2022 06:27:27 +0000 (15:27 +0900)]
[decoder] Update yolov5 decoder parameters

- Set the conf and iou threshold values to follow the upstream
  https://github.com/ultralytics/yolov5.

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
22 months ago[lcov] Change base directory
gichan [Thu, 22 Dec 2022 08:20:53 +0000 (17:20 +0900)]
[lcov] Change base directory

Because the file path for build has been changed to relative path, change base directory for lcov.
This patch fixes failure of coverage generation.

Signed-off-by: gichan <gichan2.jang@samsung.com>
22 months ago[spec] Disable armnn_support option as default accepted/tizen/unified/20221226.070009
Sangjung Woo [Thu, 22 Dec 2022 09:45:01 +0000 (18:45 +0900)]
[spec] Disable armnn_support option as default

Since ARMNN is deprecated in Tizen, this patch disables the
armnn_support option.

Signed-off-by: Sangjung Woo <sangjung.woo@samsung.com>
22 months ago[TEST/coverity] Check return value
gichan [Tue, 20 Dec 2022 07:53:59 +0000 (16:53 +0900)]
[TEST/coverity] Check return value

Fix coverity issue.
 - Check return value of `g_remove`.

Signed-off-by: gichan <gichan2.jang@samsung.com>
23 months agoriscv64 alpine linux --> ubuntu
MyungJoo Ham [Mon, 5 Dec 2022 10:32:17 +0000 (19:32 +0900)]
riscv64 alpine linux --> ubuntu

Try Ubuntu instead of alpine for riscv64 tests

Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
23 months ago[Svace] Fix the array overflow issue
Sangjung Woo [Fri, 16 Dec 2022 02:38:24 +0000 (11:38 +0900)]
[Svace] Fix the array overflow issue

The result of 'sizeof (dump_list_type) / sizeof (nnsconf_type_path)' is
4 but dump_list_str array has only 3 items. Because of this reason, it
can occur the array overflow issue. This patch fixes this issue.

Signed-off-by: Sangjung Woo <sangjung.woo@samsung.com>
23 months ago[Common] Add common utils for tensors dimension compare
Yelin Jeong [Wed, 7 Dec 2022 10:54:16 +0000 (19:54 +0900)]
[Common] Add common utils for tensors dimension compare

This patch adds common function for tensors dimension compare.

Signed-off-by: Yelin Jeong <yelini.jeong@samsung.com>
23 months ago[Query] remove mqtt connection type enum
gichan [Thu, 8 Dec 2022 06:35:08 +0000 (15:35 +0900)]
[Query] remove mqtt connection type enum

Since the tensor query does not send data through the mqtt, remove unnecessary enum.

Signed-off-by: gichan <gichan2.jang@samsung.com>
23 months ago[Meson] Don't use join_paths for library.
gichan [Mon, 12 Dec 2022 02:29:56 +0000 (11:29 +0900)]
[Meson] Don't use join_paths for library.

Let's use `files` instead of `join_paths` to create a library.
This patch prevents object file name containing the absolute path.
Refer: https://mesonbuild.com/Reference-manual_functions.html#join_paths

@todo: Update the tests in the next PR.

Signed-off-by: gichan <gichan2.jang@samsung.com>
23 months ago[Lua] Allow to declare TensorInfo not using full dimension
Yelin Jeong [Mon, 12 Dec 2022 08:09:48 +0000 (17:09 +0900)]
[Lua] Allow to declare TensorInfo not using full dimension

This patch allows to declare TensorInfo not using full dimension.
It will be used for increaseing NNS_TENSOR_RANK_LIMIT.

Signed-off-by: Yelin Jeong <yelini.jeong@samsung.com>
23 months ago[SUBPLUGIN] Support nnstreamer trainer subplugin
hyunil park [Wed, 7 Dec 2022 02:56:21 +0000 (11:56 +0900)]
[SUBPLUGIN] Support nnstreamer trainer subplugin

Allow to add trainer subplugin in runtime

- Add NNS_SUBPLUGIN_TRAINER to subpluginType
- Add NNSTREAMER_TRAINERS to meson.build
- Add group name(trainer) to nnstreamer.ini.in
- Add NNSTREAMER_TRAINER to spec

Signed-off-by: hyunil park <hyunil46.park@samsung.com>
23 months agoREADME: Replace the broken link for the SSDC 2019 page
Wook Song [Fri, 2 Dec 2022 14:23:20 +0000 (23:23 +0900)]
README: Replace the broken link for the SSDC 2019 page

This patch replaces the link for the SSDC 2019 page, which exists no
more (404 Not Found), in README.md with the YouTube link.

Signed-off-by: Wook Song <wook16.song@samsung.com>
23 months ago[Common] function to get peer caps
Jaeyun [Tue, 29 Nov 2022 02:07:23 +0000 (11:07 +0900)]
[Common] function to get peer caps

Code clean, remove unnecessary func call to get peer caps.

Signed-off-by: Jaeyun <jy1210.jung@samsung.com>
23 months agogithub-action: Add libunwind-dev for jammy (22.04)
Sangjung Woo [Thu, 1 Dec 2022 03:13:33 +0000 (12:13 +0900)]
github-action: Add libunwind-dev for jammy (22.04)

In case of Ubuntu 22.04, below error occurs since unmet dependencies.
This patch fixes this bug.
- libunwind-14-dev : Breaks: libunwind-dev but 1.3.2-2build2 is to be installed

Signed-off-by: Sangjung Woo <sangjung.woo@samsung.com>
23 months agolog: control dependency on execinfo with find_library
MyungJoo Ham [Thu, 24 Nov 2022 07:47:52 +0000 (16:47 +0900)]
log: control dependency on execinfo with find_library

Like Android, Alpine linux does not ahve execinfo, too.
Determine whether to use execinfo or not based on
find_library results.

Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
23 months agogithub-action: Add RISC-V build
MyungJoo Ham [Thu, 24 Nov 2022 04:46:19 +0000 (13:46 +0900)]
github-action: Add RISC-V build

This tries to enable RISC-V build in github-action
based on https://github.com/marketplace/actions/run-on-architecture-riscv64-alpine

In order to build in more primitive distro,
configure bixon/flex optional.

Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
23 months agoMake parser optional with meson_option.
MyungJoo Ham [Thu, 24 Nov 2022 06:27:18 +0000 (15:27 +0900)]
Make parser optional with meson_option.

For simpler distro or other OS, make parser support optional.

Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
23 months agoNew Element: tensor_debug tensor stream debugger
MyungJoo Ham [Fri, 23 Sep 2022 07:24:58 +0000 (16:24 +0900)]
New Element: tensor_debug tensor stream debugger

We introduce the new element of nnstreamer, tensor_debug.

Tensor_debug allows pipeline writers and application writers to
look at details of tensor stream properties and potentially
the performance profiling information of tensor streams at a
given point of a pipeline.

This commit is a scaffolding for tensor_debug, that do not have
its core function not implemented: _gst_tensor_debug_output().
This core function will be implemented in later PR.

This addresses #3910

Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
23 months agodebian: remove tensorflow1 from PPA
MyungJoo Ham [Thu, 24 Nov 2022 09:34:00 +0000 (18:34 +0900)]
debian: remove tensorflow1 from PPA

Let's not build obsolete tensorflow1.x subplugins
and remove them from official PPA build.

Fixes #3969

Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
23 months agosrc/iio: clean up build logic
MyungJoo Ham [Fri, 25 Nov 2022 01:40:26 +0000 (10:40 +0900)]
src/iio: clean up build logic

related logic rewritten:
- determine if src-iio is built
- determine if src-iio is registered
- determine if src-iio is tested via gtest

all the three decisions are unified for glitches in alpine build.

Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
23 months ago[build] Disable tflite-custom in cross build
Yongjoo Ahn [Tue, 22 Nov 2022 02:09:47 +0000 (11:09 +0900)]
[build] Disable tflite-custom in cross build

- In cross build, found tflite lib could has different arch with target
  system. Disable this feature for cross build.
- This fixes #3964

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
23 months agoWorkaround:CI/macos do not try to update brew images.
MyungJoo Ham [Mon, 21 Nov 2022 12:48:35 +0000 (21:48 +0900)]
Workaround:CI/macos do not try to update brew images.

Updating the given image incurs an error with sbt.
Don't try to update it.

Fixes #3960

Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
23 months ago[test] add tests for dimension declaration
Yelin Jeong [Fri, 4 Nov 2022 05:11:28 +0000 (14:11 +0900)]
[test] add tests for dimension declaration

This patch adds tests for dimension declaration.

Related issue #3937

Signed-off-by: Yelin Jeong <yelini.jeong@samsung.com>
23 months ago[Caps] update caps for negotiation
Yelin Jeong [Thu, 3 Nov 2022 06:53:18 +0000 (15:53 +0900)]
[Caps] update caps for negotiation

This patch adds update caps dimension properties.
`update_caps_dimension` uses peer_caps for negotiation.
`gst_tensor_caps_can_intersect` tries intersecting two tensor caps.
Both functions treat `a:b:c` and `a:b:c:1` equal.

Related issue #3937

Signed-off-by: Yelin Jeong <yelini.jeong@samsung.com>
23 months ago[TensorIf] Allow to declare option without full dimension
Yelin Jeong [Mon, 14 Nov 2022 08:03:32 +0000 (17:03 +0900)]
[TensorIf] Allow to declare option without full dimension

This patch allows to declare compared-value-option in tensor_if without full dimension.
Undeclared dimension will be filled with zero.

Signed-off-by: Yelin Jeong <yelini.jeong@samsung.com>
23 months agoUpdate macOS tutorial
Simon Guillot [Wed, 16 Nov 2022 08:49:17 +0000 (09:49 +0100)]
Update macOS tutorial

- Update the configure command for meson
- Removed table of content is already in the doc template
- Removed tools explanations that are duplicates of their own docs (brew, git)
- Removed commands outputs as they don't provide much info and are not up to date

Signed-off-by: Simon Guillot <cratere_01_tannin@icloud.com>
23 months agoUpdate gitignore
Simon Guillot [Wed, 16 Nov 2022 08:49:09 +0000 (09:49 +0100)]
Update gitignore

Signed-off-by: Simon Guillot <cratere_01_tannin@icloud.com>
23 months agoAdd alternative target for PyTorch on macOS
Simon Guillot [Wed, 16 Nov 2022 08:49:03 +0000 (09:49 +0100)]
Add alternative target for PyTorch on macOS

Signed-off-by: Simon Guillot <cratere_01_tannin@icloud.com>
2 years ago[svace] Fix mem leak in tensor_filter
Yongjoo Ahn [Fri, 18 Nov 2022 04:38:00 +0000 (13:38 +0900)]
[svace] Fix mem leak in tensor_filter

- Fix mem leak of the `latency`

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
2 years ago[svace] Remove unused code in gstjoin.c
Yongjoo Ahn [Fri, 18 Nov 2022 04:37:13 +0000 (13:37 +0900)]
[svace] Remove unused code in gstjoin.c

- Remove unused member `discont` from gstjoin

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>
2 years ago[Edge] Change input parameter type of the nns_edge_data_get. accepted/tizen/unified/20221115.172908
gichan [Mon, 24 Oct 2022 02:41:15 +0000 (11:41 +0900)]
[Edge] Change input parameter type of the nns_edge_data_get.

Change input parameter type of the nns_edge_data_get.
Need to SR with https://github.com/nnstreamer/nnstreamer-edge/pull/107

Signed-off-by: gichan <gichan2.jang@samsung.com>
2 years ago[build] Add compile arg for pytorch subplugin
Yongjoo Ahn [Fri, 11 Nov 2022 04:54:14 +0000 (13:54 +0900)]
[build] Add compile arg for pytorch subplugin

- Add `-Wno-unused-parameter` args because recent pytorch contains
  unused variables in its source.

Signed-off-by: Yongjoo Ahn <yongjoo1.ahn@samsung.com>