projects / platform / core / ml / nntrainer.git / commit
? search:
summary | shortlog | log | commit | commitdiff | tree
(parent: 8857798) | patch
[activation] add gelu function
authorSeungbaek Hong <sb92.hong@samsung.com>
Mon, 22 May 2023 02:32:26 +0000 (11:32 +0900)
committerJijoong Moon <jijoong.moon@samsung.com>
Tue, 23 May 2023 10:09:29 +0000 (19:09 +0900)
commit8ee8c43e735607497e1adadcbd4cfdf4786a4215
treeffabb1f9f71259aa3323b1e92625819ba590088atree | snapshot
parent8857798b6679b924ccad0d7a8383164a0c41a7e1commit | diff
[activation] add gelu function

Added GELU activation function for supporting gpt.

I created unittest for this using pytorch.

**Self evaluation:**
1. Build test:  [X]Passed [ ]Failed [ ]Skipped
2. Run test:  [X]Passed [ ]Failed [ ]Skipped

Signed-off-by: Seungbaek Hong <sb92.hong@samsung.com>
api/ccapi/include/layer.h diff | blob | history
nntrainer/layers/acti_func.cpp diff | blob | history
nntrainer/layers/acti_func.h diff | blob | history
nntrainer/layers/common_properties.h diff | blob | history
test/unittest/layers/unittest_layers_activation.cpp diff | blob | history
test/unittest/unittest_nntrainer_activations.cpp diff | blob | history
Domain: Machine Learning / ML Framework;