[layer] Attention support for different key value
authorParichay Kapoor <pk.kapoor@samsung.com>
Fri, 8 Oct 2021 08:33:12 +0000 (17:33 +0900)
committerJijoong Moon <jijoong.moon@samsung.com>
Fri, 8 Oct 2021 11:25:06 +0000 (20:25 +0900)
commit3113df80e3821d848df6b7074861afb8fb4526ec
tree11fa8e9c1c9b8435e5a7ec8b04fff397ad9d9107
parent6cd353b11edec86da9d19999d86f31960ca2d41d
[layer] Attention support for different key value

This patch adds support for different values of key and value to
be given to the attention layer.
Corresponding unittests are also added.

Signed-off-by: Parichay Kapoor <pk.kapoor@samsung.com>
nntrainer/layers/attention_layer.cpp
nntrainer/layers/attention_layer.h
packaging/unittest_layers_v2.tar.gz
test/input_gen/genLayerTests.py
test/unittest/layers/unittest_layers_attention.cpp