[multi_head_attention] implement calcDerivative, calcGradient
authorhyeonseok lee <hs89.lee@samsung.com>
Fri, 15 Jul 2022 05:46:20 +0000 (14:46 +0900)
committerJijoong Moon <jijoong.moon@samsung.com>
Wed, 7 Sep 2022 12:15:26 +0000 (21:15 +0900)
commit8bc7265f8b99e920b78abf989c994260de38e186
tree9073c346aa46cf8a5fc444a5cbe31c0f51a66c81
parenta0a3ee08ee30d2d166564c21c0bbdb319ccf91d2
[multi_head_attention] implement calcDerivative, calcGradient

 - Implement multi head attention calcDerivative, calcGradient
 - Needs to support bool type attention mask

Signed-off-by: hyeonseok lee <hs89.lee@samsung.com>
nntrainer/layers/multi_head_attention_layer.cpp