PReLU Layer and its tests
authorTakuya Narihira <dvbscb@gmail.com>
Mon, 16 Feb 2015 17:52:47 +0000 (09:52 -0800)
committerTakuya Narihira <dvbscb@gmail.com>
Thu, 12 Mar 2015 04:24:12 +0000 (21:24 -0700)
commitbb5bf436c10dee68a31825edf65f39149034c4e0
tree38b3041bb6eebfa7c13c538c85b5faf985b0d140
parent4cf2c5916c7331dc8b61bdb4922952ceb61e2651
PReLU Layer and its tests

described in Kaiming He et al, "Delving Deep into Rectifiers: Surpassing
Human-Level Performance on ImageNet Classification", arxiv 2015.

Belows are commit message histories that I had while developing.

PReLULayer takes FillerParameter for init

PReLU testing consistency with ReLU

Fix : PReLU test concistency check

PReLU tests in-place computation, and it failed in GPU

Fix: PReLU in-place backward in GPU

PReLULayer called an incorrect API for copying
data (caffe_gpu_memcpy). First argment of `caffe_gpu_memcpy` should be
size of memory region in byte. I modified to use `caffe_copy` function.

Fix: style errors

Fix: number of axes of input blob must be >= 2

Use 1D blob, zero-D blob.

Rename: hw -> dim
include/caffe/neuron_layers.hpp
src/caffe/layers/prelu_layer.cpp [new file with mode: 0644]
src/caffe/layers/prelu_layer.cu [new file with mode: 0644]
src/caffe/proto/caffe.proto
src/caffe/test/test_neuron_layer.cpp