projects / platform / upstream / caffe.git / commit
? search:
summary | shortlog | log | commit | commitdiff | tree
(parent: 3b6fd1d) | patch
batch norm: hide statistics from solver, simplifying layer definition
authorEvan Shelhamer <shelhamer@imaginarynumber.net>
Tue, 30 Aug 2016 06:42:58 +0000 (23:42 -0700)
committerEvan Shelhamer <shelhamer@imaginarynumber.net>
Tue, 13 Sep 2016 06:14:35 +0000 (23:14 -0700)
commitc8f446f640b12b0577063eca8fab004e73c0aefc
treed80cd025eddc3197a2b174c4f545538e1a1a56d4tree | snapshot
parent3b6fd1d95b374b0484f32a4f86380714c456a293commit | diff
batch norm: hide statistics from solver, simplifying layer definition

batch norm statistics are not learnable parameters subject to solver
updates, so they must be shielded from the solver. `BatchNorm` layer now
masks its statistics for itself by zeroing parameter learning rates
instead of relying on the layer definition.

n.b. declaring `param`s for batch norm layers is no longer allowed.
include/caffe/layers/batch_norm_layer.hpp diff | blob | history
src/caffe/layers/batch_norm_layer.cpp diff | blob | history
Domain: Machine Learning / ML Framework;