caffe 学习笔记之ReLUParameter

caffe的官方描述
在proto中的定义为

message ReLUParameter {  // Allow non-zero slope for negative inputs to speed up optimization  // Described in:  // Maas, A. L., Hannun, A. Y., & Ng, A. Y. (2013). Rectifier nonlinearities  // improve neural network acoustic models. In ICML Workshop on Deep Learning  // for Audio, Speech, and Language Processing.  optional float negative_slope = 1 [default = 0];  enum Engine {    DEFAULT = 0;    CAFFE = 1;    CUDNN = 2;  }  optional Engine engine = 2 [default = DEFAULT];}