深度学习你需要了解的名词（中英文对照）

主要内容来自于孙逊等人对斯坦福大学深度学习教程UFLDL Tutorial的翻译，并在此基础上不断补充和修订。

activation                  激活值activation function          激活函数additive noise                  加性噪声autoencoder                  自编码器Autoencoders                  自编码算法average firing rate          平均激活率average sum-of-squares error  均方差backpropagation                  后向传播basis                          基basis feature vectors          特征基向量batch gradient ascent          批量梯度上升法Bayesian regularization method  贝叶斯规则化方法Bernoulli random variable  伯努利随机变量bias term                   偏置项binary classfication          二元分类class labels                  类型标记concatenation                  级联conjugate gradient           共轭梯度contiguous groups          联通区域convex optimization software  凸优化软件convolution                  卷积cost function                  代价函数covariance matrix          协方差矩阵DC component                  直流分量decorrelation                  去相关degeneracy                  退化demensionality reduction          降维derivative                  导函数diagonal                          对角线diffusion of gradients          梯度的弥散eigenvalue                  特征值eigenvector                  特征向量error term                  残差feature matrix                   特征矩阵feature standardization          特征标准化feedforward architectures  前馈结构算法feedforward neural network  前馈神经网络feedforward pass                  前馈传导fine-tuned                  微调first-order feature          一阶特征forward pass                  前向传导forward propagation          前向传播Gaussian prior                  高斯先验概率generative model                  生成模型gradient descent              梯度下降Greedy layer-wise training  逐层贪婪训练方法grouping matrix                  分组矩阵Hadamard product                  阿达马乘积Hessian matrix Hessian           矩阵hidden layer                  隐含层hidden units                  隐藏神经元Hierarchical grouping          层次型分组higher-order features          更高阶特征highly non-convex optimization problem高度非凸的优化问题histogram                  直方图hyperbolic tangent          双曲正切函数hypothesis                  估值，假设identity activation function  恒等激励函数IID                          独立同分布illumination                  照明inactive                          抑制independent component analysis  独立成份分析input domains                  输入域input layer                  输入层intensity                  亮度/灰度intercept term                  截距KL divergence                  相对熵KL divergence                  KL分散度k-Means                          K-均值learning rate                  学习速率least squares                  最小二乘法linear correspondence          线性响应linear superposition          线性叠加line-search algorithm          线搜索算法local mean subtraction          局部均值消减local optima                  局部最优解logistic regression          逻辑回归loss function                  损失函数low-pass filtering          低通滤波magnitude                  幅值MAP                          极大后验估计maximum likelihood estimation  极大似然估计mean                          平均值MFCCMel                       倒频系数multi-class classification  多元分类neural networks                  神经网络neuron                          神经元Newton's method                   牛顿法non-convex function          非凸函数non-linear feature          非线性特征norm                          范式norm bounded                  有界范数norm constrained                  范数约束normalization                  归一化numerical roundoff errors   数值舍入误差numerically checking           数值检验numerically reliable          数值计算上稳定object detection                  物体检测objective function          目标函数off-by-one error           缺位错误orthogonalization          正交化output layer                  输出层overall cost function          总体代价函数over-complete basis          超完备基over-fitting                  过拟合parts of objects                目标的部件part-whole decompostion          部分-整体分解PCA                          主元分析penalty term                  惩罚因子per-example mean subtraction  逐样本均值消减pooling                          池化pretrain                         预训练principal components analysis  主成份分析quadratic constraints          二次约束RBMs                          受限Boltzman机reconstruction based models  基于重构的模型reconstruction cost          重建代价reconstruction term          重构项redundant                  冗余reflection matrix          反射矩阵regularization                  正则化regularization term          正则化项rescaling                  缩放robust                          鲁棒性run                          行程second-order feature          二阶特征sigmoid activation function  S型激励函数significant digits                有效数字singular value                  奇异值singular vector                  奇异向量smoothed L1 penalty          平滑的L1范数惩罚Smoothed topographic L1 sparsity penalty平滑地形L1稀疏惩罚函数smoothing                  平滑Softmax Regresson          Softmax回归sorted in decreasing order  降序排列source features                  源特征sparse autoencoder          消减归一化Sparsity                        稀疏性sparsity parameter        稀疏性参数sparsity penalty                稀疏惩罚square function                平方函数squared-error                方差stationary                平稳性（不变性）stationary stochastic process平稳随机过程step-size                 步长值supervised learning        监督学习symmetric positive semi-definite matrix对称半正定矩阵symmetry breaking        对称失效tanh function                双曲正切函数the average activation        平均活跃度the derivative checking method梯度验证方法the empirical distribution经验分布函数the energy function        能量函数the Lagrange dual        拉格朗日对偶函数the log likelihood        对数似然函数the pixel intensity value像素灰度值the rate of convergence        收敛速度topographic cost term        拓扑代价项topographic ordered        拓扑秩序transformation                变换translation invariant        平移不变性trivial answer                平凡解under-complete basis        不完备基unrolling                 组合扩展unsupervised learning        无监督学习variance                        方差vecotrized implementation向量化实现vectorization                矢量化visual cortex                视觉皮层weight decay                权重衰减weighted average                加权平均值whitening                白化zero-mean                均值为零