DL-2: Variants of Neural Network

来源:互联网 发布:讲课软件什么软件好 编辑:程序博客网 时间:2024/05/09 11:52

本文主要参考台湾大学李宏毅(Hung-yi Lee)的深度学习教程PPT文档。

  • CNN(Convolutional Neural Network) widely used in image processing.
  • RNN(Recurrent Neural Network) Neural Network with Memory.

CNN

A neuron does not have to see the whole image to discover the pattern.
Connecting to small region with less parameters.

  • The same patterns appear in different regions.
  • Subsampling the pixels will not change the object.

    Less parameters for the network to process the image.


cnn0

Convolution

cnn1

cnn2

cnn3

cnn4

Max Pooling

maxpooling0

maxpooling1

The whole CNN

TWCnn0

TWCnn1

TWCnn2

  • Less parameters
  • Even less parameters
  • Shared weights

TWCnn3

参考

  • Deep Learning Tutorial-李宏毅(Hung-yi Lee)
0 0
原创粉丝点击