What's Wrong with Deep Learning? Yann LeCun
来源:互联网 发布:南海 知乎 编辑:程序博客网 时间:2024/06/05 05:41
author: Yann LeCun
Facebook AI Research & New York University
Deep learning methods have had a profound impact on a number of areas in recent years, including natural image understanding and speech recognition. Other areas seem on the verge of being similarly impacted, notably natural language processing, biomedical image analysis, and the analysis of sequential signals in a variety of application domains. But deep learning systems, as they exist today, have many limitations.
First, they lack mechanisms for reasoning, search, and inference. Complex and/or ambiguous inputs require deliberate reasoning to arrive at a consistent interpretation.Producing structured outputs, such as a long text, or a label map for image segmentation, require sophisticated search and inference algorithms to satisfy complex sets of constraints. One approach to this problem is to marry deep learning with structured prediction (an idea first presented at CVPR 1997). While several deep learning systems augmented with structured prediction modules trained end to end have been proposed for OCR, body pose estimation, and semantic segmentation, new concepts are needed for tasks that require more complex reasoning.
Second, they lack short-term memory. Many tasks in natural language understanding, such asquestion-answering, require a way totemporarily store isolated facts. Correctly interpreting events in a video and being able to answer questions about it requires remembering abstract representations of what happens in the video. Deep learning systems, including recurrent nets, are notoriously inefficient at storing temporary memories. This has led researchers to propose neural nets systems augmented with separate memory modules, such asLSTM, Memory Networks, Neural Turing Machines, and Stack-Augmented RNN. While these proposals are interesting, new ideas are needed.
Lastly, they lack the ability to perform unsupervised learning. Animals and humans learn most of the structure of the perceptual world in an unsupervised manner. While the interest of the ML community in neural nets was revived in the mid-2000s by progress in unsupervised learning, the vast majority of practical applications of deep learning have used purely supervised learning.There is little doubt that future progress in computer vision will require breakthroughs in unsupervised learning, particularly for video understanding, But what principles should unsupervised learning be based on?
Preliminary works in each of these areas pave the way for future progress in image and video understanding.
- What's Wrong with Deep Learning? Yann LeCun
- What's Wrong with Deep Learning?
- 卷积神经网络-截自Deep Learning by Yann LeCun
- Pedestrian Detection with unsupervised multi-stage feature learning Yann LeCun
- What's wrong with arrays?
- What's wrong with arrays?
- What's wrong with 8051
- Facebook AI Director Yann LeCun on His Quest to Unleash Deep Learning and Make Machines Smarter
- 关于Yann LeCun, Yoshua Bengio & Geoffrey Hinton 的Deep Learning 学习摘要
- what's going wrong with me?
- What's Wrong With Hue Oozie Editor?
- Yann LeCun's answers from the Reddit AMA
- What's wrong with FND_WEB.PING in Release 12?
- “What's wrong with Object-Oriented Programming and Functional Programming”
- 卷积神经网络和CIFAR-10:Yann LeCun专访 Convolutional Nets and CIFAR-10: An Interview with Yann LeCun
- Yann LeCun,牛人也!
- What is Deep learning?
- Yann Lecun 深度学习建议
- android性能调优-工具记录
- tomcat ip地址访问项目 映射共享目录
- flex性能优化
- mac os安装eclipse tomcat 和svn
- 第一个IOS APP -ToDoList
- What's Wrong with Deep Learning? Yann LeCun
- mac安装navicat注册机激活失败
- UIWebView应用——自己动手写IOS浏览器
- jquery从头开始——一篇文章学完jQuery基础
- Java中getResourceAsStream的用法
- jsp页面中显示二维码图片
- 计算机视觉、机器学习相关领域论文和源代码大集合
- 未来的路
- FastDFS注意事项