Large Scale Machine Learning
来源:互联网 发布:东离剑游纪 知乎 编辑:程序博客网 时间:2024/04/27 21:11
Before learning with large datasets, plot a learning curve with a much small datasets, and to see if it appears to be have high bias.
Stochastic Gradient Decent
(taking linear regression for example)
(Repeat between 1 to 10 times)
as the picture shows, it will converge in random directions and fail to converge into a single point, but much more effective and faster, compared with Batch Gradient Descent.
Mini-Batch Gradient Descent
b is often chosen from 2 to 100
Mini-Batch will be faster than Stochastic only by vetorization.
Checking for Converge
(without scanning over the entire training set periodically)
In plot 1, with a smaller
In plot 2 and 3, with a larger examples, the red line looks smoother, which do help to plot 3 confronted too much noise. Similarly, it will be slower.
In plot 4, with a increasing plot, maybe we should using a smaller
Learning Rate
to get closer to the optima:
However, it will become a hard work to choose these two constants, so it maybe not good choice.
the online learning
—to learn from a continuous stream of data
Without the superscript i, while a set of data has been used, we discard it.
And it also can adapt to change preference.
CTR(Click Through Rate)
With 10 pairs of (x,y), they are also 10 examples, which can improve our parameters.
Map Reduce
- Large Scale Machine Learning
- 15-Large Scale Machine Learning
- [Shogun] A large scale machine learning toolbox
- Large scale machine learning in Python
- 学习笔记-Large scale machine learning
- Stanford Machine Learning: (6).Large Scale Machine Learning
- Andrew Ng Machine Learning 专题【Large Scale Machine Learning】
- Machine Learning week 10 quiz: Large Scale Machine Learning
- Coursera Machine Learning 第十周 quiz Large Scale Machine Learning
- Coursera Machine Learning 第十周 quiz Large Scale Machine Learning
- Stanford ML - Lecture 11 - Large scale machine learning
- Machine Learning for Large Scale Recommender Systems--Yahoo! Research
- Large Scale Machine Learning--An Engineering Perspective--0. 引言
- Large Scale Machine Learning--An Engineering Perspective--目录
- Week 10:Large Scale Machine Learning课后习题解答
- Stanford 机器学习笔记 Week10 Large Scale Machine Learning
- Coursera机器学习-第十周-Large Scale Machine Learning
- Ng机器学习 Week10 Large Scale Machine Learning
- POJ特殊密码锁
- spring cloud小坑之抽取model
- [unity] 在unity game视窗中光标正常,Build&Run为exe运行后光标消失的解决办法
- 零基础如何学习网络安全
- 代理技术简介
- Large Scale Machine Learning
- 净化心灵
- codevs 1018 单词接龙
- Linux下TCP多进程/多线程套接字通信
- 英文金曲大赛 (sdut oj)
- 动规的思想总结
- HTML元素分类
- MATLAB图像处理练习作业
- 分享,好看的PPT模板网站