Deciding What to Do Next Revisited
来源:互联网 发布:Python吧 编辑:程序博客网 时间:2024/05/17 02:28
Deciding What to Do Next Revisited
Our decision process can be broken down as follows:
- Getting more training examples: Fixes high variance
- Trying smaller sets of features: Fixes high variance
- Adding features: Fixes high bias
- Adding polynomial features: Fixes high bias
- Decreasing λ: Fixes high bias
- Increasing λ: Fixes high variance.
Diagnosing Neural Networks
- A neural network with fewer parameters is prone to underfitting. It is also computationally cheaper.
- A large neural network with more parameters is prone to overfitting. It is also computationally expensive. In this case you can use regularization (increase λ) to address the overfitting.
Using a single hidden layer is a good starting default. You can train your neural network on a number of hidden layers using your cross validation set. You can then select the one that performs best.
Model Complexity Effects:
- Lower-order polynomials (low model complexity) have high bias and low variance. In this case, the model fits poorly consistently.
- Higher-order polynomials (high model complexity) fit the training data extremely well and the test data extremely poorly. These have low bias on the training data, but very high variance.
- In reality, we would want to choose a model somewhere in between, that can generalize well but also fits the data reasonably well.
阅读全文
0 0
- Deciding What to Do Next Revisited
- advice for applying machine learning:Deciding what to do next
- What to do next……
- Stanford机器学习第六讲(上)Advices for applying machine learning--Deciding what to try next
- 如何閱讀學術論文 - 選擇要閱讀的論文 (Deciding what to read)
- what to do @110201
- what i will do next……
- What i want to do.
- What to do on TransactionTooLargeException?
- How to figure out what to do?
- What do I have to do to use XML?
- What do I need to do to get interrupts working?
- what will the goverment do in next year
- What will I do in next 100 days for programming?
- What Programming Language to Learn (Next)
- What do I Need to Get Started?
- HOW TO DO WHAT YOU LOVE
- What's a J2EE Dev To Do?
- HTML隐藏控件的方法
- interlij idea给Web项目添加SSM
- linux内存管理
- 每天一个linux命令(28):文件和目录属性 Linux文件类型与扩展名---学习笔记
- 剑指Offer----顺时针打印矩阵
- Deciding What to Do Next Revisited
- 数列1
- tensorflow im2txt模型
- oracle表操作
- 如何使用cocos的自动绑定工具实现lua调用c++的类
- insert into select from
- Tarjan求割点
- R中时间序列分析-趋势分析Trend
- gitignore针对已经忽略的文件无法忽略问题