Machine Learning Notes II
来源:互联网 发布:java 适配器模式 编辑:程序博客网 时间:2024/06/06 00:29
Machine Learning Notes II
1.Classification
Focus on Binary classification problem
- Hypothesis representation
using Sigmoid Function,also called logistic function
The function looks like this->
what needs to be emphasized is thatz
here is the theta’s transpose multipliesX
.(Actually,this depends on the input of your X and theta, you can refer to the formula in the past when we talked about the linear regression) - Decision Boundary
for simple decision boundary, it may looks like this->
Combine the hypothesis function with this image, we can find that:
ifz>=0
, thenh>=0.5
(which means it’s admitted)
else(z<0
), thenh<0.5
(which means it’s not admitted) - Cost function
- Gradient Descent
The general form of gradient descent is->
Attention: You can find that the gradient descent here is almost the same as the way we used for linear regression. However, they are different, and the only difference is functionh
.
2.Multi-class Classification
Instead of y={0,1}, we’ll expend our definition so that y={0,1,..,n}.The way we solve it is dividing the problems into n+1 classificaiton problems.
3.Regulation
- The problem of overfitting && underfitting
From the image above, we can see that the second pic is the right func we want.If theh
is too simple or too complicated, func won’t perform well(which means the predictions are not so well).
Underfitting, or high bias, is when the form of our hypothesis functionh
maps poorly to trend of the data, which is usually caused by a function that is too simple or uses too few features.
For overfitting, or high variance,is caused by a hypothesis functionthat fits the avaliable data but doesn’t generalize well to predict data. It’s usually caused by a comlicated fucntion that creates a lot of unnecessary curves and angles unrelated to the data. - Use regularization to solve this problem
Keep all the features but reduce the magnitude of parameters theta.- cost function with regularization
Attention: theta here must begin from 2,and the 1 means theta 0,which isn’t regularized. - Gradient descent
- For normal equation
To add in regularization, the equation is the same as the orignal, except that we add another term inside the paratheses:
- cost function with regularization
阅读全文
0 0
- Machine Learning Notes II
- Machine Learning Notes - PLA
- Machine Learning Notes
- Machine Learning Notes
- Machine Learning Notes
- Machine Learning Notes III
- Machine Learning Algorithms Study Notes
- Machine Learning Notes - Linear Regression
- Machine Learning Notes - Logistic Regression
- Machine Learning Algorithms Study Notes--Supervised Learning
- Machine Learning Notes ——Linear Regression
- [机器学习基础] Notes on Machine Learning
- deep learning AI book -chapter05 machine learning basics --notes
- 「Machine Learning」Learning Theory from CS229 Lecture Notes
- Machine Learning - Neural Networks Representation Part II
- Machine Learning Notes I: The Standard Linear Model
- 【Machine Learning notes(机器学习笔记-001)】
- Andrew Moore CMU machine learning Notes(ML part)
- Button按钮圆角的设置:
- POJ1274: The Perfect Stall 题解
- hdu 2795 Billboard 线段树
- 如何用js给css3中的属性和jquery中的animate动态传值
- angular.js里的ng-show,ng-hide与ng-if的区别
- Machine Learning Notes II
- Spring概念,底层原理,实例化三种方式
- 通过字节码深入分析java的枚举类型enum
- 使用SpringMVC注解@RequestParam(value="XXX",required=false)时需要注意的问题
- js回掉函数取不到action字段的问题
- centos6.4下CDH5.7.1集群的安装
- Java基础复习之StringBuffer和StringBuilder简要记录
- 【项目管理和构建】——Maven简介(二)
- ConcurrentHashMap的size操作