Hyperparameters in Machine Learning
来源:互联网 发布:一加手机工具箱网络 编辑:程序博客网 时间:2024/05/20 10:21
In machine learning, we use the term hyperparameter to distinguish from standard model parameters. So, it is worth to first understand what those are.
Standard Parameters
A machine learning model is the definition of a mathematical formula with a number of parameters that need to be learned from the data. That is the crux of machine learning: fitting a model to the data. This is done through a process known as model training. In other words, by training a model with existing data, we are able to fit the model parameters.
Hyperparameters
However, there is another kind of parameters that cannot be directly learned from the regular training process. These parameters express “higher-level” properties of the model such as its complexity or how fast it should learn. They are called hyperparameters. Hyperparameters are usually fixed before the actual training process begins.
So, how are hyperparameters decided? That is probably beyond the scope of this question, but suffice to say that, broadly speaking, this is done by setting different values for those hyperparameters, training different models, and deciding which ones work best by testing them.
So, to summarize. Hyperparameters:
- Define higher level concepts about the model such as complexity, or capacity to learn.
- Cannot be learned directly from the data in the standard model training process and need to be predefined.
- Can be decided by setting different values, training different models, and choosing the values that test better
Some Examples
Some examples of hyperparameters:
- Number of leaves or depth of a tree
- Number of latent factors in a matrix factorization
- Learning rate (in many models)
- Number of hidden layers in a deep neural network
- Number of clusters in a k-means clustering
Give a Practical Examples
Reference
https://www.quora.com/What-are-hyperparameters-in-machine-learning
- Hyperparameters in Machine Learning
- 机器学习中的超参数(Hyperparameters in machine learning)
- Thinking In Machine Learning
- machine learning in R
- machine learning in action
- Machine Learning in Python
- Machine Learning in Action
- Machine Learning in Action_CH2_1_kNN
- Machine Learning in iOS
- Machine Learning In Action
- Machine Learning In Action
- Machine Learning In Action
- Machine Learning In Action
- Machine Learning In Action
- Machine Learning In Action
- Machine Learning In Action
- Machine Learning In Action
- Machine Learning In Action
- 使用Eric构建使用Caffe应用程序
- Java线程:新特征-线程池
- 在网页中插入百度地图(Wayde-实例)
- C++ STL Vetcor中函数大全
- div模拟textarea文本域及高度自适应
- Hyperparameters in Machine Learning
- HDFS介绍
- Mapper@Test单元测试01
- linux常用命令之date用法
- ICMP/NAT/ARP/RARP/DHCP/DNS协议的作用
- Java80商城系统第六节-注册登录商城
- Java反射与内省(Introspector)
- Android登陆界面的简单实现(登陆背景渐变,密码点击隐藏与显示)
- 1063 合并果子 优先队列