Q-learning--定义--过程
来源:互联网 发布:细说php第三版电子书 编辑:程序博客网 时间:2024/06/04 18:04
The Q-Learning algorithm was proposed as a way to optimize solutions in Markov decision process problems. The distinctive feature of Q-Learning is in its capacity to choose between immediate rewards and delayed rewards. At each step of time, an agent observes the vector of state xt, then chooses and applies an action ut. As the process moves to state xt+1, the agent receives a reinforcement r(xt, ut). The goal of the training is to find the sequential order of actions which maximizes the sum of the future reinforcements, thus leading to the shortest path from start to finish.
The transition rule of Q learning is a very simple formula:
Q(state, action) = R(state, action) + gamma * Max[Q(next state, all actions)]
The gamma parameter has a range of 0 to 1 (0 <= gamma > 1), and ensures the convergence of the sum. If gamma is closer to zero, the agent will tend to consider only immediate rewards. If gamma is closer to one, the agent will consider future rewards with greater weight, willing to delay the reward.
The Q-Learning algorithm goes as follows:
1. Set the gamma parameter, and environment rewards in matrix R.
2. Initialize matrix Q to zero.
3. For each episode:
Select a random initial state.
Do While the goal state hasn't been reached.
- Select one among all possible actions for the current state.
- Using this possible action, consider going to the next state.
- Get maximum Q value for this next state based on all possible actions.
- Compute: Q(state, action) = R(state, action) + gamma * Max[Q(next state, all actions)]
- Set the next state as the current state.
End Do
End For
Q-learning是在“”及时报酬“与“延迟报酬”之间做平衡处理
根据当前的状态,在众多可能行动中选择一个
采用这个行动,考虑进入下一个状态
对所有可能行动,进入下一个状态得到的最大Q值
- Q-learning--定义--过程
- Q-learning
- Q-learning
- Q-learning
- Q-Learning实现
- Q-Learning分析
- 增强学习 | Q-Learning
- Q-learning 学习心得
- Q-Learning算法学习
- Q-learning算法
- Q-learning学习笔记
- Q-learning算法实现
- Deep Q Learning 笔记
- (一)Q-learning
- Q-Learning By Examples(zz)
- 增强学习(Q-learning)
- Q-learning寻径(练手)
- 漫谈DQN之Q-Learning
- fdfdf
- MacOS 10.12安全与隐私没有允许任何来源的app选项解决办法
- MySQL函数大全 及用法示例
- 【leetcode】【M】406. Queue Reconstruction by Height【95】
- Windows Caffe配置
- Q-learning--定义--过程
- 常用正则表达式
- H264 on RTP collections
- Android入门——Intent、Bundle的使用和ListView的应用
- Ubuntu下 Android NDK 编译 FFmpeg + x264 + fdk-aac (arm/x86)的配置脚本
- Leetcode012--四个数字的和为指定数
- Inno Setup 添加管理员权限
- ASP.NET 4.0升级至ASP.NET 4.5需要注意的地方
- 安卓直播快速实践服务端(三)