CRF、MRF、DBN的一些联系
来源:互联网 发布:苹果快捷打开移动网络 编辑:程序博客网 时间:2024/05/05 15:56
CRF and MRF are two popular graphical models, which is an intuitive model to model all kinds of networks.
Recently deep belief network has aroused a huge surge in Machine Learning community, and it got state of the art results in numerous fields, like object recognition, acoustic understanding and topic modeling. DBN is also one kind of graphical models.
As we know, CRF is a discriminative model, while MRF is a generative model. Naive Bayes is probably the simplest MRF, while logistic regression is one kind of simple CRFs. The key difference between these two kinds of models is that: MRF is trying to model a joint distribution p(X,Y), however, CRF aims to build a conditional distribution p(Y|X). To be more clear, there are no kinds of potential functions like g(x1,x2) in CRF. Nevertheless, the learning methods & procedures are quite the same, and maximum likelihood works for both model. By the way, for parameter learning in DBN, Prof. Hinton developed a method called contrastive divergence, which is pseudo-likelihood.
One important theorem in undirected graph is:
Hammersley-Clifford theorem: a positive distribution p(y) > 0 satisfies the conditional independence properties of an undirected graph G if and only if p can be represented as a product of factors, one per maximal clique.
0 0
- CRF、MRF、DBN的一些联系
- CRF和MRF概率模型的关系
- MRF HMM CRF简笔
- Tutorial papers for MRF, CRF and DRF
- 关于DBN以及RBM的一些资料汇总
- 关于CRF序列标注的一些理解
- CRF命名实体识别的一些tips
- HMM MEMM CRF 区别 联系
- HMM MEMM CRF 区别 联系
- DBN的训练过程
- 关于DBN的理解
- DBN
- Dbn
- DBN
- dbn
- 推荐一些用CRF做图像语义分割的资源
- 推荐一些用CRF做图像语义分割的资源
- 推荐一些用CRF做图像语义分割的资源
- epoll 搭建简单的聊天室
- JavaEE学习之路|我的第一个servlet
- |洛谷|模拟|P1086 花生采摘
- 洛谷 P1991 无线通讯网
- 第三周 求集合并集
- CRF、MRF、DBN的一些联系
- 实现从servlet和jsp之间的跳转
- Purifying Machine, ACM/ICPC Beijing 2005, UVa1663
- 【C++】google glog库
- IT需求管理研讨
- 第七章:数据规整化
- 每一堂课都有自己的精髓
- Linux Ubuntu下使用su命令切换root用户
- 第3周项目2-建设“顺序表”算法库