MapReduce 与 Cloud Dataflow, Caffeine, Dremel,Pregel 之间的关系

来源：互联网发布：unity3d vr抗锯齿编辑：程序博客网时间：2024/05/21 15:05

MapReduce的继任者 -- Google Cloud Dataflow

At its core, Cloud Dataflow is Google’s successor to MapReduce, which has been an experimental App Engine feature for quite a while now. http://techcrunch.com/2014/06/25/google-launches-cloud-dataflow-a-managed-data-processing-service/

MapReduce的有力补充（交互） -- Dremel：

作为MapReduce 的发起人，Google开发了Dremel将处理时间缩短到秒级，作为MapReduce的有力补充。
http://www.oschina.net/question/12_76159

MapReduce的有力补充（图处理) -- Pregel

Inside Google, MapReduce is used for 80% of all the data processing needs.The other 20% is handled by a lesser known infrastructure called Pregel which is optimized to mine relationships from graph.
http://www.royans.net/wp/2010/03/17/pregel-googles-other-data-processing-infrastructure/

MapReduce的上层搜索引擎 -- Google Caffeine

这次改动主要是重写了搜索引擎的底层架构，涉及到爬虫、索引库、排序规则等等很多方面。提升的方向主要是google一直以来追求的速度，而速度的提高会进一步带来准确性和全面性的提升。
http://www.semyj.com/archives/528

0 0