1.why MR?

来源:互联网 发布:域名报毒查询 编辑:程序博客网 时间:2024/05/16 16:11
Why MapReduce?
.将计算移动到数据
.Divide and Conquer(分而治之)

MapReduce执行流程:

Map
映射分发
Reduce
聚合

傻逼图:
计算机生成了可选文字: Input Deer Bear River Car Car River Deer Car Bear Splitting Deer Bear River Car Car River Deer Car Bear Mapping Deer, 1 Bear, 1 River, 1 car, 1 Car, 1 River, 1 Deer, I Car, 1 Bear, 1 Shuffling Bear, I Bear, 1 Car, 1 Car, 1 Car, 1 Deer, 1 Deer, 1 River, 1 River, 1 Reducing Bear, 2 car, 3 Deer, 2 River, 2 Final result Bear, 2 Car, 3 Deer, 2 River, 2
好图:

Yarn执行资源分配框架结构
ResourceManager (Master)
NodeManager (Slave)
RM>NM      NN>DN
计算机生成了可选文字: Master: Slav M n3 Client Container n2 NM NM MRAppMaster
 

0 0