《Hadoop The Definitive Guide》ch07 MapReduce Types and Formats
来源:互联网 发布:js去掉字符串最后几个 编辑:程序博客网 时间:2024/06/11 21:40
MapReduce的数据模型非常简单,它的Map和Reduce函数使用键值对进行输入和输出。本章将深入讨论MapReduce的数据模型,尤其是文本或者二进制类型的数据如何在MapReduce中使用。
1. MapReduce的类型
map和reduce函数遵循以下的形式:
map: (K1, V1) -> list(K2, V2)
reduce: (K2, list(V2)) -> list(K3, V3)
In general, the map input key and value types (K1 and V1) are different from the map output types (K2 and V2). However, the reduce input must have the same types as the
map output, although the reduce output types may be different again (K3 and V3).
2. 输入格式
Text Input
Binary Input
Multiple Inputs
Database Input
3. 输出格式
Text Output
Binary Output
Multiple Outputs
Lazy Output
Database Output
- 《Hadoop The Definitive Guide》ch07 MapReduce Types and Formats
- 《Hadoop The Definitive Guide》ch02 MapReduce
- 《Hadoop The Definitive Guide》ch08 MapReduce Features
- 《Hadoop The Definitive Guide》ch05 Developing a MapReduce Application
- 《Hadoop The Definitive Guide》ch06 How MapReduce Works
- 《Hadoop: The Definitive Guide》读书笔记 -- Chapter 2 MapReduce
- Hadoop- The Definitive Guide 笔记
- Hadoop经典书籍----- Hadoop: The Definitive Guide
- 《Hadoop The Definitive Guide》ch10 Administering Hadoop
- Notes for Hadoop the definitive guide
- Hadoop- The Definitive Guide 笔记2
- 《Hadoop The Definitive Guide》ch12 HBase
- 《Hadoop The Definitive Guide》ch13 ZooKeeper
- 《Hadoop The Definitive Guide》ch11 Pig
- 《Hadoop The Definitive Guide》ch14 Case Studies
- Notes for Hadoop the definitive guide
- Hadoop YARN Installation: The definitive guide
- Hadoop:The Definitive Guide 4th Edition
- DB2 SQL Error: SQLCODE=-964, SQLSTATE=57011的原因及解决方法
- UISearchBar背景透明,去掉背景,自定义背景
- [CToolTipCtrl]悬停工具提示条信息
- http://cdn.ac.nbutoj.com/Problem/view.xhtml?id=1184&&Elaine's Queue
- 内存泄露,缓冲区溢出,堆破坏 的问题
- 《Hadoop The Definitive Guide》ch07 MapReduce Types and Formats
- 大话EM算法
- vs2010下编译Boost 1.46
- hdu 1757
- iphone 3 开发基础教程 4.6按钮编译错误
- Hibernate错误
- hdu 1003 max sum #最大字段和
- java without ide
- unix网络编程-第七章-小结