Hadoop WritableComparable接口
来源:互联网 发布:淘宝女装尺码表模板 编辑:程序博客网 时间:2024/06/06 14:27
hadoop WritableComparable接口的作用,
两个作用 A 实现了一个序列化协议
B 可以比较的实现,实现方法compareTo()方法,
MapReduce中所有的key值类型都必须实现这个接口,避免重复的key啊
===============================================================分割线=====================================
WritableComparable接口
Writable接口大家可能都知道,它是一个实现了序列化协议的序列化对象。在Hadoop中定义一个结构化对象都要实现Writable接口,使得该结构化对象可以序列化为字节流,字节流也可以反序列化为结构化对象。那WritableComparable接口是可序列化并且可比较的接口。MapReduce中所有的key值类型都必须实现这个接口,既然是可序列化的那就必须得实现readFiels()和write()这两个序列化和反序列化函数,既然也是可比较的那就必须得实现compareTo()函数,该函数即是比较和排序规则的实现。这样MR中的key值就既能可序列化又是可比较的。下面几符图是API中对WritableComparable接口的解释及其方法,还有一个实现了该接口的对象的列子:
public interface WritableComparable<T> extends Writable, Comparable<T>
A Writable
which is alsoComparable
.
WritableComparable
s can be compared to each other, typically via Comparator
s. Any type which is to be used as a key
in the Hadoop Map-Reduce framework should implement this interface.
Example:
public class MyWritableComparable implements WritableComparable { // Some data private int counter; private long timestamp; public void write(DataOutput out) throws IOException { out.writeInt(counter); out.writeLong(timestamp); } public void readFields(DataInput in) throws IOException { counter = in.readInt(); timestamp = in.readLong(); } public int compareTo(MyWritableComparable w) { int thisValue = this.value; int thatValue = ((IntWritable)o).value; return (thisValue < thatValue ? -1 : (thisValue==thatValue ? 0 : 1)); } }转自:http://www.cnblogs.com/dyllove98/archive/2013/07/31/3228579.html 感谢作者
- Hadoop WritableComparable接口
- Hadoop WritableComparable接口
- Hadoop 之 WritableComparable 接口
- Hadoop WritableComparable接口
- Hadoop 之 Writable , WritableComparable 接口
- Hadoop WritableComparable接口收集的知识
- Hadoop WritableComparable
- Hadoop源码分析:Writable接口和WritableComparable接口
- hadoop WritableComparable与WritableComparator
- Writable接口 与 WritableComparable接口
- Hadoop自定义实现Writable/WritableComparable接口的类方法及应用
- Hadoop 实现WritableComparable的类
- Hadoop mapreduce自定义排序WritableComparable
- hadoop的WritableComparable与Writable
- Hadoop mapreduce自定义排序WritableComparable
- WritableComparable
- Hadoop中Writable和WritableComparable区别
- Hadoop中Writable和WritableComparable区别
- 第三周--顺序表的基本运算2
- iOS 通过GCDAsyncSocket建立tcp链接
- MySql安装及配置
- redis cluster主从复制
- MySQL 修改 root 密码
- Hadoop WritableComparable接口
- Python正则判断手机和邮箱
- 转载:天涯——散文天下——《一个人的悲剧人生》——作者:南方孤驴
- Swift UITabBarController 标签栏控制器
- Android EditText与第三方输入法删除键(退格键)冲突问题解决方案
- HDU 2055 An easy problem
- viewPager的使用(一)
- 苹果的3D Touch技术与安卓以往的“长按屏幕”有何区别
- LED平板灯结构解析与设计