hadoop WordCount源码
来源:互联网 发布:java多次继承例子 编辑:程序博客网 时间:2024/05/20 07:33
前提为:TokenizerMapper、IntSumReducer、IntSumReducer、Text、IntWritable 类在同一个目录下
package org.apache.hadoop.examples;
import java.io.PrintStream;
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.io.IntWritable;
import org.apache.hadoop.io.Text;
import org.apache.hadoop.mapreduce.Job;
import org.apache.hadoop.mapreduce.lib.input.FileInputFormat;
import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat;
import org.apache.hadoop.util.GenericOptionsParser;
public class WordCount
{
public static void main(String[] args)
throws Exception
{
Configuration conf = new Configuration();
String[] otherArgs = new GenericOptionsParser(conf, args).getRemainingArgs();
if (otherArgs.length < 2) {
System.err.println("Usage: wordcount <in> [<in>...] <out>");
System.exit(2);
}
Job job = new Job(conf, "word count");
job.setJarByClass(WordCount.class);
job.setMapperClass(TokenizerMapper.class);
job.setCombinerClass(IntSumReducer.class);
job.setReducerClass(IntSumReducer.class);
job.setOutputKeyClass(Text.class);
job.setOutputValueClass(IntWritable.class);
for (int i = 0; i < otherArgs.length - 1; ++i) {
FileInputFormat.addInputPath(job, new Path(otherArgs[i]));
}
FileOutputFormat.setOutputPath(job, new Path(otherArgs[(otherArgs.length - 1)]));
System.exit((job.waitForCompletion(true)) ? 0 : 1);
}
}
0 0
- Hadoop WordCount源码解读
- hadoop WordCount源码
- 理解Hadoop源码 --- WordCount
- HADOOP中WORDCOUNT源码分析
- hadoop之WordCount源码分析
- Hadoop学习笔记-WordCount源码分析
- Hadoop示例程序WordCount源码学习
- Hadoop学习(二)wordcount源码详解
- hadoop wordcount
- hadoop wordcount
- hadoop-wordcount
- Hadoop WordCount
- hadoop-wordcount
- hadoop wordcount
- hadoop 实战———WordCount源码分析
- Hadoop之wordcount源码分析和MapReduce流程分析
- wordcount源码
- <hadoop>hadoop wordcount
- UIScrollView文档翻译
- Unity3D研究院之异步加载游戏场景与异步加载游戏资源进度条
- 阻塞和非阻塞
- 【9110】高精度减法
- Linux 安装 Oracle 11g——静默安装 GRID
- hadoop WordCount源码
- Block实现iOS回调
- 浏览器 HTTP 协议缓存机制详解
- UITableView文档翻译
- labview 串口通信开发基础详解
- Androud 通过代码添加margin属性
- fgetpos
- printk 消息打印级别
- Java中的main()方法详解