最小的MapReduce驱动
来源:互联网 发布:跑腿软件排名 编辑:程序博客网 时间:2024/06/01 07:46
Configuration configuration = new Configuration();
Job job = new Job(configuration, "HelloWorld");
job.setInputFormat(TextInputFormat.class);
job.setMapperClass(IdentityMapper.class);
job.setMapOutputKeyClass(LongWritable.class);
job.setMapOutputValueClass(Text.class);
job.setPartitionerClass(HashPartitioner.class);
job.setNumReduceTasks(1);
job.setReducerClass(IdentityReducer.class);
job.setOutputKeyClass(LongWritable.class);
job.setOutputValueClass(Text.class);
job.setOutputFormat(TextOutputFormat.class);
job.waitForCompletion(true);
Job job = new Job(configuration, "HelloWorld");
job.setInputFormat(TextInputFormat.class);
job.setMapperClass(IdentityMapper.class);
job.setMapOutputKeyClass(LongWritable.class);
job.setMapOutputValueClass(Text.class);
job.setPartitionerClass(HashPartitioner.class);
job.setNumReduceTasks(1);
job.setReducerClass(IdentityReducer.class);
job.setOutputKeyClass(LongWritable.class);
job.setOutputValueClass(Text.class);
job.setOutputFormat(TextOutputFormat.class);
job.waitForCompletion(true);
1 0
- 最小的MapReduce驱动
- 026_默认的MapReduce Driver(最小驱动问题)
- Hadoop 1.x MapReduce最小驱动配置
- hadoop的MapReduce在java驱动代码
- 一些算法的MapReduce实现——最小生成树
- MapReduce 实现最小生成树
- 关于mapreduce程序之Mapper、Reducer以及Driver驱动的若干框架总结
- Hadoop 1.x MapReduce 默认驱动配置
- 基于MapReduce作业的MapReduce数据流优化
- MapReduce(三): MapReduce的主要功能模块
- MapReduce作业的MapReduce数据流优化
- MapReduce: 提高MapReduce性能的建议(1)
- MapReduce进阶:多MapReduce的链式模式
- mapreduce机制及mapreduce任务的分析
- 【MR】经典的MapReduce(MapReduce 1) 运行机制
- MapReduce----线性最小二乘(线性回归)
- Google的MapReduce
- MapReduce的设计思想
- oracle表空间增大方法
- 表单验证之BootstrapValidator
- Win10 TensorFlow(gpu)安装详解
- ORA-00600 2662错误
- 如何解决ul中li的边距问题
- 最小的MapReduce驱动
- SpringMVC 修炼手册 part4 自定义转换器以及HttpMessageConverter转换器
- 多线程-3
- STM32 SysTick 3.5固件库
- git之down代码到本地
- Python爬虫Scrapy环境搭建
- 青蛙跳阶
- spring中的web上下文,spring上下文,springmvc上下文区别(超详细)
- centos7(vm)下安装Ambari2.4.0(x86)