word_count
来源:互联网 发布:淘宝商城保健品 编辑:程序博客网 时间:2024/05/21 09:59
#!/bin/bashHADOOP_HOME=/usr/local/webserver/hadoopINPUT_PATH=/data/archive/app_oeudjgn5872a7c3aaa54_datamine/george/inputsINPUT_PATH2=/user/resys/projects/image/koudai_img/d_img/reduced/2015-taobaoOUTPUT_PATH=/data/archive/app_oeudjgn5872a7c3aaa54_datamine/george/output/may30#OUTPUT_PATH=output#echo "Clearing output path: $OUTPUT_PATH"$HADOOP_HOME/bin/hadoop fs -rmr $OUTPUT_PATH${HADOOP_HOME}/bin/hadoop jar\ ${HADOOP_HOME}/share/hadoop/tools/lib/hadoop-streaming-2.6.0.jar\ -file mapper1.py\ -file reducer1.py\ -mapper mapper1.py\ -reducer reducer1.py\ -input $INPUT_PATH\ -input $INPUT_PATH2\ -output $OUTPUT_PATH\ -jobconf mapreduce.jobtracker.split.metainfo.maxsize=-1\ -jobconf mapred.job.queue.name="offline"\ -jobconf mapred.job.priority="NORMAL"\ -jobconf mapred.reduce.tasks="10"\
0 0
- word_count
- word_count
- modprobe word_count
- dmesg | grep word_count
- 利用python进行word_count
- Android模拟器/read_write/word_count.ko
- ]# dmesg | grep word_count | tail -n 2 word_count_init_success
- storm学习(1) word_count 程序
- storm学习(2) 进阶word_count 程序
- maven install时报错Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.3.2:compile
- Push推送
- SpringBoot入门系列:第三篇 日志输出
- 兼容ie6的背景透明文字不透明
- oracle分析函数over partition by 和group by的区别
- word_count
- Swift学习---基础三(区间运算符、控制器转移语句)
- iOS 编码和解码
- Java中关于子类成员变量与父类成员变量同名
- iOS开发者的99个绝佳资源
- DC/OS 安装部署
- android函数调用堆栈打印方法
- java 并发编程学习之二 ---- lock
- 有三种钱,你花得越多,赚得越多!