run hadoop in ghc and aws

来源:互联网 发布:mysql函数与存储过程 编辑:程序博客网 时间:2024/05/16 16:55
jar Success step in GHC

1. javac MapReduce.java

2. jar -cvf mr.jar *.class

3. hadoop fs -copyFromLocal mr.jar /user/linal

4. export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:./mr.jar 

5. hadoop jar mr.jar MapReduce RCV1.small_test.txt testmr 1


AWS 

1. jar location
s3://10605-s14-project-linal/HW4b/mr.jar
2. 
MapReduce s3://10605-s14-project-linal/HW4/RCV1.small_test.txt s3://10605-s14-project-linal/HW4b/small_test 10

classname inputoutput     size


0 0
原创粉丝点击