hadoop jar singlnode下运行的命令行输出
来源:互联网 发布:日文图片翻译软件 编辑:程序博客网 时间:2024/05/21 17:33
[hadoop@aaa ~]$ hadoop jar /opt/workspace/PGMdriver.jar GibbsSamplingDriver /output14/05/22 20:39:13 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:803214/05/22 20:39:13 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.14/05/22 20:39:14 INFO mapreduce.JobSubmitter: number of splits:214/05/22 20:39:14 INFO Configuration.deprecation: user.name is deprecated. Instead, use mapreduce.job.user.name14/05/22 20:39:14 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar14/05/22 20:39:14 INFO Configuration.deprecation: mapred.cache.files.filesizes is deprecated. Instead, use mapreduce.job.cache.files.filesizes14/05/22 20:39:14 INFO Configuration.deprecation: mapred.cache.files is deprecated. Instead, use mapreduce.job.cache.files14/05/22 20:39:14 INFO Configuration.deprecation: mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class14/05/22 20:39:14 INFO Configuration.deprecation: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class14/05/22 20:39:14 INFO Configuration.deprecation: mapred.job.name is deprecated. Instead, use mapreduce.job.name14/05/22 20:39:14 INFO Configuration.deprecation: mapreduce.inputformat.class is deprecated. Instead, use mapreduce.job.inputformat.class14/05/22 20:39:14 INFO Configuration.deprecation: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir14/05/22 20:39:14 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps14/05/22 20:39:14 INFO Configuration.deprecation: mapred.cache.files.timestamps is deprecated. Instead, use mapreduce.job.cache.files.timestamps14/05/22 20:39:14 INFO Configuration.deprecation: mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class14/05/22 20:39:14 INFO Configuration.deprecation: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir14/05/22 20:39:14 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1400777095877_000314/05/22 20:39:15 INFO impl.YarnClientImpl: Submitted application application_1400777095877_0003 to ResourceManager at /0.0.0.0:803214/05/22 20:39:15 INFO mapreduce.Job: The url to track the job: http://localhost:8088/proxy/application_1400777095877_0003/14/05/22 20:39:15 INFO mapreduce.Job: Running job: job_1400777095877_000314/05/22 20:39:22 INFO mapreduce.Job: Job job_1400777095877_0003 running in uber mode : false14/05/22 20:39:22 INFO mapreduce.Job: map 0% reduce 0%14/05/22 20:39:30 INFO mapreduce.Job: map 100% reduce 0%14/05/22 20:39:37 INFO mapreduce.Job: map 100% reduce 100%14/05/22 20:39:38 INFO mapreduce.Job: Job job_1400777095877_0003 completed successfully14/05/22 20:39:38 INFO mapreduce.Job: Counters: 43File System CountersFILE: Number of bytes read=34651FILE: Number of bytes written=308564FILE: Number of read operations=0FILE: Number of large read operations=0FILE: Number of write operations=0HDFS: Number of bytes read=40HDFS: Number of bytes written=33845HDFS: Number of read operations=7HDFS: Number of large read operations=0HDFS: Number of write operations=2Job Counters Launched map tasks=2Launched reduce tasks=1Other local map tasks=2Total time spent by all maps in occupied slots (ms)=10975Total time spent by all reduces in occupied slots (ms)=4275Map-Reduce FrameworkMap input records=0Map output records=200Map output bytes=34045Map output materialized bytes=34657Input split bytes=40Combine input records=0Combine output records=0Reduce input groups=176Reduce shuffle bytes=34657Reduce input records=200Reduce output records=200Spilled Records=400Shuffled Maps =2Failed Shuffles=0Merged Map outputs=2GC time elapsed (ms)=201CPU time spent (ms)=2410Physical memory (bytes) snapshot=662515712Virtual memory (bytes) snapshot=2658840576Total committed heap usage (bytes)=512229376Shuffle ErrorsBAD_ID=0CONNECTION=0IO_ERROR=0WRONG_LENGTH=0WRONG_MAP=0WRONG_REDUCE=0File Input Format Counters Bytes Read=0File Output Format Counters Bytes Written=33845
以上位运行成功
下面换了个jar,运行没错,但是结果不对,貌似没读到hdfs里的文件,命令行显示结果如下:
[hadoop@aaa~]$ hadoop jar /opt/workspace/PGM2205.jar /output14/05/22 21:23:10 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:803214/05/22 21:23:11 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.14/05/22 21:23:11 INFO mapreduce.JobSubmitter: number of splits:314/05/22 21:23:11 INFO Configuration.deprecation: user.name is deprecated. Instead, use mapreduce.job.user.name14/05/22 21:23:11 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar14/05/22 21:23:11 INFO Configuration.deprecation: mapred.cache.files.filesizes is deprecated. Instead, use mapreduce.job.cache.files.filesizes14/05/22 21:23:11 INFO Configuration.deprecation: mapred.cache.files is deprecated. Instead, use mapreduce.job.cache.files14/05/22 21:23:11 INFO Configuration.deprecation: mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class14/05/22 21:23:11 INFO Configuration.deprecation: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class14/05/22 21:23:11 INFO Configuration.deprecation: mapred.job.name is deprecated. Instead, use mapreduce.job.name14/05/22 21:23:11 INFO Configuration.deprecation: mapreduce.inputformat.class is deprecated. Instead, use mapreduce.job.inputformat.class14/05/22 21:23:11 INFO Configuration.deprecation: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir14/05/22 21:23:11 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps14/05/22 21:23:11 INFO Configuration.deprecation: mapred.cache.files.timestamps is deprecated. Instead, use mapreduce.job.cache.files.timestamps14/05/22 21:23:11 INFO Configuration.deprecation: mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class14/05/22 21:23:11 INFO Configuration.deprecation: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir14/05/22 21:23:12 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1400777095877_000914/05/22 21:23:12 INFO impl.YarnClientImpl: Submitted application application_1400777095877_0009 to ResourceManager at /0.0.0.0:803214/05/22 21:23:12 INFO mapreduce.Job: The url to track the job: http://localhost:8088/proxy/application_1400777095877_0009/14/05/22 21:23:12 INFO mapreduce.Job: Running job: job_1400777095877_000914/05/22 21:23:18 INFO mapreduce.Job: Job job_1400777095877_0009 running in uber mode : false14/05/22 21:23:18 INFO mapreduce.Job: map 0% reduce 0%14/05/22 21:23:27 INFO mapreduce.Job: map 33% reduce 0%14/05/22 21:23:29 INFO mapreduce.Job: map 100% reduce 0%14/05/22 21:23:34 INFO mapreduce.Job: map 100% reduce 100%14/05/22 21:23:34 INFO mapreduce.Job: Job job_1400777095877_0009 completed successfully14/05/22 21:23:34 INFO mapreduce.Job: Counters: 43File System CountersFILE: Number of bytes read=6FILE: Number of bytes written=318973FILE: Number of read operations=0FILE: Number of large read operations=0FILE: Number of write operations=0HDFS: Number of bytes read=60HDFS: Number of bytes written=0HDFS: Number of read operations=9HDFS: Number of large read operations=0HDFS: Number of write operations=2Job Counters Launched map tasks=3Launched reduce tasks=1Other local map tasks=3Total time spent by all maps in occupied slots (ms)=21498Total time spent by all reduces in occupied slots (ms)=3932Map-Reduce FrameworkMap input records=0Map output records=0Map output bytes=0Map output materialized bytes=18Input split bytes=60Combine input records=0Combine output records=0Reduce input groups=0Reduce shuffle bytes=18Reduce input records=0Reduce output records=0Spilled Records=0Shuffled Maps =3Failed Shuffles=0Merged Map outputs=3GC time elapsed (ms)=143CPU time spent (ms)=2560Physical memory (bytes) snapshot=946880512Virtual memory (bytes) snapshot=3543068672Total committed heap usage (bytes)=717225984Shuffle ErrorsBAD_ID=0CONNECTION=0IO_ERROR=0WRONG_LENGTH=0WRONG_MAP=0WRONG_REDUCE=0File Input Format Counters Bytes Read=0File Output Format Counters Bytes Written=0为什么呢?
0 0
- hadoop jar singlnode下运行的命令行输出
- 命令行下运行带有第三方jar的java程序
- 关于命令行下java程序的jar打包与运行
- 在命令行下运行第一个hadoop的程序
- hadoop运行jar的命令
- Hadoop学习1_在使用命令行运行WordCount时,遇到的jar命令说明
- 命令行实现hadoop上传JAR文件,运行《hadoop权威指南第二版》测试最大气温的应用
- 将hadoop程序打成jar包,在linux下以命令行方式运行(例如单词计算程序)
- 命令行运行jar
- 命令行运行jar
- 命令行隐藏运行jar
- 命令行运行 java jar
- java程序打包成jar,运行jar的命令行方式
- linux下jar命令和eclipse两种方式生成wordcount.jar包和hadoop下wordcount实例的运行
- hadoop 引用 运行第三方的jar
- hadoop的jar命令运行任务方法
- 在Linux下的命令行以及eclipse运行Hadoop提供的Wordcount例子
- Java程序在命令行下编译运行打Jar包
- CentOS 6.0配置本地yum源
- Ubuntu10.04中使用minicom
- 安装memcached服务器和php中添加memcache拓展模块
- Android的.9.png制作
- 谷歌技术面试要点(Google面试)(14年5月20日交大专场)
- hadoop jar singlnode下运行的命令行输出
- 5分钟内搞定 Tomcat 的 SSL 配置
- JFace MVC控件
- Android自启动应用
- 如何生成ipa文件
- (Kruskal)克鲁斯卡尔算法
- Prim算法
- java50题----08叠数求和
- dijkstra和floyd算法