mapreduce大规模计算实验结果和性能比较

来源:互联网 发布:mac做java开发工具 编辑:程序博客网 时间:2024/06/07 00:37

等待实验结果.....

13/07/10 11:18:31 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
13/07/10 11:18:31 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
13/07/10 11:18:31 WARN mapred.JobClient: No job jar file set.  User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
13/07/10 11:18:31 INFO input.FileInputFormat: Total input paths to process : 100
13/07/10 11:18:31 INFO mapred.JobClient: Running job: job_local_0001
13/07/10 11:18:31 INFO util.ProcessTree: setsid exited with exit code 0
13/07/10 11:18:31 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@181bb68
13/07/10 11:18:31 INFO mapred.MapTask: io.sort.mb = 100
13/07/10 11:18:31 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/10 11:18:31 INFO mapred.MapTask: record buffer = 262144/327680
setup过程:正在处理的文件名:1b0eabda826c6f24095b0401af87fac7.sift
1b0eabda826c6f24095b0401af87fac7.sift
13/07/10 11:18:32 INFO mapred.JobClient:  map 0% reduce 0%
13/07/10 11:18:37 INFO mapred.LocalJobRunner: 
13/07/10 11:18:38 INFO mapred.JobClient:  map 100% reduce 0%
13/07/10 11:18:40 INFO mapred.LocalJobRunner: 
13/07/10 11:18:43 INFO mapred.LocalJobRunner: 
13/07/10 11:18:46 INFO mapred.LocalJobRunner: 
13/07/10 11:18:49 INFO mapred.LocalJobRunner: 
13/07/10 11:18:52 INFO mapred.LocalJobRunner: 
13/07/10 11:18:55 INFO mapred.LocalJobRunner: 
13/07/10 11:18:58 INFO mapred.LocalJobRunner: 
13/07/10 11:19:01 INFO mapred.LocalJobRunner: 
13/07/10 11:19:04 INFO mapred.LocalJobRunner: 
13/07/10 11:19:07 INFO mapred.LocalJobRunner: 
13/07/10 11:19:10 INFO mapred.LocalJobRunner: 
13/07/10 11:19:13 INFO mapred.LocalJobRunner: 
13/07/10 11:19:16 INFO mapred.LocalJobRunner: 
13/07/10 11:19:19 INFO mapred.LocalJobRunner: 
13/07/10 11:19:22 INFO mapred.LocalJobRunner: 
13/07/10 11:19:25 INFO mapred.LocalJobRunner: 
13/07/10 11:19:28 INFO mapred.LocalJobRunner: 
13/07/10 11:19:31 INFO mapred.LocalJobRunner: 
13/07/10 11:19:34 INFO mapred.LocalJobRunner: 
13/07/10 11:19:37 INFO mapred.LocalJobRunner: 
13/07/10 11:19:40 INFO mapred.LocalJobRunner: 
13/07/10 11:19:43 INFO mapred.LocalJobRunner: 
13/07/10 11:19:46 INFO mapred.LocalJobRunner: 
13/07/10 11:19:49 INFO mapred.LocalJobRunner: 
13/07/10 11:19:52 INFO mapred.LocalJobRunner: 
13/07/10 11:19:55 INFO mapred.LocalJobRunner: 
13/07/10 11:19:58 INFO mapred.LocalJobRunner: 
13/07/10 11:20:01 INFO mapred.LocalJobRunner: 
13/07/10 11:20:04 INFO mapred.LocalJobRunner: 
13/07/10 11:20:07 INFO mapred.LocalJobRunner: 
13/07/10 11:20:10 INFO mapred.LocalJobRunner: 
13/07/10 11:20:13 INFO mapred.LocalJobRunner: 
13/07/10 11:20:16 INFO mapred.LocalJobRunner: 
13/07/10 11:20:19 INFO mapred.LocalJobRunner: 
13/07/10 11:20:22 INFO mapred.LocalJobRunner: 

原创粉丝点击