windows下maven环境开发hadoop mapreduce程序报Cannot initialize Cluster

来源:互联网 发布:sql server好学吗 编辑:程序博客网 时间:2024/05/22 13:38

环境:windows 、idea 、maven、hadoop2.8.0

今天开发hadoop mapreduce程序时,想直接用main方法运行,报如下错误:


Exception in thread "main" java.io.IOException: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses.at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:143)at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:108)at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:101)at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1311)at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307)at java.security.AccessController.doPrivileged(Native Method)at javax.security.auth.Subject.doAs(Subject.java:415)at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1807)at org.apache.hadoop.mapreduce.Job.connect(Job.java:1307)at org.apache.hadoop.mapreduce.Job.submit(Job.java:1335)at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1359)at com.cn.test.mapreduce.WordCountDebugRunner.main(WordCountDebugRunner.java:48)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:601)at com.intellij.rt.execution.application.AppMain.main(AppMain.java:140)

网上看了一些博客,都是说加

<dependency>            <groupId>org.apache.hadoop</groupId>            <artifactId>hadoop-mapreduce-client-common</artifactId>            <version>2.8.1</version></dependency>

结果加了还是报错,然后看了一些写如何写mapreduce程序的博客,发现要引入

<dependency>            <groupId>org.apache.hadoop</groupId>            <artifactId>hadoop-mapreduce-client-jobclient</artifactId>            <version>2.8.1</version></dependency>


然后就可以了

阅读全文
0 0
原创粉丝点击