Hadoop Exception while unregistering exited with exitCode: 1 报错处理

来源:互联网 发布:win7一直正在识别网络 编辑:程序博客网 时间:2024/05/18 00:40




问题现象:

查看 hadoop  resourcemanager.log 查看有如下异常:

Application application_1508235352644_0005 failed 2 times due to AM Container for appattempt_1508235352644_0005_000002 exited with exitCode: 1For more detailed output, check application tracking page:http://h1:8088/cluster/app/application_1508235352644_0005Then, click on links to logs of each attempt.Diagnostics: Exception from container-launch.Container id: container_e22_1508235352644_0005_02_000001Exit code: 1Stack trace: ExitCodeException exitCode=1:at org.apache.hadoop.util.Shell.runCommand(Shell.java:582)at org.apache.hadoop.util.Shell.run(Shell.java:479)at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:773)at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)at java.util.concurrent.FutureTask.run(FutureTask.java:266)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)Container exited with a non-zero exit code 1Failing this attempt. Failing the application.


应用客户端,我这是自己配置的log4j2 生成日志,会在所在Active 节点生成 日志

日志中有如下异常:

rg.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.unregister(RMCommunicator.java:190)|Exception while unregistering java.lang.NullPointerException: nullat org.apache.hadoop.mapreduce.v2.util.MRWebAppUtil.getApplicationWebURLOnJHSWithoutScheme(MRWebAppUtil.java:140) ~[hadoop-mapreduce-client-common-2.7.3.jar:?]at org.apache.hadoop.mapreduce.v2.util.MRWebAppUtil.getApplicationWebURLOnJHSWithScheme(MRWebAppUtil.java:155) ~[hadoop-mapreduce-client-common-2.7.3.jar:?]at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.doUnregistration(RMCommunicator.java:218) ~[hadoop-mapreduce-client-app-2.7.3.jar:?]at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.unregister(RMCommunicator.java:188) [hadoop-mapreduce-client-app-2.7.3.jar:?]at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.serviceStop(RMCommunicator.java:268) [hadoop-mapreduce-client-app-2.7.3.jar:?]at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.serviceStop(RMContainerAllocator.java:297) [hadoop-mapreduce-client-app-2.7.3.jar:?]at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221) [hadoop-common-2.7.3.jar:?]at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52) [hadoop-common-2.7.3.jar:?]at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter.serviceStop(MRAppMaster.java:886) [hadoop-mapreduce-client-app-2.7.3.jar:?]at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221) [hadoop-common-2.7.3.jar:?]at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52) [hadoop-common-2.7.3.jar:?]at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:80) [hadoop-common-2.7.3.jar:?]at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:157) [hadoop-common-2.7.3.jar:?]at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:131) [hadoop-common-2.7.3.jar:?]at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStop(MRAppMaster.java:1659) [hadoop-mapreduce-client-app-2.7.3.jar:?]at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221) [hadoop-common-2.7.3.jar:?]at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.stop(MRAppMaster.java:1166) [hadoop-mapreduce-client-app-2.7.3.jar:?]at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$MRAppMasterShutdownHook.run(MRAppMaster.java:1506) [hadoop-mapreduce-client-app-2.7.3.jar:?]at org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54) [hadoop-common-2.7.3.jar:?]




解决办法:

参考apache 官网https://issues.apache.org/jira/browse/MAPREDUCE-5721 点击打开链接



可以看到 说是jobhistory 的配置,检查你 客户端程序 mapre-site.xml 配置:



查看: jobhistory的配置是否有问题,我检查了下我出现问题的原因是因为 没有h4这台机器,jobhisroty运行在h3 



问题解决,给大家发福利,有有效期的, 支付宝扫码, 赶紧 过期不候啊