Hadoop Exception while unregistering exited with exitCode: 1 报错处理
来源:互联网 发布:win7一直正在识别网络 编辑:程序博客网 时间:2024/05/18 00:40
问题现象:
查看 hadoop resourcemanager.log 查看有如下异常:
Application application_1508235352644_0005 failed 2 times due to AM Container for appattempt_1508235352644_0005_000002 exited with exitCode: 1For more detailed output, check application tracking page:http://h1:8088/cluster/app/application_1508235352644_0005Then, click on links to logs of each attempt.Diagnostics: Exception from container-launch.Container id: container_e22_1508235352644_0005_02_000001Exit code: 1Stack trace: ExitCodeException exitCode=1:at org.apache.hadoop.util.Shell.runCommand(Shell.java:582)at org.apache.hadoop.util.Shell.run(Shell.java:479)at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:773)at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)at java.util.concurrent.FutureTask.run(FutureTask.java:266)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)Container exited with a non-zero exit code 1Failing this attempt. Failing the application.
应用客户端,我这是自己配置的log4j2 生成日志,会在所在Active 节点生成 日志
日志中有如下异常:
rg.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.unregister(RMCommunicator.java:190)|Exception while unregistering java.lang.NullPointerException: nullat org.apache.hadoop.mapreduce.v2.util.MRWebAppUtil.getApplicationWebURLOnJHSWithoutScheme(MRWebAppUtil.java:140) ~[hadoop-mapreduce-client-common-2.7.3.jar:?]at org.apache.hadoop.mapreduce.v2.util.MRWebAppUtil.getApplicationWebURLOnJHSWithScheme(MRWebAppUtil.java:155) ~[hadoop-mapreduce-client-common-2.7.3.jar:?]at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.doUnregistration(RMCommunicator.java:218) ~[hadoop-mapreduce-client-app-2.7.3.jar:?]at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.unregister(RMCommunicator.java:188) [hadoop-mapreduce-client-app-2.7.3.jar:?]at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.serviceStop(RMCommunicator.java:268) [hadoop-mapreduce-client-app-2.7.3.jar:?]at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.serviceStop(RMContainerAllocator.java:297) [hadoop-mapreduce-client-app-2.7.3.jar:?]at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221) [hadoop-common-2.7.3.jar:?]at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52) [hadoop-common-2.7.3.jar:?]at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter.serviceStop(MRAppMaster.java:886) [hadoop-mapreduce-client-app-2.7.3.jar:?]at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221) [hadoop-common-2.7.3.jar:?]at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52) [hadoop-common-2.7.3.jar:?]at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:80) [hadoop-common-2.7.3.jar:?]at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:157) [hadoop-common-2.7.3.jar:?]at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:131) [hadoop-common-2.7.3.jar:?]at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStop(MRAppMaster.java:1659) [hadoop-mapreduce-client-app-2.7.3.jar:?]at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221) [hadoop-common-2.7.3.jar:?]at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.stop(MRAppMaster.java:1166) [hadoop-mapreduce-client-app-2.7.3.jar:?]at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$MRAppMasterShutdownHook.run(MRAppMaster.java:1506) [hadoop-mapreduce-client-app-2.7.3.jar:?]at org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54) [hadoop-common-2.7.3.jar:?]
解决办法:
参考apache 官网https://issues.apache.org/jira/browse/MAPREDUCE-5721 点击打开链接
可以看到 说是jobhistory 的配置,检查你 客户端程序 mapre-site.xml 配置:
查看: jobhistory的配置是否有问题,我检查了下我出现问题的原因是因为 没有h4这台机器,jobhisroty运行在h3
问题解决,给大家发福利,有有效期的, 支付宝扫码, 赶紧 过期不候啊
阅读全文
0 0
- Hadoop Exception while unregistering exited with exitCode: 1 报错处理
- AM Container for appattempt_1508757966311_0001_000002 exited with exitCode 1
- hadoop报错处理
- CXF - prefix wsdp is not bound to a namespace - with linked exception - 报错处理
- 解决 RMContainerAllocator: Exception while unregistering java.lang.NullPointerException问题
- Hadoop报错处理方法汇总
- hadoop错误提示 exitCode: 1 due to: Exception from container-launch.
- 报错处理:严重: Exception starting filter struts2 NoClassDefFoundError
- FNBJ-报错处理-1
- oracle-报错处理-1
- docker报错处理1
- 【Hadoop】6、Hadoop安装之报错处理
- hadoop上hive安装配置及报错处理
- Mac 上运行Hadoop的mapreduce报错exitCode: 127
- Hadoop运行job程序报错 exitCode=255
- ASPxGridView报错处理
- mencoder 报错处理
- tomcat报错处理
- VSCode使用经验总结
- 异常----异常对象的抛出
- Java培训过程中,如何提高学习效率?
- angularjs+多文件上传
- 复盘,交易计划,计划交易
- Hadoop Exception while unregistering exited with exitCode: 1 报错处理
- bzoj 1570: [JSOI2008]Blue Mary的旅行
- 多线程执行job任务 线程池
- int main(int argc, char *argv[]) 的用法
- Python每日小结(一)
- @Target、ElementType源码翻译
- 关于keil软件左侧不出现 .h文件的解决办法。
- pulltorefresh 的布局
- Spark Java 二次排序