【汇总】ExitCodeException问题Ooz…

来源：互联网发布：世界人工智能大会北京编辑：程序博客网时间：2024/06/04 18:49

这种问题光看yarn的log，是看不出到底啥毛病的。

Applicationapplication_1486993422162_0079 failed 2 times due to AM Containerfor appattempt_1486993422162_0079_000002 exited with exitCode:1

For more detailed output, checkapplication trackingpage:http://bigdata-master:8088/cluster/app/application_1486993422162_0079Then,click on links to logs of each attempt.

Diagnostics: Exception fromcontainer-launch.

Container id:container_1486993422162_0079_02_000001

Exit code: 1

Stack trace: ExitCodeExceptionexitCode=1:

atorg.apache.hadoop.util.Shell.runCommand(Shell.

atorg.apache.hadoop.util.Shell.run(Shell.

atorg.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.

atorg.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.

atorg.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.

…… …… …… ……

Container exited with anon-zero exit code 1

Failing this attempt. Failingthe application.

必须根据yarn web UI给出的applicationID，在yarn里面查询yarn的log才能判断问题。问题可能有这么几种：

1、Oozie运行python的spark job解决缺py4j.zip和pyspark.zip问题

2、Oozie报错Py4JJavaError SecurityException: class"javax.servlet.FilterRegistr

3、Oozie 4.3.0运行Error: Could not load YARN classes. This copyof Spark may not have been compiled with YARN support.

4、Oozie报错ClassNotFoundException: Classorg.apache.oozie.action.hadoop.SparkMain

0 0