ozzie配置和example

来源:互联网 发布:云计算系统软件 编辑:程序博客网 时间:2024/05/16 12:28

修改core-site.xml属性

hadoop.proxyuser.beifeng.hosts
hadoop-senior.ibeifeng.com


hadoop.proxyuser.beifeng.groups
beifeng

oozie-site.xml属性

oozie.service.HadoopAccessorService.hadoop.configurations
*=/opt/cdh-5.3.6/hadoop-2.5.0-cdh5.3.6/etc/hadoop

Comma separated AUTHORITY=HADOOP_CONF_DIR, where AUTHORITY is the HOST:PORT of
the Hadoop service (JobTracker, HDFS). The wildcard '*' configuration is
used when there is no exact match for an authority. The HADOOP_CONF_DIR contains
the relevant Hadoop *-site.xml files. If the path is relative is looked within
the Oozie configuration directory; though the path can be absolute (i.e. to point
to Hadoop client conf/ directories in the local filesystem.


解压oozie-hadooplibs-4.0.0-cdh5.3.6.tar.gz 到当前目录

Create a libext/ directory in the directory where Oozie was expanded.

拷贝hadooplib目录jar包到libext中
cp -r oozie-4.0.0-cdh5.3.6/hadooplibs/hadooplib-2.5.0-cdh5.3.6.oozie-4.0.0-cdh5.3.6/* libext/

把extjs2.2也拷贝到该目录中/libext/
mv ext-2.2.zip /opt/cdh-5.3.6/oozie-4.0.0-cdh5.3.6/libext/

bin/oozie-setup.sh prepare-war

bin/oozie-setup.sh sharelib create -fs hdfs://hadoop-senior.ibeifeng.com -locallib oozie-sharelib-4.0.0-cdh5.3.6-yarn.tar.gz

bin/ooziedb.sh create -sqlfile oozie.sql -run DB Connection

bin/oozied.sh start

安装完成

运行example

修改以下配置文件
/opt/cdh-5.3.6/oozie-4.0.0-cdh5.3.6/examples/apps/map-reduce/job.properties

nameNode=hdfs://hadoop-senior.ibeifeng.com:8020
jobTracker=hadoop-senior.ibeifeng.com:8021
queueName=default
examplesRoot=examples

oozie.wf.application.path=nameNode/user/{user.name}/${examplesRoot}/apps/map-reduce/workflow.xml
outputDir=map-reduce

bin/oozie job -oozie http://hadoop-senior.ibeifeng.com:11000/oozie -config examples/apps/map-reduce/job.properties -run
oozie job -oozie http://localhost:11000/oozie -config examples/apps/map-reduce/job.properties -run

exportOOZIEURL=http://hadoopsenior.ibeifeng.com:11000/oozie/
$ oozie job -info 14-20090525161321-oozie-tucu
这里写图片描述
这里写图片描述
这里写图片描述
这里写图片描述
这里写图片描述

0 0