ozzie配置和example
来源:互联网 发布:云计算系统软件 编辑:程序博客网 时间:2024/05/16 12:28
修改core-site.xml属性
hadoop.proxyuser.beifeng.hosts
hadoop-senior.ibeifeng.com
hadoop.proxyuser.beifeng.groups
beifeng
oozie-site.xml属性
oozie.service.HadoopAccessorService.hadoop.configurations
*=/opt/cdh-5.3.6/hadoop-2.5.0-cdh5.3.6/etc/hadoop
Comma separated AUTHORITY=HADOOP_CONF_DIR, where AUTHORITY is the HOST:PORT of
the Hadoop service (JobTracker, HDFS). The wildcard '*' configuration is
used when there is no exact match for an authority. The HADOOP_CONF_DIR contains
the relevant Hadoop *-site.xml files. If the path is relative is looked within
the Oozie configuration directory; though the path can be absolute (i.e. to point
to Hadoop client conf/ directories in the local filesystem.
解压oozie-hadooplibs-4.0.0-cdh5.3.6.tar.gz 到当前目录
Create a libext/ directory in the directory where Oozie was expanded.
拷贝hadooplib目录jar包到libext中
cp -r oozie-4.0.0-cdh5.3.6/hadooplibs/hadooplib-2.5.0-cdh5.3.6.oozie-4.0.0-cdh5.3.6/* libext/
把extjs2.2也拷贝到该目录中/libext/
mv ext-2.2.zip /opt/cdh-5.3.6/oozie-4.0.0-cdh5.3.6/libext/
bin/oozie-setup.sh prepare-war
bin/oozie-setup.sh sharelib create -fs hdfs://hadoop-senior.ibeifeng.com -locallib oozie-sharelib-4.0.0-cdh5.3.6-yarn.tar.gz
bin/ooziedb.sh create -sqlfile oozie.sql -run DB Connection
bin/oozied.sh start
安装完成
运行example
修改以下配置文件
/opt/cdh-5.3.6/oozie-4.0.0-cdh5.3.6/examples/apps/map-reduce/job.properties
nameNode=hdfs://hadoop-senior.ibeifeng.com:8020
jobTracker=hadoop-senior.ibeifeng.com:8021
queueName=default
examplesRoot=examples
oozie.wf.application.path=
outputDir=map-reduce
bin/oozie job -oozie http://hadoop-senior.ibeifeng.com:11000/oozie -config examples/apps/map-reduce/job.properties -run
oozie job -oozie http://localhost:11000/oozie -config examples/apps/map-reduce/job.properties -run
$ oozie job -info 14-20090525161321-oozie-tucu
- ozzie配置和example
- adaboost原理和example
- 模块配置组件 Example 程序
- 模块配置组件 Example 程序
- HornetQ和Spring3集成Example
- example
- example
- Example
- example
- Example
- Example
- Example
- Example
- example
- Example
- Example
- 网络协作的天才骑士:Ray Ozzie
- 架构期刊人物述评:Ray Ozzie
- SparkSQL入门_1
- UIImagePickerController 拍照
- Android开发---测试教程
- linux下安装mysql
- Firefox下打开wap站的表单,第一次页面正常,提交后验证失败,重新回到表单页乱码是什么原因造成的
- ozzie配置和example
- Android简单用属性动画实现两个控件重叠
- Yum配置文件详解
- 关于序列旋转(辗转相除求取最大公约数)
- Ruby 安装
- erl_tree heap 堆实现
- POJ 3080 Blue Jeans (暴力)
- 如何更便捷的监控前端服务质量
- java 静态(static)方法的继承和重写