sqoop2安装

来源:互联网 发布:hl线切割锥度编程视频 编辑:程序博客网 时间:2024/05/29 03:16

1. 解压

$tar -zxvf sqoop-1.99.6-bin-hadoop200.tar.gz$cd sqoop-1.99.6-bin-hadoop200$pwd/home/clohadoop/sqoop-1.99.6-bin-hadoop200

2. 设置环境变量

$cd /home/clohahaoop$pwd /home/clohadoop$vi .bash_profile


#添加以下环境变量:
export SQOOP_HOME=/home/clohadoop/sqoop-1.99.6-bin-hadoop200export PATH=$SQOOP_HOME/bin:$PATHexport CATALINA_BASE=/home/clohadoop/sqoop-1.99.6-bin-hadoop200/serverexport LOGDIR=$SQOOP_HOME/logs/

$source bash_profile

3. 修改服务配置

$ cd /home/clohadoop/sqoop-1.99.6-bin-hadoop200/server/conf$vi sqoop.properties
将org.apache.sqoop.submission.engine.mapreduce.configuration.directory属性修改为自己对应Hadoop的配置文件目录
设置:

org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/home/clohadoop/hadoop/etc/hadoop


配置数据库(可选操作,默认derby)并且保存。

$vi catalina.properties
设置:

common.loader=${catalina.base}/lib,${catalina.base}/lib/*.jar,${catalina.home}/lib,${catalina.home}/lib/*.jar,${catalina.home}/../lib/*.jar,/home/clohadoop/hadoop/share/hadoop/common/*.jar,/home/clohadoop/hadoop/share/hadoop/common/lib/*.jar,/home/clohadoop/hadoop/share/hadoop/hdfs/*.jar,/home/clohadoop/hadoop/share/hadoop/hdfs/lib/*.jar,/home/clohadoop/hadoop/share/hadoop/mapreduce/*.jar,/home/clohadoop/hadoop/share/hadoop/mapreduce/lib/*.jar,/home/clohadoop/hadoop/share/hadoop/tools/*.jar,/home/clohadoop/hadoop/share/hadoop/tools/lib/*.jar,/home/clohadoop/hadoop/share/hadoop/yarn/*.jar,/home/clohadoop/hadoop/share/hadoop/yarn/lib/*.jar,/home/clohadoop/hadoop/share/hadoop/httpfs/tomcat/lib/*.jar

把oracle的驱动包ojdbc6-11.2.0.4.jar放到/home/clohadoop/sqoop-1.99.5-bin-hadoop200/server/lib/目录下
如果需要将转换传输的是mysql中的数据,则将mysql的 JDBC驱动包导入即可


4. 启动服务

$cd /home/clohadoop/sqoop-1.99.6-bin-hadoop200/bin/$./ sqoop.sh sever start

5. 查看服务是否启动
$jps20334 Jps132954 Main112940 RunJar77100 HMaster111305 RunJar41401 NameNode41709 SecondaryNameNode42166 ResourceManager20289 Bootstrap


#Bootstrap表示服务已经启动

6. 停止服务

$ sqoop.sh server stop  

7. 使用客户端调用sqoop server

$ sqoop.sh client







0 0
原创粉丝点击