sqoop安装

来源:互联网 发布:剑网3脸型数据导入 编辑:程序博客网 时间:2024/04/28 19:33

1、下载sqoop

     下载地址:http://sqoop.apache.org/

2、安装

# tar -xzvf sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz

3、更改解压后文件的名字(因为源名字太长):

# mv sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz sqoop-1.4.6

4、编辑 profile文件

# vi /etc/profile
  •     添加 export SQOOP_HOME=/opt/sqoop-1.4.6
  •     在PATH路径中添加$SQOOP_HOME/bin:

              PATH=$SQOOP_HOME/bin:$JAVA_HOME/bin:$HADOOP_HOME/bin:$PATH

             Clipboard Image.png

[root@localhost opt]# source /etc/profile

5、验证

[root@localhost opt]# echo $SQOOP_HOME 
/opt/sqoop-1.4.6
[root@localhost sqoop-1.4.6]# sqoop version
Error: /opt/sqoop-1.4.6/../hadoop does not exist!
Please set $HADOOP_COMMON_HOME to the root of your Hadoop installation.

报错 Error: /opt/sqoop-1.4.6/../hadoop does not exist!

解决方法:

  • 在sqoop中conf目录下新复制一个sqoop-env.sh文件:
[root@localhost sqoop-1.4.6]# cd conf/
[root@localhost conf]# ll
total 28
-rw-rw-r--. 1 root root 3895 Apr 26  2015 oraoop-site-template.xml
-rw-rw-r--. 1 root root 1404 Apr 26  2015 sqoop-env-template.cmd
-rwxr-xr-x. 1 root root 1345 Apr 26  2015 sqoop-env-template.sh
-rw-rw-r--. 1 root root 5531 Apr 26  2015 sqoop-site-template.xml
-rw-rw-r--. 1 root root 5531 Apr 26  2015 sqoop-site.xml
[root@localhost conf]# cp sqoop-env-template.sh sqoop-env.sh
  • 配置sqoop-env.sh文件:
[root@localhost conf]# vi sqoop-env.sh
修改
#Set path to where bin/hadoop is available
export HADOOP_COMMON_HOME=/opt/hadoop-2.7.2/
#Set path to where hadoop-*-core.jar is available
export HADOOP_MAPRED_HOME=/opt/hadoop-2.7.2/
  • 验证
[root@localhost conf]# sqoop version
Sqoop 1.4.6
git commit id c0c5a81723759fa575844a0a1eae8f510fa32c25
Compiled by root on Mon Apr 27 14:38:36 CST 2015

6、下载数据库的jar包

oracle:http://www.oracle.com/technetwork/database/enterprise-edition/jdbc-112010-090769.html

mysql:http://dev.mysql.com/downloads/file/?id=465643

需要把下载好的jar包copy到sqoop的lib下面

[root@localhost opt]# tar -xzvf mysql-connector-java-5.1.40.tar.gz 
[root@localhost opt]# cp ojdbc6.jar sqoop-1.4.6/lib/

7、sqoop user guide文档

http://sqoop.apache.org/docs/1.4.6/SqoopUserGuide.html

0 0
原创粉丝点击