sqoop安装
来源:互联网 发布:剑网3脸型数据导入 编辑:程序博客网 时间:2024/04/28 19:33
1、下载sqoop
下载地址:http://sqoop.apache.org/
2、安装
# tar -xzvf sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz
3、更改解压后文件的名字(因为源名字太长):
# mv sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz sqoop-1.4.6
4、编辑 profile文件
# vi /etc/profile
- 添加 export SQOOP_HOME=/opt/sqoop-1.4.6
- 在PATH路径中添加$SQOOP_HOME/bin:
PATH=$SQOOP_HOME/bin:$JAVA_HOME/bin:$HADOOP_HOME/bin:$PATH
[root@localhost opt]# source /etc/profile
5、验证
[root@localhost opt]# echo $SQOOP_HOME
/opt/sqoop-1.4.6
[root@localhost sqoop-1.4.6]# sqoop version
Error: /opt/sqoop-1.4.6/../hadoop does not exist!
Please set $HADOOP_COMMON_HOME to the root of your Hadoop installation.
报错 Error: /opt/sqoop-1.4.6/../hadoop does not exist!
解决方法:
- 在sqoop中conf目录下新复制一个sqoop-env.sh文件:
[root@localhost sqoop-1.4.6]# cd conf/
[root@localhost conf]# ll
total 28
-rw-rw-r--. 1 root root 3895 Apr 26 2015 oraoop-site-template.xml
-rw-rw-r--. 1 root root 1404 Apr 26 2015 sqoop-env-template.cmd
-rwxr-xr-x. 1 root root 1345 Apr 26 2015 sqoop-env-template.sh
-rw-rw-r--. 1 root root 5531 Apr 26 2015 sqoop-site-template.xml
-rw-rw-r--. 1 root root 5531 Apr 26 2015 sqoop-site.xml
[root@localhost conf]# cp sqoop-env-template.sh sqoop-env.sh
- 配置sqoop-env.sh文件:
[root@localhost conf]# vi sqoop-env.sh
修改
#Set path to where bin/hadoop is available
export HADOOP_COMMON_HOME=/opt/hadoop-2.7.2/
#Set path to where hadoop-*-core.jar is available
export HADOOP_MAPRED_HOME=/opt/hadoop-2.7.2/
- 验证
[root@localhost conf]# sqoop version
Sqoop 1.4.6
git commit id c0c5a81723759fa575844a0a1eae8f510fa32c25
Compiled by root on Mon Apr 27 14:38:36 CST 2015
6、下载数据库的jar包
oracle:http://www.oracle.com/technetwork/database/enterprise-edition/jdbc-112010-090769.html
mysql:http://dev.mysql.com/downloads/file/?id=465643
需要把下载好的jar包copy到sqoop的lib下面
[root@localhost opt]# tar -xzvf mysql-connector-java-5.1.40.tar.gz
[root@localhost opt]# cp ojdbc6.jar sqoop-1.4.6/lib/
7、sqoop user guide文档
http://sqoop.apache.org/docs/1.4.6/SqoopUserGuide.html
0 0
- [Sqoop]Sqoop安装
- sqoop安装
- sqoop 安装
- SQOOP安装
- 安装Sqoop
- sqoop安装
- sqoop 安装
- sqoop安装
- sqoop安装
- sqoop安装
- Sqoop 安装
- sqoop安装
- sqoop 安装
- Sqoop安装
- sqoop安装
- sqoop安装
- sqoop 安装
- Sqoop安装
- spark与hadoop
- list集合移除某个属性相同的重复对象
- sublime快捷键使用
- dispatch_async_f 详解
- Mixin编写和使用
- sqoop安装
- Linux TCP最大连接数
- React双向绑定Mixin
- OpenCv (正式篇) 5----Highgui板块 /* 不断更新 */
- hadoop环境搭建笔记
- sql order by,desc和limit使用(mysql)
- biee echarts饼图数据引入
- 文章标题
- 棋牌游戏服务器开发心得