Sqoop-1.4.6安装部署

来源：互联网发布：建立java.jar文件编辑：程序博客网时间：2024/06/05 06:53

感谢分享：

http://blog.csdn.net/bluejoe2000/article/details/49838455

http://blog.csdn.net/dwld_3090271/article/details/50747639

下载地址：http://mirrors.cnnic.cn/apache/sqoop/

1.下载sqoop-1.4.6并解压

wget http://mirrors.cnnic.cn/apache/sqoop/1.4.6/sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz

tar -zxvf sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz

ln -s /opt/sqoop-1.4.6.bin__hadoop-2.0.4-alpha /usr/local/hadoop/sqoop-1.4.6

2.配置环境变量

vim /etc/profile

#for sqoop
export SQOOP_HOME=/usr/local/hadoop/sqoop-1.4.6/
export PATH=$SQOOP_HOME/bin:$PATH

source /etc/profile

3.创建sqoop-env.conf文件

cd/usr/local/hadoop/sqoop-1.4.6/conf

cp sqoop-env-template.sh sqoop-env.sh

vi sqoop-env.sh

export HADOOP_COMMON_HOME=${HADOOP_HOME}

export HADOOP_MAPRED_HOME=${HADOOP_HOME}

export ZOOCFGDIR=${ZOOKEEPER_HOME}/conf

因为HADOOP_HOME、HBASE_HOME、HIVE_HOME以及ZOOKEEPER_HOME都在etc/profile中有过定义，因此在此不再定义。

4.将MySQL的驱动拷贝到lib下：

cp /opt/mysql-connector-java-5.1.39/mysql-connector-java-5.1.39-bin.jar /usr/local/hadoop/sqoop-1.4.6/lib

5.修改$SQOOP_HOME/bin/configure-sqoop

注释掉HCatalog，Accumulo检查(除非你准备使用HCatalog，Accumulo等HADOOP上的组件)
## Moved to be a runtime check in sqoop.
#if [ ! -d "${HCAT_HOME}" ]; then
# echo "Warning: $HCAT_HOME does not exist! HCatalog jobs willfail."
# echo 'Please set $HCAT_HOME to the root of your HCatalog installation.'
#fi
#if [ ! -d "${ACCUMULO_HOME}" ];then
# echo "Warning: $ACCUMULO_HOME does not exist! Accumulo imports willfail."
# echo 'Please set $ACCUMULO_HOME to the root of your Accumuloinstallation.'
#fi

6.测试连接：

显示mysql数据库列表:

sqoop list-databases --connect jdbc:mysql://192.168.71.221:3306/ --username hive --password hive

显示数据库里所有表:

sqoop list-tables --connect jdbc:mysql://192.168.71.221:3306/hive --username hive --password hive

0 0