【hadoop Sqoop】Sqoop从mysql导数据到hdfs

来源:互联网 发布:阿里云 smtp发不出 编辑:程序博客网 时间:2024/05/16 05:50

1.下载sqoop安装包

wget https://mirrors.tuna.tsinghua.edu.cn/apache/sqoop/1.4.6/sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz

2.解压安装包

tar -xzvf  /sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz

3.配置hadoop

mv sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz  sqoop-1.4.6cd sqoop-1.4.6/confcp sqoop-env-template.sh sqoop-env.shvim sqoop-env.sh

这里写图片描述

4.将mysql-connector-java-5.1.32-bin.jar放到 sqoop-1.4.6/lib目录中

5.设置环境变量 vim ~/etc/profile

    export SQOOP_HOME=/home/hadoop/sqoop-1.4.6    export PATH=$PATH:$SQOOP_HOME/bin

6.编写脚本vim import-data.sh

#bin/bashsqoop import \--connect jdbc:mysql://115.29.185.31:39556/cgjr \--username XXXX \--password XXXX \--table t_user_contact   \--m 4  \--target-dir /cgjr/t_user_contact \--as-textfile
原创粉丝点击