centos7(vm)下sqoop1.99.7安装(x86)

来源:互联网 发布:魔方数据是什么 编辑:程序博客网 时间:2024/04/28 16:04

1.vm安装(略)

2.软件下载

sqoop-1.99.7-bin-hadoop200.tar.gz (直接下载已经编译好的,解压即可)

jdk-8u77-linux-x64.tar

环境变量如下:

#JAVA
export JAVA_HOME=/root/java/jdk1.8.0_77
export JRE_HOME=$JAVA_HOME/jre
export PATH=$PATH:$JAVA_HOME/bin
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar

#SCALA
export SCALA_HOME=/root/spark/scala-2.10.4
export PATH=$PATH:$SCALA_HOME/bin

#HADOOP
export HADOOP_HOME=/root/hadoop/hadoop-2.7.2
export PATH=.:$HADOOP_HOME/bin:$JAVA_HOME/bin:$PATH

#sqoop
export SQOOP_HOME=/root/sqoop/sqoop-1.99.7-bin-hadoop200
export PATH=$SQOOP_HOME/bin:$PATH


1.sqoop的安装路径

[root@localhost sqoop-1.99.7-bin-hadoop200]# pwd
/root/sqoop/sqoop-1.99.7-bin-hadoop200
[root@localhost sqoop-1.99.7-bin-hadoop200]# ll
total 128
drwxr-xr-x  4 root root   128 Dec 20 23:12 bin
-rw-r--r--  1 root root 93386 Jul 20 07:09 CHANGELOG.txt
drwxr-xr-x  2 root root    62 Dec 20 23:10 conf
drwxr-xr-x 10 root root  4096 Dec 20 22:59 docs
-rw-r--r--  1 root root 24356 Jul 20 07:09 LICENSE.txt
-rw-r--r--  1 root root   166 Jul 20 07:09 NOTICE.txt
-rw-r--r--  1 root root  1610 Jul 20 07:09 README.txt
drwxr-xr-x  3 root root    16 Jul 20 07:09 server
drwxr-xr-x  3 root root    16 Jul 20 07:09 shell
drwxr-xr-x  3 root root    16 Jul 20 07:09 tools
[root@localhost sqoop-1.99.7-bin-hadoop200]#

2.Sqoop服务器配置

主要是配置conf目录下的sqoop.properties和sqoop_bootstrap.properties两个文件

sqoop_bootstrap.properties一般使用默认值即可:

sqoop.config.provider=org.apache.sqoop.core.PropertiesConfigurationProvider 

sqoop.properties

org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/root/hadoop/hadoop-2.7.2/etc/hadoop
org.apache.sqoop.security.authentication.type=SIMPLE
org.apache.sqoop.security.authentication.handler=org.apache.sqoop.security.authentication.SimpleAuthenticationHandler
org.apache.sqoop.security.authentication.anonymous=true


3.sqoop2-tool工具 进行验证

[root@localhost bin]# ./sqoop2-tool  verify

4.开启服务
[root@localhost bin]# ./sqoop2-server start

5.jps验证
[root@localhost bin]# jps
5315 Jps
3353 AmbariServer
4926 SqoopJettyServer
[root@localhost bin]#




1 0
原创粉丝点击