hadoop集群sqoop2安装指南
来源:互联网 发布:d3.js圆形图 编辑:程序博客网 时间:2024/05/17 01:38
环境说明
操作系统:Ubuntu 14.04
集群节点:
- Master
- slave1
- slave2
解压并安装
hadoop@Master:~$ sudo tar xvfz sqoop-1.99.6-bin-hadoop200.tar.gz hadoop@Master:~$ sudo mv sqoop-1.99.6-bin-hadoop200 /usr/local/sqoophadoop@Master:~$ sudo chmod -R 775 /usr/local/sqoophadoop@Master:~$ sudo chown -R hadoop:hadoop /usr/local/sqoop
修改环境变量
hadoop@Master:~$ sudo nano /etc/profile#sqoopexport SQOOP_HOME=/usr/local/sqoopexport PATH=$SQOOP_HOME/bin:$PATHexport CATALINA_BASE=$SQOOP_HOME/serverexport LOGDIR=$SQOOP_HOME/logshadoop@Master:~$ source /etc/profile
修改sqoop的环境变量
hadoop@Master:/$ sudo nano /usr/local/sqoop/server/conf/sqoop.properties #修改指向我的hadoop安装目录 org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/usr/local/hadoop/etc/hadoop hadoop@Master:/$ sudo nano /usr/local/sqoop/server/conf/catalina.properties common.loader=/usr/local/hadoop/share/hadoop/common/*.jar,/usr/local/hadoop/share/hadoop/common/lib/*.jar,/usr/local/hadoop/share/hadoop/hdfs/*.jar,/usr/local/hadoop/share/hadoop/hdfs/lib/*.jar,/usr/local/hadoop/share/hadoop/mapreduce/*.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/*.jar,/usr/local/hadoop/share/hadoop/tools/*.jar,/usr/local/hadoop/share/hadoop/tools/lib/*.jar,/usr/local/hadoop/share/hadoop/yarn/*.jar,/usr/local/hadoop/share/hadoop/yarn/lib/*.jar,/usr/local/hadoop/share/hadoop/httpfs/tomcat/lib/*.jar,
下载mysql驱动包,mysql-connector-java-5.1.27.jar
把jar包丢到到$SQOOP_HOME/server/lib下面
$ sudo cp mysql-connector-java-5.1.27.jar $SQOOP_HOME/server/lib
有时,启动sqoop时可能会遇到找不到JAVA_HOME的情况,为了保险起见我们直接在配置文件中写入JAVA_HOME
#在/usr/local/sqoop/server/bin/setenv.sh中,添加export JAVA_HOME=/usr/lib/jvm/
启动sqoop
hadoop@Master:~/mysql-connector-java-5.0.8$ sqoop.sh server startSqoop home directory: /usr/local/sqoopSetting SQOOP_HTTP_PORT: 12000Setting SQOOP_ADMIN_PORT: 12001Using CATALINA_OPTS: Adding to CATALINA_OPTS: -Dsqoop.http.port=12000 -Dsqoop.admin.port=12001Using CATALINA_BASE: /usr/local/sqoop/serverUsing CATALINA_HOME: /usr/local/sqoop/serverUsing CATALINA_TMPDIR: /usr/local/sqoop/server/tempUsing JRE_HOME: /usr/lib/jvm//jreUsing CLASSPATH: /usr/local/sqoop/server/bin/bootstrap.jar
验证启动成功
如果服务端已经启动,则有Bootstrap这个进程:
hadoop@Master:~$ jps...13771 Bootstrap...
1 0
- hadoop集群sqoop2安装指南
- Hadoop 2.7集群安装指南
- 安装sqoop2
- sqoop2安装
- sqoop2安装
- Sqoop2-1:Sqoop2 安装配置
- CentOS6.4配置Hadoop-2.6.0集群配置安装指南
- sqoop2 1.99.3安装
- Sqoop2安装记录
- Sqoop2安装记录
- ubuntu安装sqoop2
- Sqoop2安装 (unstable)
- sqoop2安装配置
- Sqoop2 Java客户端API指南
- Sqoop2 Java客户端API指南
- Hadoop集群安装spark集群
- sqoop2 hadoop ha搭建注意
- Kubernetes 集群安装指南
- UVA 1336 Fixing the Great Wall
- iOS10适配
- Popupwindow的使用
- spring和redis的整合
- java 中的 成员变量、局部变量、静态变量、类变量、非静态变量、实例变量、向前引用、非法向前引用、静态代码块、非静态代码块 执行时机
- hadoop集群sqoop2安装指南
- 【GLSL教程】(二)在OpenGL中使用GLSL
- OD常用快捷键
- SpringMVC从Controller跳转到另一个Controller
- C学习阶段的遗漏二
- JVM的内存区域划分
- CTR预估特征工程
- 负载均衡算法
- 怎么把pdf文件内容都转换成jpg图片