hadoop-2.6.0下hive-1.2.2安装与配置
来源:互联网 发布:盈建科软件 编辑:程序博客网 时间:2024/05/16 13:53
1集群组成
yesmasterserver2Data node & Node manager
yesRegion serverserver3Data node & Node manager
yesRegion serverserver4Data node & Node manager
yesRegion server
hive只需要在server1上安装配置。
2:下载解压hive-1.2.2
cd /usr/local/hadoop-2.6.0tar -zxvfapache-hive-1.2.2-bin.tar.gzmv apache-hive-1.2.2-bin.tar.gz hive-1.2.2
3:设置环境变量:
HIVE_HOME=/usr/local/hadoop-2.6.0/hive-1.2.2PATH=$HIVE_HOME/bin:$PATHCLASSPATH=$CLASSPATH:$HIVE_HOME/libexport HIVE_HOMEexport PATHexport CLASSPATH执行:source /etc/profile
4:安装配置数据库(mariadb)
yum install mariadb mariadb-serversystemctl enable mariadbsystemctl start mariadb
4.1:下载mysql驱动
mariadb装好后去网上下载一个链接MYSQL的JDBC驱动,对应自己的数据库版本下载相应的jdbc,mysql-connector-java-5.5.38-bin.jar此处下载的是:将jdbc放入到hive的解压文件的lib目录下。
驱动下载
4.2:创建和授权mysql用户
mysql_secure_installation ——>设置root用户密码mysql -u root -p ——>输入root用户密码,进入数据库.create database hiveDB;——>创建数据库create user "hive"@'%' identified by "redhat"; ——>创建一个名为hive密码为redhat的用户,其可以从任意地方登陆grant all privileges on hiveDB.* to hive@'%'; ——>授予hive用户对hiveDB的所有权限flush privileges; ——>刷新系统权限
5:配置hive,配置文件在hive的conf目录下面
5.1:配置hive-site.xml
配置hive-site.xml,conf目录下应该没有这个文件,需要将hive-default.xml.template中的配置文件中内容复制到hive-site.xml文件中,但是现在我们只需要用一些配置信息,所以可以在conf目录下直接新建hive-site.xml,然后在文件中写入一下内容即可。
<?xml version="1.0" encoding="UTF-8" standalone="no"?><?xml-stylesheet type="text/xsl" href="configuration.xsl"?><!-- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to You under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.--><configuration><property> <name>hive.exec.scratchdir</name> <value>hdfs://server1:9000/tmp/hive</value></property><property> <name>javax.jdo.option.ConnectionURL</name> <value>jdbc:mysql://server1:3306/hiveDB?createDatabaseIfNotExist=true&characterEncoding=UTF-8</value></property><property> <name>javax.jdo.option.ConnectionDriverName</name> <value>com.mysql.jdbc.Driver</value></property><property> <name>javax.jdo.option.ConnectionUserName</name> <value>hive</value></property><property> <name>javax.jdo.option.ConnectionPassword</name> <value>redhat</value></property><property> <name>hive.metastore.warehouse.dir</name> <value>hdfs://server1:9000/hive/warehouse</value> <description>location of default database for the warehouse</description></property><property> <name>javax.jdo.option.Multithreaded</name> <value>true</value></property></configuration>
注:hive.exec.scratchdir是执行HIVE操作访问HDFS用于临时存储数据的目录
javax.jdo.option.ConnectionURL -> 设置hive通过JDBC链接MYSQL数据库存储metastore存放的数据库地址
javax.jdo.option.ConnectionDriverName ->设置链接mysql的驱动名称。
javax.jdo.option.ConnectionUserName -> 设置存储metastore内容的数据库用户名
javax.jdo.option.ConnectionPassword -> 设置存储metastore内容的数据库用户名密码
hive.metastore.warehouse.dir -> 设置用于存放hive元数据的目录位置,改配置有三种模式,内嵌模式,本地元数据,远程元数据。
5.2:配置hive-env.sh
cp hive-env.sh.template hive-env.shvim hive-env.shHADOOP_HOME=/usr/local/hadoop-2.6.0# Hive Configuration Directory can be controlled by:export HIVE_CONF_DIR=/usr/local/hadoop-2.6.0/hive-1.2.2/conf注:次时也不能启动hive服务,因为Hadoop的版本是2.6.0,hive的版本是1.2.2,HIVE_HOME/lib目录下的jline-2.12.jar比HADOOP_HOME/share/hadoop/yarn/lib下的jline-0.9.94.jar版本高,版本不一致导致。所以将HIVE_HOME/lib目录下的jline-2.12.jar复制到HADOOP_HOME/share/hadoop/yarn/lib下,并将jline-0.9.94.jar删除,然后重启hadoop
cp /usr/local/hadoop-2.6.0/hive-1.2.2/bin/lib/jline-2.12.jar /usr/local/hadoop-2.6.0/share/hadoop/yarn/lib/rm /usr/local/hadoop-2.6.0/share/hadoop/yarn/lib/jline-0.9.94.jar
6:完成验证:
当在命令行输入hive无报错,出现交互界面,及成功安装。
- hadoop-2.6.0下hive-1.2.2安装与配置
- hive安装配置与hive的JDBC (hadoop-0.20.2 + hive-0.7.0)
- hive安装配置与hive的JDBC (hadoop-0.20.2 + hive-0.7.0)
- Hadoop学习--Hive安装与配置
- Hadoop学习--Hive安装与配置
- hadoop集群安装与配置---hive安装与配置
- Hadoop&hive安装配置
- hadoop-hive安装配置
- Hive&hadoop 安装配置
- Hadoop+Hive安装配置
- hive 1.0.1 安装配置 hadoop 2.6.0
- Hadoop-2.7.3环境下Hive-2.1.1安装配置。
- linux下hadoop与hive的单机开发配置
- Hadoop+Hive部署安装配置
- Hadoop+Hive部署安装配置
- Hadoop那些事儿(五)---Hive安装与配置
- hadoop学习笔记之hive 安装与配置
- Hadoop学习-hive的安装配置与常见问题解决
- POJ 1151 Atlantis 笔记
- Python turtle 库 画图 彩色螺旋线五角星太阳花
- 2118 sdut
- HDU 5880 AC自动机
- 部署ecshop之一
- hadoop-2.6.0下hive-1.2.2安装与配置
- Oracle基本操作八:PL/SQL特殊数据类型%type %rowtype VARRAY TABLE RECORD
- [计算机视觉][神经网络与深度学习]Faster R-CNN配置及其训练教程2
- 会场安排问题
- Android ActionBar应用实战,高仿微信主界面的设计
- Hihocoder 1514
- 实验吧——WriteUp&&涨姿势(2)
- [YTu]_2439(C++习题 复数类--重载运算符+)
- 20170513_请判断二叉树是不是平衡二叉树?