HIVE入门安装及配置

来源：互联网发布：梦幻诛仙手游数据互通编辑：程序博客网时间：2024/05/16 17:21

HIVE安装及配置

1、mysql安装需要软件为：

MySQL-client-5.5.28-1.linux2.6.x86_64.rpm(client端)

MySQL-server-5.5.28-1.linux2.6.x86_64.rpm #server端

mysql-connector-java-5.1.10.jar (mysql驱动包)

2、安装mysql server 端

rpm -qa |grep mysql                                             #检查是否已经安装rpm  -e  mysql*   --nodeps                                  #删除已经安装的mysql

rpm -i   MySQL-server-5.5.28-1.linux2.6.x86_64.rpm

#安装mysql服务端

 mysqld_safe &

#启动mysql 服务端，执行命令

3、安装mysql客户端

rpm -i   MySQL-client-5.5.28-1.linux2.6.x86_64.rpm

4、设置root用户密码

mysql_secure_installation #设置root用户密码

在这里mysql安装完毕了

5、配置mysql 做为hive的元数据存储位置

hive下载地址：http://archive.apache.org/dist/hive/hive-0.13.1/

6、配置hive-0.13.1/conf/hive-env.sh

内容为：

# Set HADOOP_HOME to point to a specific hadoop install directory HADOOP_HOME=/opt/hadoop# Hive Configuration Directory can be controlled by: export HIVE_CONF_DIR=/opt/hive-0.13.1/conf

7、配置hive-0.13.1/conf/hive-site.xml内容为：

<property>        <name>javax.jdo.option.ConnectionURL</name>     <value>jdbc:mysql://cloud1:3306/hive?createDatabaseIfNotExist=true</value>   #############这里设数据库为hive</property> <property>      <name>javax.jdo.option.ConnectionDriverName</name>       <value>com.mysql.jdbc.Driver</value></property><property>        <name>javax.jdo.option.ConnectionUserName</name>        <value>hadoop</value></property><property>   <name>javax.jdo.option.ConnectionPassword</name>    <value>hadoop</value></property>

这里配置hadoop用户访问mysql 首先hadoop必须有权限访问mysql 因为我是用 root用户安装的mysql

8、授权：(我这里有5台机器)

 GRANT ALL PRIVILEGES ON *.* TO 'hadoop'@'192.168.80.20' IDENTIFIED BY 'hadoop' WITH GRANT OPTION;  GRANT ALL PRIVILEGES ON *.* TO 'hadoop'@'192.168.80.21' IDENTIFIED BY 'hadoop' WITH GRANT OPTION;  GRANT ALL PRIVILEGES ON *.* TO 'hadoop'@'192.168.80.22' IDENTIFIED BY 'hadoop' WITH GRANT OPTION;  GRANT ALL PRIVILEGES ON *.* TO 'hadoop'@'192.168.80.23' IDENTIFIED BY 'hadoop' WITH GRANT OPTION;  GRANT ALL PRIVILEGES ON *.* TO 'hadoop'@'192.168.80.24' IDENTIFIED BY 'hadoop' WITH GRANT OPTION;

9、启动mysql

mysql -u root -p

我这里没有密码回车就ok

10、因为上面的配置数据库为hive 可以在mysql中查看

mysql> show databases;+--------------------+| Database           |+--------------------+| information_schema || hive               || mysql              || performance_schema || test               |+--------------------+5 rows in set (0.04 sec)

11、使用hive数据库

mysql> use hive show tables

结果为

| Tables_in_hive            |+---------------------------+| BUCKETING_COLS            || CDS                       || COLUMNS_V2                || DATABASE_PARAMS           || DBS                       || FUNCS                     || FUNC_RU                   || GLOBAL_PRIVS              || PARTITIONS                || PARTITION_KEYS            || PARTITION_KEY_VALS        || PARTITION_PARAMS          || PART_COL_STATS            || ROLES                     || SDS                       || SD_PARAMS                 || SEQUENCE_TABLE            || SERDES                    || SERDE_PARAMS              || SKEWED_COL_NAMES          || SKEWED_COL_VALUE_LOC_MAP  || SKEWED_STRING_LIST        || SKEWED_STRING_LIST_VALUES || SKEWED_VALUES             || SORT_COLS                 || TABLE_PARAMS              || TAB_COL_STATS             || TBLS                      || VERSION

 select * from DBS;+-------+-----------------------+------------------------------------+---------+------------+------------+| DB_ID | DESC                  | DB_LOCATION_URI                    | NAME    | OWNER_NAME | OWNER_TYPE |+-------+-----------------------+------------------------------------+---------+------------+------------+|     1 | Default Hive database | hdfs://cluster/user/hive/warehouse | default | public     | ROLE       |+-------+-----------------------+------------------------------------+---------+------------+------------+1 row in set (0.00 sec)

12、启动hive

cd $HIVE_HOME/bin

hive

[root@cloud1 bin]# hive15/10/17 23:43:46 WARN conf.HiveConf: DEPRECATED: hive.metastore.ds.retry.* no longer has any effect.  Use hive.hmshandler.retry.* insteadLogging initialized using configuration in jar:file:/opt/hive-0.13.1/lib/hive-common-0.13.1.jar!/hive-log4j.propertieshive> create table student (id int,name string) row format delimited fields terminated by '\t';OK

13、在hive中创建表

create table student (id int,name string) row format delimited fields terminated by '\t';

加载数据

load data local inpath '/opt/xiaoming/a.txt' overwrite into table student ;

查看数据

hive> select * from student; OK1xiaoming2zhangsan3lisiTime taken: 4.015 seconds, Fetched: 3 row(s)

搞定了

0 0