ubuntu13.10安装hive0.12.0

来源:互联网 发布:修仙女配之随身淘宝店 编辑:程序博客网 时间:2024/06/05 20:39


参考转载:http://blog.csdn.net/yonghutwo/article/details/23700749


本机环境:
ubuntu 13.10
hadoop 1.1.2
mysql 5.5.7
安装hive版本0.12.0


一、创建用户hive,并授权:
root用户登录mysql创建hive用户并授权,执行命令:


CREATE USER 'hive'@localhost IDENTIFIED BY '123456';

(hive为用户名 ,123456为密码)

GRANT ALL PRIVILEGES ON *.* TO 'hive'@'localhost' WITH GRANT OPTION;

二、安装配置hive
1.下载hive-0.12.0.tar.gz
2.解压tar -xzvf hive-0.12.0.tar.gz(我的hive文件放在/usr/local下)
3.配置环境变量,在etc/profile文件末尾添加以下内容:
export HIVE_HOME=/usr/localhive-0.12.0
export PATH=$HIVE_HOME/bin:$PATH
执行source /etc/profile更新环境变量
4.拷贝模板配置文件并修改
[root@hadoop1 hive-0.12.0]# cd conf/
[root@hadoop1 conf]# cp hive-env.sh.template hive-env.sh
[root@hadoop1 conf]# cp hive-default.xml.template hive-site.xml
5.修改hive-env.sh文件,指定HADOOP_HOME及HIVE_CONF_DIR的路径如下: 
HADOOP_HOME=/usr/local/hadoop 
export HIVE_CONF_DIR=/usr/local/hive-0.12.0/conf
6.修改hive-site.xml文件,指定MySQL数据库驱动、数据库名、用户名及密码,修改的内容如下所示:
<property>
  <name>javax.jdo.option.ConnectionURL</name>
  <value>jdbc:mysql://localhost:3306/hive?createDatabaseIfNotExist=true</value>
  <description>JDBC connect string for a JDBC metastore</description>
</property>


<property>
  <name>javax.jdo.option.ConnectionDriverName</name>
  <value>com.mysql.jdbc.Driver</value>
  <description>Driver class name for a JDBC metastore</description>
</property>


<property>
  <name>javax.jdo.option.ConnectionUserName</name>
  <value>hive</value>
  <description>username to use against metastore database</description>
</property>


<property>
  <name>javax.jdo.option.ConnectionPassword</name>
  <value>hive</value>
  <description>password to use against metastore database</description>
</property>


7.拷贝MySQL驱动mysql-connector-java-5.1.30.jar到hive-0.12.0/lib目录中

8.在HDFS中创建/tmp和/user/hive/warehouse并设置权限

[rot@hadoop1 bin]# pwd
/work/hadoop/hadoop-1.0.4/bin
[root@hadoop1 bin]# ./hadoop fs -mkdir /tmp
[root@hadoop1 bin]# ./hadoop fs -mkdir /user/hive/warehouse
[root@hadoop1 bin]# ./hadoop fs -chmod g+w /tmp
[root@hadoop1 bin]# ./hadoop fs -chmod g+w /user/hive/warehouse

9.测试hive
zcf@zcf-K42JZ:~$ hive


Logging initialized using configuration in jar:file:/usr/local/hive-0.12.0/lib/hive-common-0.12.0.jar!/hive-log4j.properties
hive> show tables;
OK
Time taken: 3.578 seconds


安装成功。


三、错误及解决


1.hive> show tables;
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
导致这个错误的原因很多,有必要查看详细错误信息。退出hive,以debug模式启动hive并将信息显示到控制台:hive -hiveconf hive.root.logger=DEBUG,console
发现以上错误是由Caused by: MetaException(message:Version information not found in metastore. )导致的。解决方法将hive-site.xml 里面 hive.metastore.schema.verification 的值改为 false后,就没出现错误了。
2.[Fatal Error] hive-site.xml:2000:16: The element type "value" must be terminated by the matching end-tag "</value>".
14/04/14 19:34:36 FATAL conf.Configuration: error parsing conf file: org.xml.sax.SAXParseException: The element type "value" must be terminated by the matching end-tag "</value>".报错很明显hive-site.xml 2000行有错,查看发现2000行竟是这样的<value>auth</auth>能没错吗,将</auth>改为</value>错误解决。

0 0
原创粉丝点击