HiveServer2配置HA

• 软件环境

  CentOS 6.8

  Hadoop 2.6.0-cdh5.9.0

  Hive 1.1.0-cdh5.9.0

  Zookeeper 3.4.5-cdh5.9.0

• 工作原理

常规连接

HiverServer HA

• 配置Hive HA
  

  前置条件先安装好Hadoop、Zookeeper
  
  vi $HIVE_HOME/conf/hive-site.xml
  
  添加配置如下:

<property><name>hive.server2.support.dynamic.service.discovery</name><value>true</value></property><property><name>hive.server2.zookeeper.namespace</name><value>hiveserver2_zk</value></property><property><name>hive.zookeeper.quorum</name><value>dw1:2181,dw2:2181,dw3:2181</value></property><property><name>hive.zookeeper.client.port</name><value>2181</value></property><property><name>hive.server2.thrift.bind.host</name><value>主机名(强烈建议使用主机名防止IP发生变化)</value></property>

• 启动HiveServer2

  $HIVE_HOME/bin/hiveserver2
  //默认端口为10000

• 检查Zookeeper注册

  登录Zookeeper对应的服务器

  执行zookeeper-client如下：

[zk: localhost:2181(CONNECTED) 0] ls /hiveserver2_zk[serverUri=dw2:10000;version=1.1.0-cdh5.9.0;sequence=0000000006, serverUri=dw1:10000;version=1.1.0-cdh5.9.0;sequence=0000000007][zk: localhost:2181(CONNECTED) 1]

以上表示注册成功

• 连接hiveserver2
  

  连接字符串如下：

$HIVE_HOME/bin/beeline -u "jdbc:hive2://dw1:2181,dw2:2181,dw3:2181/default;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2_zk" hadoop hadoop

连接成功信息如下：

hadoop@dw6:~$ $HIVE_HOME/bin/beeline -u "jdbc:hive2://dw1:2181,dw2:2181,dw3:2181/default;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2_zk" hadoop hadoopscan complete in 1msConnecting to jdbc:hive2://dw1:2181,dw2:2181,dw3:2181/default;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2_zk17/11/30 18:40:52 [main]: INFO jdbc.HiveConnection: Connected to dw1:10000Connected to: Apache Hive (version 1.1.0-cdh5.9.0)Driver: Hive JDBC (version 1.1.0-cdh5.9.0)Transaction isolation: TRANSACTION_REPEATABLE_READBeeline version 1.1.0-cdh5.9.0 by Apache Hive0: jdbc:hive2://dw1:2181,dw2:2181,dw3:2181/de> show tables;+----------------+--+|    tab_name    |+----------------+--+| test_datediff  || web_logs       || web_logs_1     || web_logs_orc   || web_logs_text  |+----------------+--+5 rows selected (0.147 seconds)0: jdbc:hive2://dw1:2181,dw2:2181,dw3:2181/de> 

• 文章参考

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_hadoop-ha/content/ch_HA-Hive.html
http://lxw1234.com/archives/2016/05/675.htm

---