hadoop、hbase、hive、zookeeper版本对应关系
来源:互联网 发布:沈阳seo新浪博客 编辑:程序博客网 时间:2024/05/17 07:56
hive、hbase、zookeeper的关系
Hadoop 与hbase支持版本
S = 支持并且测试,X = 不支持,NT = 应该可以,但是没有测试.
[a] Support for Hadoop 1.x is deprecated.
[b] Hadoop 1.x is NOT supported
[c] HBase requires hadoop 1.0.3 at a minimum; there is an issue where we cannot find KerberosUtil compiling against earlier versions of Hadoop.
[d] To get 0.94.x to run on hadoop 2.2.0, you need to change the hadoop 2 and protobuf versions in the pom.xml: Here is a diff with pom.xml changes:
$ svn diff pom.xml Index: pom.xml =================================================================== --- pom.xml (revision 1545157) +++ pom.xml (working copy) @@ -1034,7 +1034,7 @@ <slf4j.version>1.4.3</slf4j.version> <log4j.version>1.2.16</log4j.version> <mockito-all.version>1.8.5</mockito-all.version> - <protobuf.version>2.4.0a</protobuf.version> + <protobuf.version>2.5.0</protobuf.version> <stax-api.version>1.0.1</stax-api.version> <thrift.version>0.8.0</thrift.version> <zookeeper.version>3.4.5</zookeeper.version> @@ -2241,7 +2241,7 @@ </property> </activation> <properties> - <hadoop.version>2.0.0-alpha</hadoop.version> + <hadoop.version>2.2.0</hadoop.version> <slf4j.version>1.6.1</slf4j.version> </properties> <dependencies>The next step is to regenerate Protobuf files and assuming that the Protobuf has been installed:
Go to the hbase root folder, using the command line;
Type the following commands:
$ protoc -Isrc/main/protobuf --java_out=src/main/java src/main/protobuf/hbase.proto$ protoc -Isrc/main/protobuf --java_out=src/main/java src/main/protobuf/ErrorHandling.proto
Building against the hadoop 2 profile by running something like the following command:
$ mvn clean install assembly:single -Dhadoop.profile=2.0 -DskipTestsBecause HBase depends on Hadoop, it bundles an instance of the Hadoop jar under its lib directory. The bundled jar is ONLY for use in standalone mode. In distributed mode, it is critical that the version of Hadoop that is out on your cluster match what is under HBase. Replace the hadoop jar found in the HBase lib directory with the hadoop jar you are running on your cluster to avoid version mismatch issues. Make sure you replace the jar in HBase everywhere on your cluster. Hadoop version mismatch issues have various manifestations but often all looks like its hung up.
- hadoop、hbase、hive、zookeeper版本对应关系
- hadoop、hbase、hive、zookeeper版本对应关系
- hadoop、hbase、hive、zookeeper版本对应关系
- hadoop、hbase、hive、zookeeper版本对应关系
- hadoop、hbase、hive、zookeeper版本对应关系
- hadoop、hbase、hive、zookeeper版本对应关系
- hadoop、hbase、hive、zookeeper版本对应关系
- hadoop、hbase、hive、zookeeper版本对应关系
- hadoop 、hbase 、hive 版本对应关系
- hadoop、hbase、hive等版本对应关系
- hadoop、hbase、hive版本对应关系
- hbase与zookeeper版本对应关系
- hadoop+zookeeper+hbase+hive
- HADOOP+ZOOKEEPER+HBASE+HIVE
- HADOOP+ZOOKEEPER+HBASE+HIVE
- hadoop,hbase,hive,zookeeper整合可行性分析及版本确定
- hadoop,hbase,hive,zookeeper版本整合兼容性问题总结
- hadoop,hbase,hive,zookeeper版本整合兼容性问题总结
- Google Protocol Buffer 的使用和原理
- 想学JS的原型和闭包吗?COME ON(4)
- 让Nginx支持Lua
- 复杂条件下的随机数
- java NIO(十) 缓冲区——compact方法介绍
- hadoop、hbase、hive、zookeeper版本对应关系
- Activity做子View的ViewPager与外界Activity的的交互通信
- (17) java提高篇 -----抽象类与接口
- struts2标签,OGNL,JSTL'S EL
- QQ 通信协议
- intellij idea 修改背景保护色&&修改字体&&快捷键大全
- 【bzoj 2006】: [NOI2010]超级钢琴
- unity 部分知识小集合
- 设计模式大总结