hadoop、hbase、hive、zookeeper版本对应关系
来源:互联网 发布:王者荣耀开发语言知乎 编辑:程序博客网 时间:2024/05/16 14:23
hadoop、hbase、hive、zookeeper版本对应关系
下载:http://archive.apache.org/dist/hive/
转:http://www.aboutyun.com/blog-61-62.html
hadoop、hbase、hive、zookeeper版本对应关系续
Hadoop 1.x.y, 2.x.y
hive版本 1.0.0支持hadoop版本
Hadoop 1.x.y, 2.x.y
hive、hbase、zookeeper的关系
Hadoop 与hbase支持版本
[a] Support for Hadoop 1.x is deprecated.
[b] Hadoop 1.x is NOT supported
[c] HBase requires hadoop 1.0.3 at a minimum; there is an issue where we cannot find KerberosUtil compiling against earlier versions of Hadoop.
[d] To get 0.94.x to run on hadoop 2.2.0, you need to change the hadoop 2 and protobuf versions in the pom.xml: Here is a diff with pom.xml changes:
$ svn diff pom.xml Index: pom.xml =================================================================== --- pom.xml (revision 1545157) +++ pom.xml (working copy) @@ -1034,7 +1034,7 @@ <slf4j.version>1.4.3</slf4j.version> <log4j.version>1.2.16</log4j.version> <mockito-all.version>1.8.5</mockito-all.version> - <protobuf.version>2.4.0a</protobuf.version> + <protobuf.version>2.5.0</protobuf.version> <stax-api.version>1.0.1</stax-api.version> <thrift.version>0.8.0</thrift.version> <zookeeper.version>3.4.5</zookeeper.version> @@ -2241,7 +2241,7 @@ </property> </activation> <properties> - <hadoop.version>2.0.0-alpha</hadoop.version> + <hadoop.version>2.2.0</hadoop.version> <slf4j.version>1.6.1</slf4j.version> </properties> <dependencies>The next step is to regenerate Protobuf files and assuming that the Protobuf has been installed:
Go to the hbase root folder, using the command line;
Type the following commands:
$ protoc -Isrc/main/protobuf --java_out=src/main/java src/main/protobuf/hbase.proto$ protoc -Isrc/main/protobuf --java_out=src/main/java src/main/protobuf/ErrorHandling.proto
Building against the hadoop 2 profile by running something like the following command:
$ mvn clean install assembly:single -Dhadoop.profile=2.0 -DskipTestsBecause HBase depends on Hadoop, it bundles an instance of the Hadoop jar under its lib directory. The bundled jar is ONLY for use in standalone mode. In distributed mode, it is critical that the version of Hadoop that is out on your cluster match what is under HBase. Replace the hadoop jar found in the HBase lib directory with the hadoop jar you are running on your cluster to avoid version mismatch issues. Make sure you replace the jar in HBase everywhere on your cluster. Hadoop version mismatch issues have various manifestations but often all looks like its hung up.
更新内容:
Hadoop version support matrix
· "S" = supported
· "X" = not supported
· "NT" = Not tested
HBase-0.92.x
HBase-0.94.x
HBase-0.96.x
HBase-0.98.x (Support for Hadoop 1.1+ is deprecated.)
HBase-1.0.x (Hadoop 1.x is NOT supported)
Hadoop-0.20.205
S
X
X
X
X
Hadoop-0.22.x
S
X
X
X
X
Hadoop-1.0.x
X
X
X
X
X
Hadoop-1.1.x
NT
S
S
NT
X
Hadoop-0.23.x
X
S
NT
X
X
Hadoop-2.0.x-alpha
X
NT
X
X
X
Hadoop-2.1.0-beta
X
NT
S
X
X
Hadoop-2.2.0
X
NT
S
S
NT
Hadoop-2.3.x
X
NT
S
S
NT
Hadoop-2.4.x
X
NT
S
S
S
Hadoop-2.5.x
X
NT
S
S
S
- hadoop、hbase、hive、zookeeper版本对应关系
- hadoop、hbase、hive、zookeeper版本对应关系
- hadoop、hbase、hive、zookeeper版本对应关系
- hadoop、hbase、hive、zookeeper版本对应关系
- hadoop、hbase、hive、zookeeper版本对应关系
- hadoop、hbase、hive、zookeeper版本对应关系
- hadoop、hbase、hive、zookeeper版本对应关系
- hadoop、hbase、hive、zookeeper版本对应关系
- hadoop 、hbase 、hive 版本对应关系
- hadoop、hbase、hive等版本对应关系
- hadoop、hbase、hive版本对应关系
- hbase与zookeeper版本对应关系
- hadoop+zookeeper+hbase+hive
- HADOOP+ZOOKEEPER+HBASE+HIVE
- HADOOP+ZOOKEEPER+HBASE+HIVE
- hadoop,hbase,hive,zookeeper整合可行性分析及版本确定
- hadoop,hbase,hive,zookeeper版本整合兼容性问题总结
- hadoop,hbase,hive,zookeeper版本整合兼容性问题总结
- chapter2 理解消息中间件和JMS
- Android 四大组件详解(一) Activity
- Java中测试异常的多种方式
- Java中this调用重载构造函数
- FTPS VS SFTP
- hadoop、hbase、hive、zookeeper版本对应关系
- Java 获取当前线程的相关信息
- 如何修改Android设备的开机第一阶段Logo
- 集合初探(五)
- C++Primer第五版 12.1.4节练习
- C语言中static变量详解
- 友盟分享单个平台时的调用方法
- Java泛型详解
- replace into的用法