YCSB 安装 hadoop 2.2.0 + hbase 0.96

来源:互联网 发布:axure linux 编辑:程序博客网 时间:2024/06/07 00:44

YCSB 对 hadoop2.2 与 hbase 0.96 没有一个好的安装教程,多多少少都会有些问题,所以写下这篇文章,希望可以帮上正在安装的你。

  • 用 git 下载 YCSB 到本机系统,若操作系统没有装 git ,可直接安装 ubuntu (sudo apt-get install git)
git clone http://github.com/brianfrankcooper/YCSB.git
  • 安装 maven,wget http://apache.fayea.com/apache-mirror/maven/maven-3/3.1.1/binaries/apache-maven-3.1.1-bin.tar.gz

1).tar -zxvf apache-maven-3.1.1-bin.tar.gz

2).tvi /etc/profile

3).export MAVEN_HOME=/home/hadoop/apache-maven-3.1.1

     export PATH=$JAVA_HOME/bin:$PATH:$MAVEN_HOME/bin

4).source /etc/profile

  • cd YCSB

1).vi YCSB/pom.xml

     <hbase.version>your hbase version</hbase.verion>

2).注释 <module>infinispan</module>

3).vi YCSB/hbase/pom.xml

添加 

<dependency>      <groupid>org.apache.hbase</groupid>      <artifactid>hbase-client</artifactid>      <version>0.96.0-hadoop2</version>    </dependency>    <dependency>      <groupid>org.apache.hadoop</groupid>      <artifactid>hadoop-common</artifactid>      <version>2.2.0</version> </dependency><!-- <dependency>        <groupid>org.apache.hbase</groupid>        <artifactid>hbase</artifactid>        <version>{hbase.version}</version>      </dependency>      <dependency>        <groupid>org.apache.hadoop</groupid>        <artifactid>hadoop-core</artifactid>        <version>1.0.0</version>   </dependency>  -->此段依赖代码注释掉

  • 4.mvn clean package
  • 5.cp distribution/target/ycsb*.gz 
  • 6.解压 tar-zxvf ycsb*gz
  • 7.拷贝 hadoop-auth.-2.2.0jar 至 ycsb/hbase-building/lib 中
  • 8 cp $HBASE_HOME/conf/hbase.site.xml 到 ycsb/hbase-building/conf/ 中
届时安装完成

测试


 hbase(main):004:0> create "usertable","family"
0 row(s) in 0.5800 seconds
~/ycsb-0.1.4/bin/ycsb load hbase -P ~/ycsb-0.1.4/workloads/workloada -p columnfamily=family -p recordcount=10000 -p threadcount=4 -s | tee -a workloada_load.dat
hbase(main):003:0* hbase(main):001:0> count "usertable"
Current count: 2000, row: user2679876345976412335
Current count: 3000, row: user349645708467423033
Current count: 4000, row: user4305432704820238773
Current count: 5000, row: user5172413856130882967
Current count: 6000, row: user5991838079364555435
Current count: 7000, row: user6795182229709704951
Current count: 8000, row: user7643190092256492953
Current count: 9000, row: user8483598885615797937
Current count: 10000, row: user997378877721381023


0 0