Hbase+HDFS单机版配置

来源:互联网 发布:淘宝ctr是什么意思 编辑:程序博客网 时间:2024/04/20 23:34

环境:
ubuntu 13.04 ,hadoop-1.2.1+hbase-0.94.11

ubuntu 的/etc/hosts的文档修改如下,避免某些域名被映射成,127.0.1.1。

127.0.0.1       localhost
127.0.0.1       shallon-ThinkPad-X230
127.0.0.1       ubuntu.ubuntu-domain ubuntu

1、hadoop的配置
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/conf$ more core-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->
<configuration>
     <property>
         <name>fs.default.name</name>
         <value>hdfs://shallon-ThinkPad-X230:9000/hbase</value>
     </property>
<property> 
   <name>hadoop.tmp.dir</name> 
   <value>/home/hadoop/hadoop-${user.name}</value> 
   <description>A base for other temporary directories.</description> 
</property>
</configuration>

hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/conf$ more masters
shallon-ThinkPad-X230
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/conf$ more slaves
shallon-ThinkPad-X230

hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/conf$ more hdfs-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->
<configuration>
     <property>
         <name>dfs.replication</name>
         <value>1</value>
     </property>
</configuration>

启动hadoop的文件HDFS:
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/bin$ ./start-dfs.sh

hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/bin$ jps
1493 NameNode
1780 DataNode
2226 SecondaryNameNode

尝试访问dfs。
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1$ bin/hadoop dfs -ls /
Found 3 items
drwxr-xr-x   - hadoop supergroup          0 2013-09-22 22:05 /hbase
drwxr-xr-x   - hadoop supergroup          0 2013-09-22 15:54 /home
drwxr-xr-x   - hadoop supergroup          0 2013-08-30 15:18 /user

2、Hbase 配置
hadoop@shallon-ThinkPad-X230:~/hbase-0.94.11/conf$ vi hbase-site.xml
<configuration>
<property>
    <name>hbase.rootdir</name>
    <value>hdfs://shallon-ThinkPad-X230:9000/hbase</value>
  </property>
<property>
    <name>hbase.cluster.distributed</name>
    <value>true</value>
  </property>
</configuration>

黑体部分与上面配置的HDFS根路径匹配。指向本地配置的HDFS

hadoop@shallon-ThinkPad-X230:~/hbase-0.94.11/bin$ ./start-hbase.sh
hadoop@localhost's password:
localhost: starting zookeeper, logging to /home/hadoop/hbase-0.94.11/bin/../logs/hbase-hadoop-zookeeper-shallon-ThinkPad-X230.out
starting master, logging to /home/hadoop/hbase-0.94.11/bin/../logs/hbase-hadoop-master-shallon-ThinkPad-X230.out
hadoop@shallon-thinkpad-x230's password:
shallon-ThinkPad-X230: starting regionserver, logging to /home/hadoop/hbase-0.94.11/bin/../logs/hbase-hadoop-regionserver-shallon-ThinkPad-X230.out

查看HBase的启动进程
hadoop@shallon-ThinkPad-X230:~/hbase-0.94.11$ jps
1493 NameNode
1780 DataNode
2226 SecondaryNameNode
20273 Jps
14163 HMaster
14081 HQuorumPeer
14655 HRegionServer


查看hbase的master的状态

http://localhost:60010/

Master: localhost:60000

Local logs, Thread Dump, Log Level, Debug dump,


Attributes

Attribute NameValueDescriptionHBase Version0.94.11, r1513697HBase version and revisionHBase CompiledWed Aug 14 04:54:46 UTC 2013, jenkinsWhen HBase version was compiled and by whomHadoop Version1.0.4, r1393290Hadoop version and revisionHadoop CompiledThu Oct 4 20:40:32 UTC 2012, hortonfoWhen Hadoop version was compiled and by whomHBase Root Directoryhdfs://shallon-ThinkPad-X230:9000/hbaseLocation of HBase home directoryZookeeper Quorumlocalhost:2181Addresses of all registered ZK servers. For more, see zk dump.HMaster Start TimeMon Sep 23 10:06:53 CST 2013Date stamp of when this HMaster was startedHMaster Active TimeMon Sep 23 10:06:53 CST 2013Date stamp of when this HMaster became activeLoad average3Average number of regions per regionserver. Naive computation.HBase Cluster ID4d409e24-108f-41bb-ad32-a49977445601Unique identifier generated for each HBase clusterCoprocessors[]Coprocessors currently loaded loaded by the master

 

使用HBase的创建表和查询数据

hadoop@shallon-ThinkPad-X230:~/hbase-0.94.11/bin$ ./hbase shell
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 0.94.11, r1513697, Wed Aug 14 04:54:46 UTC 2013

hbase(main):003:0> create 'test', 'cf'0 row(s) in 1.2200 secondshbase(main):003:0> list 'test'..1 row(s) in 0.0550 secondshbase(main):004:0> put 'test', 'row1', 'cf:a', 'value1'0 row(s) in 0.0560 secondshbase(main):005:0> put 'test', 'row2', 'cf:b', 'value2'0 row(s) in 0.0370 secondshbase(main):006:0> put 'test', 'row3', 'cf:c', 'value3'0 row(s) in 0.0450 seconds

hbase(main):001:0> scan 'test'
ROW                   COLUMN+CELL                                               
 row1                 column=cf:a, timestamp=1379858801692, value=value1        
 row2                 column=cf:b, timestamp=1379858810975, value=value2        
 row3                 column=cf:c, timestamp=1379858822233, value=value3        
3 row(s) in 1.3100 seconds


查看HBase Root Directory的文件内容

http://localhost:50075/browseDirectory.jsp?dir=/&namenodeInfoPort=50070

Contents of directory /hbase


Goto :
Go to parent directory
NameTypeSizeReplicationBlock SizeModification TimePermissionOwnerGroup-ROOT-dir   2013-09-22 22:02rwxr-xr-xhadoopsupergroup.META.dir   2013-09-22 16:32rwxr-xr-xhadoopsupergroup.corruptdir   2013-09-22 22:02rwxr-xr-xhadoopsupergroup.logsdir   2013-09-23 10:06rwxr-xr-xhadoopsupergroup.oldlogsdir   2013-09-23 10:07rwxr-xr-xhadoopsupergroup.tmpdir   2013-09-23 10:06rwxr-xr-xhadoopsupergrouphbase.idfile0.04 KB364 MB2013-09-22 16:32rw-r--r--hadoopsupergrouphbase.versionfile0 KB364 MB2013-09-22 16:32rw-r--r--hadoopsupergrouptestdir   2013-09-22 22:05rwxr-xr-xhadoop
原创粉丝点击