Hbase+HDFS单机版配置
来源:互联网 发布:淘宝ctr是什么意思 编辑:程序博客网 时间:2024/04/20 23:34
环境:ubuntu 13.04 ,hadoop-1.2.1+hbase-0.94.11
ubuntu 的/etc/hosts的文档修改如下,避免某些域名被映射成,127.0.1.1。
127.0.0.1 localhost
127.0.0.1 shallon-ThinkPad-X230
127.0.0.1 ubuntu.ubuntu-domain ubuntu
127.0.0.1 shallon-ThinkPad-X230
127.0.0.1 ubuntu.ubuntu-domain ubuntu
1、hadoop的配置
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/conf$ more core-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://shallon-ThinkPad-X230:9000/hbase</value>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/home/hadoop/hadoop-${user.name}</value>
<description>A base for other temporary directories.</description>
</property>
</configuration>
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://shallon-ThinkPad-X230:9000/hbase</value>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/home/hadoop/hadoop-${user.name}</value>
<description>A base for other temporary directories.</description>
</property>
</configuration>
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/conf$ more masters
shallon-ThinkPad-X230
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/conf$ more slaves
shallon-ThinkPad-X230
shallon-ThinkPad-X230
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/conf$ more slaves
shallon-ThinkPad-X230
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/conf$ more hdfs-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
</configuration>
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
</configuration>
启动hadoop的文件HDFS:
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/bin$ ./start-dfs.sh
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/bin$ jps
1493 NameNode
1780 DataNode
2226 SecondaryNameNode
1493 NameNode
1780 DataNode
2226 SecondaryNameNode
尝试访问dfs。
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1$ bin/hadoop dfs -ls /
Found 3 items
drwxr-xr-x - hadoop supergroup 0 2013-09-22 22:05 /hbase
drwxr-xr-x - hadoop supergroup 0 2013-09-22 15:54 /home
drwxr-xr-x - hadoop supergroup 0 2013-08-30 15:18 /user
Found 3 items
drwxr-xr-x - hadoop supergroup 0 2013-09-22 22:05 /hbase
drwxr-xr-x - hadoop supergroup 0 2013-09-22 15:54 /home
drwxr-xr-x - hadoop supergroup 0 2013-08-30 15:18 /user
2、Hbase 配置
hadoop@shallon-ThinkPad-X230:~/hbase-0.94.11/conf$ vi hbase-site.xml
<configuration>
<property>
<name>hbase.rootdir</name>
<value>hdfs://shallon-ThinkPad-X230:9000/hbase</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
</configuration>
<property>
<name>hbase.rootdir</name>
<value>hdfs://shallon-ThinkPad-X230:9000/hbase</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
</configuration>
黑体部分与上面配置的HDFS根路径匹配。指向本地配置的HDFS
hadoop@shallon-ThinkPad-X230:~/hbase-0.94.11/bin$ ./start-hbase.sh
hadoop@localhost's password:
localhost: starting zookeeper, logging to /home/hadoop/hbase-0.94.11/bin/../logs/hbase-hadoop-zookeeper-shallon-ThinkPad-X230.out
starting master, logging to /home/hadoop/hbase-0.94.11/bin/../logs/hbase-hadoop-master-shallon-ThinkPad-X230.out
hadoop@shallon-thinkpad-x230's password:
shallon-ThinkPad-X230: starting regionserver, logging to /home/hadoop/hbase-0.94.11/bin/../logs/hbase-hadoop-regionserver-shallon-ThinkPad-X230.out
hadoop@localhost's password:
localhost: starting zookeeper, logging to /home/hadoop/hbase-0.94.11/bin/../logs/hbase-hadoop-zookeeper-shallon-ThinkPad-X230.out
starting master, logging to /home/hadoop/hbase-0.94.11/bin/../logs/hbase-hadoop-master-shallon-ThinkPad-X230.out
hadoop@shallon-thinkpad-x230's password:
shallon-ThinkPad-X230: starting regionserver, logging to /home/hadoop/hbase-0.94.11/bin/../logs/hbase-hadoop-regionserver-shallon-ThinkPad-X230.out
查看HBase的启动进程
hadoop@shallon-ThinkPad-X230:~/hbase-0.94.11$ jps
1493 NameNode
1780 DataNode
2226 SecondaryNameNode
20273 Jps
14163 HMaster
14081 HQuorumPeer
14655 HRegionServer
1493 NameNode
1780 DataNode
2226 SecondaryNameNode
20273 Jps
14163 HMaster
14081 HQuorumPeer
14655 HRegionServer
查看hbase的master的状态
http://localhost:60010/
Master: localhost:60000
Local logs, Thread Dump, Log Level, Debug dump,
Attributes
使用HBase的创建表和查询数据
hadoop@shallon-ThinkPad-X230:~/hbase-0.94.11/bin$ ./hbase shell
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 0.94.11, r1513697, Wed Aug 14 04:54:46 UTC 2013
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 0.94.11, r1513697, Wed Aug 14 04:54:46 UTC 2013
hbase(main):003:0> create 'test', 'cf'0 row(s) in 1.2200 secondshbase(main):003:0> list 'test'..1 row(s) in 0.0550 secondshbase(main):004:0> put 'test', 'row1', 'cf:a', 'value1'0 row(s) in 0.0560 secondshbase(main):005:0> put 'test', 'row2', 'cf:b', 'value2'0 row(s) in 0.0370 secondshbase(main):006:0> put 'test', 'row3', 'cf:c', 'value3'0 row(s) in 0.0450 seconds
hbase(main):001:0> scan 'test'
ROW COLUMN+CELL
row1 column=cf:a, timestamp=1379858801692, value=value1
row2 column=cf:b, timestamp=1379858810975, value=value2
row3 column=cf:c, timestamp=1379858822233, value=value3
3 row(s) in 1.3100 seconds
ROW COLUMN+CELL
row1 column=cf:a, timestamp=1379858801692, value=value1
row2 column=cf:b, timestamp=1379858810975, value=value2
row3 column=cf:c, timestamp=1379858822233, value=value3
3 row(s) in 1.3100 seconds
查看HBase Root Directory的文件内容
http://localhost:50075/browseDirectory.jsp?dir=/&namenodeInfoPort=50070
Contents of directory /hbase
Goto :
Go to parent directory
NameTypeSizeReplicationBlock SizeModification TimePermissionOwnerGroup-ROOT-dir 2013-09-22 22:02rwxr-xr-xhadoopsupergroup.META.dir 2013-09-22 16:32rwxr-xr-xhadoopsupergroup.corruptdir 2013-09-22 22:02rwxr-xr-xhadoopsupergroup.logsdir 2013-09-23 10:06rwxr-xr-xhadoopsupergroup.oldlogsdir 2013-09-23 10:07rwxr-xr-xhadoopsupergroup.tmpdir 2013-09-23 10:06rwxr-xr-xhadoopsupergrouphbase.idfile0.04 KB364 MB2013-09-22 16:32rw-r--r--hadoopsupergrouphbase.versionfile0 KB364 MB2013-09-22 16:32rw-r--r--hadoopsupergrouptestdir 2013-09-22 22:05rwxr-xr-xhadoop
- Hbase+HDFS单机版配置
- hbase ubuntu 单机版 安装配置
- Hbase 单机版的安装配置
- Hbase单机版配置与使用
- HBase单机配置
- HBase单机配置
- HBase单机模式配置
- Hbase单机安装配置
- HBase正确安装配置单机和分布式【独立zk_quoram和data在hdfs上】
- HDFS单机版安装
- HDFS单机版安装
- Hadoop2.X配置管理1-HDFS安装配置单机版
- hbase单机安装和配置
- 单机配置HBase的心得
- Hbase单机版安装
- HBase 单机版
- Hbase 单机版
- Hbase单机版测试
- jQuery 取值
- MyEclipse6.5代码自动补全
- 注释助手
- 用commons-validator时java.lang.ClassNotFoundException: org.apache.commons.digester.Rule异常原因
- android中Toast显示时间累加问题的解决
- Hbase+HDFS单机版配置
- ORACLE 10g下载|ORACLE 10g下载地址|ORACLE 10g官网下载地址
- Padding Oracle 攻击实例分析(ms10-070)
- vc 7.1中使用valarray时的技巧
- tomcat运行时出现了Failed to start component [StandardEngine[Catalina].StandardHost[localhost]]等错误
- iOS开发学习之Cookie认识
- Base64系列第二篇 python中使用Base64编码解码
- ODTwithODAC 安装说明
- 可用性组Failover切换后,数据库变成read-only的处理