python 通过thrift 简单操作hbase
来源:互联网 发布:java语言开发游戏 编辑:程序博客网 时间:2024/05/19 19:14
thrift 是facebook开发并开源的一个二进制通讯中间件,通过thrift,我们可以充分利用各个语言的优势,编写高效的代码。
关于thrift的论文:http://pan.baidu.com/share/link?shareid=234128&uk=3238841275
安装thrift:http://thrift.apache.org/docs/install/ubuntu/
安装完成后到hbase的目录下,找到Hbase.thrift,该文件在
hbase-0.94.4/src/main/resources/org/apache/hadoop/hbase/thrift下可以找到
thrift --gen python hbase.thrift 会生成gen-py文件夹,将其修改成hbase
安装python的thrift库
sudo pip install thrift
启动hbase的thrift服务:bin/hbase-daemon.sh start thrift 默认端口是9090
创建hbase表:
1 from thrift import Thrift 2 from thrift.transport import TSocket 3 from thrift.transport import TTransport 4 from thrift.protocol import TBinaryProtocol 5 6 from hbase import Hbase 7 from hbase.ttypes import * 8 9 transport = TSocket.TSocket('localhost', 9090);10 11 transport = TTransport.TBufferedTransport(transport)12 13 protocol = TBinaryProtocol.TBinaryProtocol(transport);14 15 client = Hbase.Client(protocol)16 transport.open()17 18 19 contents = ColumnDescriptor(name='cf:', maxVersions=1)20 client.createTable('test', [contents])21 22 print client.getTableNames()
执行代码,成功后,进入hbase的shell,用命令list可以看到刚刚的test表已经创建成功。
插入数据:
1 from thrift import Thrift 2 from thrift.transport import TSocket 3 from thrift.transport import TTransport 4 from thrift.protocol import TBinaryProtocol 5 6 from hbase import Hbase 7 8 from hbase.ttypes import * 9 10 transport = TSocket.TSocket('localhost', 9090)11 12 transport = TTransport.TBufferedTransport(transport)13 14 protocol = TBinaryProtocol.TBinaryProtocol(transport)15 16 client = Hbase.Client(protocol)17 18 transport.open()19 20 row = 'row-key1'21 22 mutations = [Mutation(column="cf:a", value="1")]23 client.mutateRow('test', row, mutations, None)
插入成功,通过scan命令查看插入结果:
获取一行数据:
1 from thrift import Thrift 2 from thrift.transport import TSocket 3 from thrift.transport import TTransport 4 from thrift.protocol import TBinaryProtocol 5 6 from hbase import Hbase 7 from hbase.ttypes import * 8 9 transport = TSocket.TSocket('localhost', 9090)10 transport = TTransport.TBufferedTransport(transport)11 12 protocol = TBinaryProtocol.TBinaryProtocol(transport)13 14 client = Hbase.Client(protocol)15 16 transport.open()17 18 tableName = 'test'19 rowKey = 'row-key1'20 21 result = client.getRow(tableName, rowKey, None)22 print result23 for r in result:24 print 'the row is ' , r.row25 print 'the values is ' , r.columns.get('cf:a').value
getRow返回的是TResult列表,结果如下:
返回多行则需要使用scan:
1 from thrift import Thrift 2 from thrift.transport import TSocket 3 from thrift.transport import TTransport 4 from thrift.protocol import TBinaryProtocol 5 6 from hbase import Hbase 7 from hbase.ttypes import * 8 9 transport = TSocket.TSocket('localhost', 9090)10 transport = TTransport.TBufferedTransport(transport)11 12 protocol = TBinaryProtocol.TBinaryProtocol(transport)13 14 client = Hbase.Client(protocol)15 transport.open()16 17 scan = TScan()18 tableName = 'test'19 id = client.scannerOpenWithScan(tableName, scan, None)20 21 result2 = client.scannerGetList(id, 10)22 23 print result2
scannerGetList会取10条数据,然后输出结果
scannerGet则是每次只取一行数据:
1 from thrift import Thrift 2 from thrift.transport import TSocket 3 from thrift.transport import TTransport 4 from thrift.protocol import TBinaryProtocol 5 6 from hbase import Hbase 7 from hbase.ttypes import * 8 9 transport = TSocket.TSocket('localhost', 9090)10 transport = TTransport.TBufferedTransport(transport)11 12 protocol = TBinaryProtocol.TBinaryProtocol(transport)13 14 client = Hbase.Client(protocol)15 transport.open()16 17 scan = TScan()18 tableName = 'test'19 id = client.scannerOpenWithScan(tableName, scan, None)20 result = client.scannerGet(id)21 while result:22 print result23 result = client.scannerGet(id)
输出结果:
- python 通过thrift 简单操作hbase
- python 通过thrift 简单操作hbase
- python通过thrift操作hbase
- 使用Python语言通过Thrift 网关操作HBase
- python是通过thrift来操作hbase的示例程序
- PHP通过Thrift操作Hbase
- PHP通过Thrift操作Hbase
- php通过thrift操作hbase
- PHP通过Thrift操作Hbase
- PHP操作HBASE(通过thrift)
- php通过thrift操作hbase
- php通过thrift操作hbase
- PHP通过Thrift操作Hbase
- python通过thrift连接Hbase
- C#通过thrift连接hbase操作步骤
- 使用C++(通过Thrift) 操作Hbase
- php通过thrift 0.9.0操作HBase
- C# 通过Thrift 1 操作 HBase
- java数据结构_笔记(5)_图的算法续
- PHP中redis 的安装和使用
- 正确计算linux系统内存使用率
- 程序多开源理
- JS计算日期相减天数
- python 通过thrift 简单操作hbase
- common-IO.jar相关
- 数据结构与算法书籍推荐
- dialog.dismiss()
- Android 权限申请
- 【文件】FAT文件系统分析
- 关于javascript中apply()和call()方法的区别
- 学用 html5 canvas 与 javascript 开发画图程序
- android中一种欢迎界面模式