HBase read tuning tip
来源:互联网 发布:软件侵权鉴定报告 编辑:程序博客网 时间:2024/06/05 16:17
Joel ask the following question:
=================
Hi All,
I have an application with two HBase tables.
One table is written to frequently, by a crawler writing web pages.
Another table is written to occasionally (the result of some
processing), but end users read data from this table, and I want the
read response times to be as low as possible.
I only have one server on which to host both tables.
What tuning should I consider to minimise the read latency on the second
table (there will be relatively few users, so throughput is less of a
concern, for the time being) ?
Regards,
Joel
Stack answer it at first
================
Mark the second-table in-memory in the schema. And for the first,
have it not use cache at all. This way, cache should only have
content from the table that is read. Does the second table fit fully
in memory?
Joel reply it again
================
No, the second table is too large to fit in memory.
Lars George answer it at second
================
Hi Joel,
Marking it "in-memory" is *not* making it all stay or be loaded into
memory. It is just a priority flag to retain blocks of that CF
preferably in the block caches. So it caches it up to the max block
cache size. The rest may cause some churn but that is the best you can
do.
Lars
- HBase read tuning tip
- Hbase Performance Tuning - Configuration
- Oracle sequential read disk I/O tuning
- Oracle---Tip for SQL Database tuning and performance
- Tuning Java Garbage Collection for HBase
- HBase Random Read性能测试
- tip
- Tip
- tip
- Tip:
- TIP
- Tip
- tip
- Tip
- Tip
- tip
- [hbase]Increment V.S. Read-Modify-Write in HBase
- Increment V.S. Read-Modify-Write in HBase
- 基于云计算的通讯录产品设计
- 透视Ext JS 4类背后的机制与特点(中)
- 【转】C#路径/文件/目录/I/O常见操作汇总 收藏
- 进入SAP 鞋服行业
- UBUNTU一句话技巧--Linux入门(给新手)
- HBase read tuning tip
- [转]chroot 与 jail
- zoj 1937 || poj 2248 Addition Chains
- 常用SQL
- eclipse 软件的背景颜色、字体设置
- 部分与全部内容的显示收缩功能
- 高分求字符串程序-文件
- memcpy报错
- 页面重构“鑫三无准则” 之“无宽度”准则