Big Table

来源:互联网 发布:深圳小额贷款软件 编辑:程序博客网 时间:2024/05/17 01:22

Big Table paper review

Definition:

Bigtable is a distributed storage system for managing structured data that is designed to scale to a very large size

Tablet: Large table broken into tablet at boundary



Background:

Many Google applications such as web indexing, google earth use BigTable to store data.

这些服务无论从数据大小,or latency requirement 都有很大不同


characteristics:

-Simple data model:

dynamic control over data layout and format

-Data is indexed using row and column names

-Bigtable schema parameters let clients dynamically control whether to serve data out of memory or from disk.

-Based on GFS to store data and log files


Components:

-One master server 

-library linked into every client  (client communicate directly with tablet for read&write, 和GFS 原理一样)

-Dynamically added tablet server (Used to store table,each tablet server store ten to a thousand tables)