pgfincore introduces

来源:互联网 发布:毕向东java基础视频 编辑:程序博客网 时间:2024/05/29 16:24

pgfincore 和shared buffer不同,是OS层面的缓存,可以把大对象缓存到OS的cache里,其实就是内存,所以机器的内存配置越大越好,至于oracle是缓存到buffer_pool_keep,可以手工刷出,不过这个是database的缓存,和pg的shared buffer同理。这里就不再详细介绍。

1.下载wget http://pgfoundry.org/frs/download.php/3186/pgfincore-v1.1.1.tar.gz

2.解压下载的安装包tar -zxvf pgfincore-v1.1.1.tar.gz

3.复制解压后的目录到pg源代码目录/contrib

4.安装:

postgres用户:

make clean
make

su - root

source /home/postgres/.bash_profile

make install

根据READ.rst

For PostgreSQL >= 9.1, log in your database and::

  mydb=# CREATE EXTENSION pgfincore;

For other release, create the functions from the sql script (it should be in
your contrib directory)::

  psql mydb -f pgfincore.sql

 

postgres=# select version();
                                                    version                                                    
---------------------------------------------------------------------------------------------------------------
 PostgreSQL 9.1.2 on x86_64-unknown-linux-gnu, compiled by gcc (GCC) 4.1.2 20071124 (Red Hat 4.1.2-42), 64-bit

postgres=# CREATE EXTENSION pgfincore;
CREATE EXTENSION

postgres=# select * from pg_extension ;
    extname     | extowner | extnamespace | extrelocatable | extversion | extconfig | extcondition 
----------------+----------+--------------+----------------+------------+-----------+--------------
 plpgsql        |       10 |           11 | f              | 1.0        |           | 
 pg_buffercache |       10 |         2200 | t              | 1.0        |           | 
 pgfincore      |       10 |         2200 | t              | 1.1.1      |           |

pgfincore使用:

pgfincore 对象的cache情况

pgfadvise_willneed 将对象刷入cache

pgfadvise_dontneed 将对象刷出cache

pgfadvise_loader 直接和page cache交互,加载,卸载页面

pgsysconf 操作系统的cache情况

pgsysconf_pretty同上,只不过输更易懂,带上了单位。

 

postgres=# \d t
                         Table "public.t"
 Column |  Type   |                   Modifiers                   
--------+---------+-----------------------------------------------
 s      | integer | not null default nextval('t_s_seq'::regclass)
 i      | integer | 
 postgres=# insert into t(i) values (generate_series(1,10000000));
INSERT 0 10000000
postgres=#  select pg_size_pretty(pg_relation_size('t'));
 pg_size_pretty 
----------------
 346 MB

当前文件系统的使用情况:pgsysconf(),pgsysconf_pretty()
 postgres=#  select * from pgsysconf();
 os_page_size | os_pages_free | os_total_pages 
--------------+---------------+----------------
         4096 |        182787 |        2044328

postgres=# select * from pgsysconf_pretty();
 os_page_size | os_pages_free | os_total_pages 
--------------+---------------+----------------
 4096 bytes   | 721 MB        | 7986 MB
(1 row)

表t的使用情况:pgfincore

postgres=#  select * from pgfincore('t');
     relpath      | segment | os_page_size | rel_os_pages | pages_mem | group_mem | os_pages_free | databit 
------------------+---------+--------------+--------------+-----------+-----------+---------------+---------
 base/12699/16441 |       0 |         4096 |        88496 |     88496 |         1 |        181767 |

os_page_size:文件系统页大小

rel_os_pages:占用文件系统页数量

pages_mem:有多少文件系统页在系统cache

 

刷入cache:pgfadvise_willneed()

postgres=# select * from pgfadvise_willneed('t');
     relpath      | os_page_size | rel_os_pages | os_pages_free 
------------------+--------------+--------------+---------------
 base/12699/16441 |         4096 |        88496 |        186428
(1 row)

postgres=#  select * from pgfincore('t');
     relpath      | segment | os_page_size | rel_os_pages | pages_mem | group_mem | os_pages_free | databit 
------------------+---------+--------------+--------------+-----------+-----------+---------------+---------
 base/12699/16441 |       0 |         4096 |        88496 |     88496 |         1 |        186397 | 
(1 row)

 

 刷出cache:    
postgres=# select * from pgfadvise_dontneed('t');
     relpath      | os_page_size | rel_os_pages | os_pages_free 
------------------+--------------+--------------+---------------
 base/12699/16441 |         4096 |        88496 |        275021
(1 row)

postgres=# select * from pgfincore('t');
     relpath      | segment | os_page_size | rel_os_pages | pages_mem | group_mem | os_pages_free | databit 
------------------+---------+--------------+--------------+-----------+-----------+---------------+---------
 base/12699/16441 |       0 |         4096 |        88496 |         0 |         0 |        275052 | 
(1 row)

 

pgfadvise_loader:

postgres=# select * from pgfadvise_loader('t', 0, true, true, B'111000');
     relpath      | os_page_size | os_pages_free | pages_loaded | pages_unloaded 
------------------+--------------+---------------+--------------+----------------
 base/12699/16441 |         4096 |        186626 |            3 |              3
(1 row)

loading:

postgres=# select * from pgfadvise_loader('t', 0, true, false, B'111000');
     relpath      | os_page_size | os_pages_free | pages_loaded | pages_unloaded 
------------------+--------------+---------------+--------------+----------------
 base/12699/16441 |         4096 |        186460 |            3 |              0
(1 row)

unloading:

postgres=# select * from pgfadvise_loader('t', 0, false, true, B'111000');
     relpath      | os_page_size | os_pages_free | pages_loaded | pages_unloaded 
------------------+--------------+---------------+--------------+----------------
 base/12699/16441 |         4096 |        186557 |            0 |              3
(1 row)

pgfadvise_NORMAL
pgfadvise_SEQUENTIAL
pgfadvise_RANDOM

这几个可以指定当前内存的属性,正常,顺序,还是随机。

快照与恢复:

做快照:

create table pgfincore_snapshot as
select 't'::text as relname,*,now() as date_snapshot
from pgfincore('t',true);

应用快照:

select * from pgfadvise_loader('t', 0, true, true,
                          (select databit from  pgfincore_snapshot
                           where relname='t' and segment = 0));

     relpath      | os_page_size | os_pages_free | pages_loaded | pages_unloaded 
------------------+--------------+---------------+--------------+----------------
 base/12699/16441 |         4096 |        186259 |        88490 |              6
(1 row)

postgres=#  select * from pgfincore('t');
     relpath      | segment | os_page_size | rel_os_pages | pages_mem | group_mem | os_pages_free | databit 
------------------+---------+--------------+--------------+-----------+-----------+---------------+---------
 base/12699/16441 |       0 |         4096 |        88496 |     88490 |         2 |        186097 | 
(1 row)

可以看到 88496 和88490,有几个页面是刷出cache,所以不相等

select * from pgfadvise_willneed('t');

postgres=# select * from pgfincore('t');
     relpath      | segment | os_page_size | rel_os_pages | pages_mem | group_mem | os_pages_free | databit 
------------------+---------+--------------+--------------+-----------+-----------+---------------+---------
 base/12699/16441 |       0 |         4096 |        88496 |     88496 |         1 |        186227 | 
(1 row)


限制:
*PgFincore needs mincore() and POSIX_FADVISE.

*PgFincore has a limited mode when POSIX_FADVISE is not provided by the platform.

*PgFincore needs PostgreSQL >= 8.3

原创粉丝点击