Glusterfs (ls操作代码处理分析)

来源:互联网 发布:vb中chr(10)是什么意思 编辑:程序博客网 时间:2024/06/05 19:20

使用glusterfs3.3-release版本进行分析,ls命令执行后,抓取trace, 分析glusterfs的代码处理过程,用一台centos6.2虚拟机进行即可,创建卷及挂载过程步骤如下:

1.  官网下载release版本路径如下:http://www.gluster.org,下载后解压,然后我们先打入一个patch,使能glusterfs各个translator调用的trace,patch如下:

--- /root/stack.h       2013-06-13 00:57:40.244154611 -0700
+++ libglusterfs/src/stack.h    2013-06-07 01:10:59.752761043 -0700
@@ -248,6 +248,7 @@
                 }                                                       \
                 UNLOCK(&frame->root->stack_lock);                       \
                 old_THIS = THIS;                                        \
+                gf_log(old_THIS->name, GF_LOG_TRACE, " enter stack");   \
                 THIS = obj;                                             \
                 fn (_new, obj, params);                                 \
                 THIS = old_THIS;                                        \
@@ -287,6 +288,7 @@
                 UNLOCK(&frame->root->stack_lock);                       \
                 fn##_cbk = rfn;                                         \
                 old_THIS = THIS;                                        \
+                gf_log(old_THIS->name, GF_LOG_TRACE, " enter stack cookie");   \
                 THIS = obj;                                             \
                 fn (_new, obj, params);                                 \
                 THIS = old_THIS;                                        \
@@ -311,6 +313,7 @@
                 }                                                       \
                 UNLOCK(&frame->root->stack_lock);                       \
                 old_THIS = THIS;                                        \
+                gf_log(old_THIS->name, GF_LOG_TRACE, " exit stack");    \
                 THIS = _parent->this;                                   \
                 frame->complete = _gf_true;                             \
                 frame->unwind_from = __FUNCTION__;                      \
@@ -338,6 +341,7 @@
                 }                                                       \
                 UNLOCK(&frame->root->stack_lock);                       \
                 old_THIS = THIS;                                        \
+                gf_log(old_THIS->name, GF_LOG_TRACE, " exit stack strict");   \
                 THIS = _parent->this;                                   \
                 frame->complete = _gf_true;                             \
                 frame->unwind_from = __FUNCTION__;                      \

从patch上可以看到,关键之处在STACK_WIND/UNWIND函数调用上加入trace信息,打入patch后,继续执行如下命令安装:

执行./autogen.sh && ./configure --enable-fusermount && make && make install

2. 启动glusterd

/etc/init.d/glusterd start

3.创建两个本地目录

mkdir /root/server-data1 /root/server-data2

4.创建客户端挂载的目录

mkdir /root/client-data

5.创建glusterfs卷(tcp+replictaion卷)

gluster volume create volume-rep replica 2 transport tcp localhost.localdomain:/root/server-data1 localhost.localdomain:/root/server-data2

6.启动卷

gluster volume start volume-rep

7.挂载卷(使用glusterfs-native 客户端协议)

mount -t glusterfs -o log-file=/var/log/gluster.log,log-level=TRACE localhost.localdomain:/volume-rep /root/client-data

[注意:log-level使用TRACE级别,或者默认方式,后面可以执行gluster volume set debug-gluster diagnostics.client-log-level TRACE 动态配置]

此后,我们所做的所有操作,都会记录在gluster.log文件中。

8.进入挂载目录/root/client-data中,执行touch test.txt文件,然后ls 执行后,我们可以打开gluster.log文件分析一下 ls命令在glusterfs文件系统协议中处理的全过程,日志及分析如下:

【注:】

通过下面的详细log分析,我们可以对应到代码函数进行细粒度分析,会发现虽然我们只建立了replication+tcp卷,实际内部默认配置了多个translator,总结如下,客户端translator的路径列举如下

 

fuse(client) -> io-stats(client)->md-cache(client)->quick-read(client)->io-cache(client)->defaults(client)->dht(client)->afr(client)->

rpc-clnt (client) .

P.S.: 后续我们再分析server端的处理路径

 

[2013-06-07 08:52:54.477283] T [fuse-bridge.c:597:fuse_getattr] 0-fuse:  enter stack
[2013-06-07 08:52:54.477309] T [io-stats.c:1855:io_stats_lookup] 0-debug-gluster-rep:  enter stack

[2013-06-07 08:52:54.477328] T [md-cache.c:733:mdc_lookup] 0-debug-gluster-rep-md-cache:  enter stack
[2013-06-07 08:52:54.477341] T [quick-read.c:563:qr_lookup] 0-debug-gluster-rep-quick-read:  enter stack
[2013-06-07 08:52:54.477351] T [io-cache.c:284:ioc_lookup] 0-debug-gluster-rep-io-cache:  enter stack
[2013-06-07 08:52:54.477359] T [defaults.c:1241:default_lookup] 0-debug-gluster-rep-read-ahead:  enter stack
[2013-06-07 08:52:54.477367] T [defaults.c:1241:default_lookup] 0-debug-gluster-rep-write-behind:  enter stack

[2013-06-07 08:52:54.477382] T [dht-common.c:1414:dht_lookup] 0-debug-gluster-rep-dht:  enter stack
[2013-06-07 08:52:54.477408] T [afr-common.c:2187:afr_lookup] 0-debug-gluster-rep-replicate-0:  enter stack cookie
[2013-06-07 08:52:54.477473] T [rpc-clnt.c:1305:rpc_clnt_record] 0-debug-gluster-rep-client-0: Auth Info: pid: 3161, uid: 0, gid: 0, owner: 00000
00000000000
[2013-06-07 08:52:54.477491] T [rpc-clnt.c:1185:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 600, payload: 504, rpc hdr: 96
[2013-06-07 08:52:54.477538] T [rpc-clnt.c:1504:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x94x Program: GlusterFS 3.1, ProgVers: 330,
 Proc: 27) to rpc-transport (debug-gluster-rep-client-0)
[2013-06-07 08:52:54.477556] T [rpc-clnt.c:1305:rpc_clnt_record] 0-debug-gluster-rep-client-0: Auth Info: pid: 0, uid: 0, gid: 0, owner:
[2013-06-07 08:52:54.477567] T [rpc-clnt.c:1185:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 64, payload: 0, rpc hdr: 64
[2013-06-07 08:52:54.477597] T [rpc-clnt.c:1504:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x95x Program: GlusterFS Handshake, ProgVers
: 2, Proc: 3) to rpc-transport (debug-gluster-rep-client-0)

[2013-06-07 08:52:54.477613] T [afr-common.c:2187:afr_lookup] 0-debug-gluster-rep-replicate-0:  enter stack cookie
[2013-06-07 08:52:54.477629] T [rpc-clnt.c:1305:rpc_clnt_record] 0-debug-gluster-rep-client-1: Auth Info: pid: 3161, uid: 0, gid: 0, owner: 00000
00000000000
[2013-06-07 08:52:54.477639] T [rpc-clnt.c:1185:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 600, payload: 504, rpc hdr: 96
[2013-06-07 08:52:54.477701] T [rpc-clnt.c:1504:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x138x Program: GlusterFS 3.1, ProgVers: 330
, Proc: 27) to rpc-transport (debug-gluster-rep-client-1)
[2013-06-07 08:52:54.477718] T [rpc-clnt.c:1305:rpc_clnt_record] 0-debug-gluster-rep-client-1: Auth Info: pid: 0, uid: 0, gid: 0, owner:
[2013-06-07 08:52:54.477729] T [rpc-clnt.c:1185:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 64, payload: 0, rpc hdr: 64
[2013-06-07 08:52:54.477757] T [rpc-clnt.c:1504:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x139x Program: GlusterFS Handshake, ProgVer
s: 2, Proc: 3) to rpc-transport (debug-gluster-rep-client-1)

[2013-06-07 08:52:54.478163] T [rpc-clnt.c:682:rpc_clnt_reply_init] 0-debug-gluster-rep-client-1: received rpc message (RPC XID: 0x139x Program:
GlusterFS Handshake, ProgVers: 2, Proc: 3) from rpc-transport (debug-gluster-rep-client-1)

[2013-06-07 08:52:54.478195] T [rpc-clnt.c:682:rpc_clnt_reply_init] 0-debug-gluster-rep-client-0: received rpc message (RPC XID: 0x95x Program: GlusterFS Handshake, ProgVers: 2, Proc: 3) from rpc-transport (debug-gluster-rep-client-0)
[2013-06-07 08:52:54.478215] T [rpc-clnt.c:682:rpc_clnt_reply_init] 0-debug-gluster-rep-client-1: received rpc message (RPC XID: 0x138x Program: GlusterFS 3.1, ProgVers: 330, Proc: 27) from rpc-transport (debug-gluster-rep-client-1)

[2013-06-07 08:52:54.478271] T [client3_1-fops.c:2657:client3_1_lookup_cbk] 0-debug-gluster-rep-client-1:  exit stack strict
[2013-06-07 08:52:54.478304] T [rpc-clnt.c:682:rpc_clnt_reply_init] 0-debug-gluster-rep-client-0: received rpc message (RPC XID: 0x94x Program: GlusterFS 3.1, ProgVers: 330, Proc: 27) from rpc-transport (debug-gluster-rep-client-0)
[2013-06-07 08:52:54.478333] T [client3_1-fops.c:2657:client3_1_lookup_cbk] 0-debug-gluster-rep-client-0:  exit stack strict

[2013-06-07 08:52:54.478379] D [afr-self-heal-common.c:139:afr_sh_print_pending_matrix] 0-debug-gluster-rep-replicate-0: pending_matrix: [ 0 0 ]
[2013-06-07 08:52:54.478393] D [afr-self-heal-common.c:139:afr_sh_print_pending_matrix] 0-debug-gluster-rep-replicate-0: pending_matrix: [ 0 0 ]

[2013-06-07 08:52:54.478401] D [afr-self-heal-common.c:829:afr_mark_sources] 0-debug-gluster-rep-replicate-0: Number of sources: 0
[2013-06-07 08:52:54.478410] D [afr-self-heal-data.c:871:afr_lookup_select_read_child_by_txn_type] 0-debug-gluster-rep-replicate-0: returning read_child: 1
[2013-06-07 08:52:54.478418] D [afr-common.c:1294:afr_lookup_select_read_child] 0-debug-gluster-rep-replicate-0: Source selected as 1 for /
[2013-06-07 08:52:54.478428] D [afr-common.c:1097:afr_lookup_build_response_params] 0-debug-gluster-rep-replicate-0: Building lookup response from 1
[2013-06-07 08:52:54.478440] T [afr-common.c:1885:afr_lookup_done] 0-debug-gluster-rep-replicate-0:  exit stack strict
[2013-06-07 08:52:54.478456] T [dht-common.c:659:dht_revalidate_cbk] 0-debug-gluster-rep-dht:  exit stack strict

[2013-06-07 08:52:54.478464] T [defaults.c:38:default_lookup_cbk] 0-debug-gluster-rep-write-behind:  exit stack strict
[2013-06-07 08:52:54.478471] T [defaults.c:38:default_lookup_cbk] 0-debug-gluster-rep-read-ahead:  exit stack strict
[2013-06-07 08:52:54.478478] T [io-cache.c:224:ioc_lookup_cbk] 0-debug-gluster-rep-io-cache: locked inode(0x2461140)
[2013-06-07 08:52:54.478485] T [io-cache.c:233:ioc_lookup_cbk] 0-debug-gluster-rep-io-cache: unlocked inode(0x2461140)
[2013-06-07 08:52:54.478492] T [io-cache.c:128:ioc_inode_flush] 0-debug-gluster-rep-io-cache: locked inode(0x2461140)
[2013-06-07 08:52:54.478499] T [io-cache.c:132:ioc_inode_flush] 0-debug-gluster-rep-io-cache: unlocked inode(0x2461140)
[2013-06-07 08:52:54.478505] T [io-cache.c:242:ioc_lookup_cbk] 0-debug-gluster-rep-io-cache: locked table(0x23f11a0)
[2013-06-07 08:52:54.478511] T [io-cache.c:247:ioc_lookup_cbk] 0-debug-gluster-rep-io-cache: unlocked table(0x23f11a0)

[2013-06-07 08:52:54.478519] T [io-cache.c:256:ioc_lookup_cbk] 0-debug-gluster-rep-io-cache:  exit stack strict
[2013-06-07 08:52:54.478526] T [quick-read.c:466:qr_lookup_cbk] 0-debug-gluster-rep-quick-read:  exit stack strict
[2013-06-07 08:52:54.478539] T [md-cache.c:685:mdc_lookup_cbk] 0-debug-gluster-rep-md-cache:  exit stack strict
[2013-06-07 08:52:54.478547] T [io-stats.c:1467:io_stats_lookup_cbk] 0-debug-gluster-rep:  exit stack strict
[2013-06-07 08:52:54.478554] T [fuse-bridge.c:489:fuse_attr_cbk] 0-glusterfs-fuse: 140: LOOKUP() / => 1
[2013-06-07 08:52:54.478691] T [fuse-resolve.c:59:fuse_resolve_loc_touchup] 0-fuse: return value inode_path 1
[2013-06-07 08:52:54.478718] T [fuse-bridge.c:2249:fuse_opendir_resume] 0-glusterfs-fuse: 141: OPENDIR /
[2013-06-07 08:52:54.478883] T [fuse-bridge.c:2252:fuse_opendir_resume] 0-fuse:  enter stack
[2013-06-07 08:52:54.478895] T [io-stats.c:2279:io_stats_opendir] 0-debug-gluster-rep:  enter stack
[2013-06-07 08:52:54.478906] T [defaults.c:914:default_opendir] 0-debug-gluster-rep-md-cache:  enter stack
[2013-06-07 08:52:54.478914] T [defaults.c:914:default_opendir] 0-debug-gluster-rep-quick-read:  enter stack
[2013-06-07 08:52:54.478920] T [defaults.c:914:default_opendir] 0-debug-gluster-rep-io-cache:  enter stack
[2013-06-07 08:52:54.478956] T [defaults.c:914:default_opendir] 0-debug-gluster-rep-read-ahead:  enter stack
[2013-06-07 08:52:54.478963] T [defaults.c:914:default_opendir] 0-debug-gluster-rep-write-behind:  enter stack
[2013-06-07 08:52:54.478972] T [dht-common.c:2741:dht_opendir] 0-debug-gluster-rep-dht:  enter stack
[2013-06-07 08:52:54.478991] T [afr-dir-read.c:329:afr_opendir] 0-debug-gluster-rep-replicate-0:  enter stack cookie
[2013-06-07 08:52:54.479004] T [rpc-clnt.c:1305:rpc_clnt_record] 0-debug-gluster-rep-client-0: Auth Info: pid: 3161, uid: 0, gid: 0, owner: 0000000000000000
[2013-06-07 08:52:54.479014] T [rpc-clnt.c:1185:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 116, payload: 20, rpc hdr: 96
[2013-06-07 08:52:54.479043] T [rpc-clnt.c:1504:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x96x Program: GlusterFS 3.1, ProgVers: 330, Proc: 20) to rpc-transport (debug-gluster-rep-client-0)
[2013-06-07 08:52:54.479055] T [afr-dir-read.c:329:afr_opendir] 0-debug-gluster-rep-replicate-0:  enter stack cookie
[2013-06-07 08:52:54.479066] T [rpc-clnt.c:1305:rpc_clnt_record] 0-debug-gluster-rep-client-1: Auth Info: pid: 3161, uid: 0, gid: 0, owner: 0000000000000000
[2013-06-07 08:52:54.479075] T [rpc-clnt.c:1185:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 116, payload: 20, rpc hdr: 96
[2013-06-07 08:52:54.479125] T [rpc-clnt.c:1504:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x140x Program: GlusterFS 3.1, ProgVers: 330, Proc: 20) to rpc-transport (debug-gluster-rep-client-1)
[2013-06-07 08:52:54.479312] T [rpc-clnt.c:682:rpc_clnt_reply_init] 0-debug-gluster-rep-client-0: received rpc message (RPC XID: 0x96x Program: GlusterFS 3.1, ProgVers: 330, Proc: 20) from rpc-transport (debug-gluster-rep-client-0)
[2013-06-07 08:52:54.479335] T [client3_1-fops.c:2569:client3_1_opendir_cbk] 0-debug-gluster-rep-client-0:  exit stack strict
[2013-06-07 08:52:54.479545] T [rpc-clnt.c:682:rpc_clnt_reply_init] 0-debug-gluster-rep-client-1: received rpc message (RPC XID: 0x140

x Program: GlusterFS 3.1, ProgVers: 330, Proc: 20) from rpc-transport (debug-gluster-rep-client-1)
[2013-06-07 08:52:54.479561] T [client3_1-fops.c:2569:client3_1_opendir_cbk] 0-debug-gluster-rep-client-1:  exit stack strict
[2013-06-07 08:52:54.479570] T [afr-dir-read.c:284:afr_opendir_cbk] 0-debug-gluster-rep-replicate-0:  exit stack strict
[2013-06-07 08:52:54.479578] T [dht-common.c:2571:dht_fd_cbk] 0-debug-gluster-rep-dht:  exit stack strict
[2013-06-07 08:52:54.479585] T [defaults.c:256:default_opendir_cbk] 0-debug-gluster-rep-write-behind:  exit stack strict
[2013-06-07 08:52:54.479592] T [defaults.c:256:default_opendir_cbk] 0-debug-gluster-rep-read-ahead:  exit stack strict
[2013-06-07 08:52:54.479598] T [defaults.c:256:default_opendir_cbk] 0-debug-gluster-rep-io-cache:  exit stack strict
[2013-06-07 08:52:54.479604] T [defaults.c:256:default_opendir_cbk] 0-debug-gluster-rep-quick-read:  exit stack strict
[2013-06-07 08:52:54.479610] T [defaults.c:256:default_opendir_cbk] 0-debug-gluster-rep-md-cache:  exit stack strict
[2013-06-07 08:52:54.479625] T [io-stats.c:1572:io_stats_opendir_cbk] 0-debug-gluster-rep:  exit stack strict
[2013-06-07 08:52:54.479631] T [fuse-bridge.c:689:fuse_fd_cbk] 0-glusterfs-fuse: 141: OPENDIR() / => 0x24471ac
[2013-06-07 08:52:54.479766] T [fuse-bridge.c:2379:fuse_readdir_resume] 0-glusterfs-fuse: 142: READDIR (0x24471ac, size=4096, offset=0)
[2013-06-07 08:52:54.479883] T [fuse-bridge.c:2382:fuse_readdir_resume] 0-fuse:  enter stack
[2013-06-07 08:52:54.479931] T [io-stats.c:2307:io_stats_readdir] 0-debug-gluster-rep:  enter stack
[2013-06-07 08:52:54.479954] T [md-cache.c:1782:mdc_readdir] 0-debug-gluster-rep-md-cache:  enter stack
[2013-06-07 08:52:54.479967] T [defaults.c:1204:default_readdirp] 0-debug-gluster-rep-quick-read:  enter stack
[2013-06-07 08:52:54.479979] T [io-cache.c:1401:ioc_readdirp] 0-debug-gluster-rep-io-cache:  enter stack
[2013-06-07 08:52:54.479991] T [defaults.c:1204:default_readdirp] 0-debug-gluster-rep-read-ahead:  enter stack
[2013-06-07 08:52:54.480002] T [defaults.c:1204:default_readdirp] 0-debug-gluster-rep-write-behind:  enter stack
[2013-06-07 08:52:54.480019] T [dht-common.c:3030:dht_do_readdir] 0-debug-gluster-rep-dht:  enter stack
[2013-06-07 08:52:54.480032] D [afr-common.c:704:afr_get_call_child] 0-debug-gluster-rep-replicate-0: Returning 0, call_child: 1, last_index: -1
[2013-06-07 08:52:54.480044] T [afr-dir-read.c:706:afr_do_readdir] 0-debug-gluster-rep-replicate-0:  enter stack cookie
[2013-06-07 08:52:54.480063] T [rpc-clnt.c:1305:rpc_clnt_record] 0-debug-gluster-rep-client-1: Auth Info: pid: 3161, uid: 0, gid: 0, owner: 0000000000000000
[2013-06-07 08:52:54.480074] T [rpc-clnt.c:1185:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 308, payload: 212, rpc hdr: 96
[2013-06-07 08:52:54.480132] T [rpc-clnt.c:1504:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x141x Program: GlusterFS 3.1, ProgVers: 330, Proc: 40) to rpc-transport (debug-gluster-rep-client-1)
[2013-06-07 08:52:54.480513] T [rpc-clnt.c:682:rpc_clnt_reply_init] 0-debug-gluster-rep-client-1: received rpc message (RPC XID: 0x141x Program: GlusterFS 3.1, ProgVers: 330, Proc: 40) from rpc-transport (debug-gluster-rep-client-1)
[2013-06-07 08:52:54.480541] T [client3_1-fops.c:2354:client3_1_readdirp_cbk] 0-debug-gluster-rep-client-1:  exit stack strict
[2013-06-07 08:52:54.480551] T [afr-dir-read.c:617:afr_readdirp_cbk] 0-debug-gluster-rep-replicate-0:  exit stack strict
[2013-06-07 08:52:54.480561] T [dht-common.c:2868:dht_readdirp_cbk] 0-debug-gluster-rep-dht:  exit stack strict
[2013-06-07 08:52:54.480568] T [defaults.c:431:default_readdirp_cbk] 0-debug-gluster-rep-write-behind:  exit stack strict
[2013-06-07 08:52:54.480575] T [defaults.c:431:default_readdirp_cbk] 0-debug-gluster-rep-read-ahead:  exit stack strict
[2013-06-07 08:52:54.480582] T [io-cache.c:1391:ioc_readdirp_cbk] 0-debug-gluster-rep-io-cache:  exit stack strict
[2013-06-07 08:52:54.480589] T [defaults.c:431:default_readdirp_cbk] 0-debug-gluster-rep-quick-read:  exit stack strict
[2013-06-07 08:52:54.480596] T [md-cache.c:1750:mdc_readdirp_cbk] 0-debug-gluster-rep-md-cache:  exit stack strict
[2013-06-07 08:52:54.480603] T [io-stats.c:1394:io_stats_readdir_cbk] 0-debug-gluster-rep:  exit stack strict
[2013-06-07 08:52:54.480609] T [fuse-bridge.c:2333:fuse_readdir_cbk] 0-glusterfs-fuse: 142: READDIR => 3/4096,0
[2013-06-07 08:52:54.480792] T [fuse-bridge.c:597:fuse_getattr] 0-fuse:  enter stack
[2013-06-07 08:52:54.480805] T [io-stats.c:1855:io_stats_lookup] 0-debug-gluster-rep:  enter stack
[2013-06-07 08:52:54.480816] T [md-cache.c:721:mdc_lookup] 0-debug-gluster-rep-md-cache:  exit stack strict
[2013-06-07 08:52:54.480823] T [io-stats.c:1467:io_stats_lookup_cbk] 0-debug-gluster-rep:  exit stack strict
[2013-06-07 08:52:54.480830] T [fuse-bridge.c:489:fuse_attr_cbk] 0-glusterfs-fuse: 143: LOOKUP() / => 1
[2013-06-07 08:52:54.480864] T [fuse-resolve.c:59:fuse_resolve_loc_touchup] 0-fuse: return value inode_path 4
[2013-06-07 08:52:54.480876] T [fuse-bridge.c:361:fuse_lookup_resume] 0-glusterfs-fuse: 144: LOOKUP /xxx(96a95b49-943c-4058-8d02-8ef0f157316b)
[2013-06-07 08:52:54.480924] T [fuse-bridge.c:374:fuse_lookup_resume] 0-fuse:  enter stack
[2013-06-07 08:52:54.480934] T [io-stats.c:1855:io_stats_lookup] 0-debug-gluster-rep:  enter stack
[2013-06-07 08:52:54.480972] T [md-cache.c:733:mdc_lookup] 0-debug-gluster-rep-md-cache:  enter stack
[2013-06-07 08:52:54.480982] T [quick-read.c:563:qr_lookup] 0-debug-gluster-rep-quick-read:  enter stack
[2013-06-07 08:52:54.480990] T [io-cache.c:284:ioc_lookup] 0-debug-gluster-rep-io-cache:  enter stack
[2013-06-07 08:52:54.480997] T [defaults.c:1241:default_lookup] 0-debug-gluster-rep-read-ahead:  enter stack
[2013-06-07 08:52:54.481003] T [defaults.c:1241:default_lookup] 0-debug-gluster-rep-write-behind:  enter stack
[2013-06-07 08:52:54.481016] T [dht-common.c:1434:dht_lookup] 0-debug-gluster-rep-dht:  enter stack
[2013-06-07 08:52:54.481034] D [afr-common.c:132:afr_lookup_xattr_req_prepare] 0-debug-gluster-rep-replicate-0: /xxx: failed to get the gfid from dict
[2013-06-07 08:52:54.481043] T [afr-common.c:2187:afr_lookup] 0-debug-gluster-rep-replicate-0:  enter stack cookie
[2013-06-07 08:52:54.481060] T [rpc-clnt.c:1305:rpc_clnt_record] 0-debug-gluster-rep-client-0: Auth Info: pid: 3161, uid: 0, gid: 0, owner: 0000000000000000
[2013-06-07 08:52:54.481069] T [rpc-clnt.c:1185:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 444, payload: 348, rpc hdr: 96
[2013-06-07 08:52:54.481101] T [rpc-clnt.c:1504:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x97x Program: GlusterFS 3.1, ProgVers: 330, Proc: 27) to rpc-transport (debug-gluster-rep-client-0)
gVers: 330, Proc: 27) to rpc-transport (debug-gluster-rep-client-0)
[2013-06-07 08:52:54.481115] T [afr-common.c:2187:afr_lookup] 0-debug-gluster-rep-replicate-0:  enter stack cookie
[2013-06-07 08:52:54.481129] T [rpc-clnt.c:1305:rpc_clnt_record] 0-debug-gluster-rep-client-1: Auth Info: pid: 3161, uid: 0, gid: 0, owner: 0000000000000000
[2013-06-07 08:52:54.481138] T [rpc-clnt.c:1185:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 444, payload: 348, rpc hdr: 96
[2013-06-07 08:52:54.481185] T [rpc-clnt.c:1504:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x142x Program: GlusterFS 3.1, ProgVers: 330, Proc: 27) to rpc-transport (debug-gluster-rep-client-1)
[2013-06-07 08:52:54.481361] T [rpc-clnt.c:682:rpc_clnt_reply_init] 0-debug-gluster-rep-client-1: received rpc message (RPC XID: 0x142x Program: GlusterFS 3.1, ProgVers: 330, Proc: 27) from rpc-transport (debug-gluster-rep-client-1)
[2013-06-07 08:52:54.481384] T [client3_1-fops.c:2657:client3_1_lookup_cbk] 0-debug-gluster-rep-client-1:  exit stack strict
[2013-06-07 08:52:54.481405] T [rpc-clnt.c:682:rpc_clnt_reply_init] 0-debug-gluster-rep-client-0: received rpc message (RPC XID: 0x97x Program: GlusterFS 3.1, ProgVers: 330, Proc: 27) from rpc-transport (debug-gluster-rep-client-0)
[2013-06-07 08:52:54.481420] T [client3_1-fops.c:2657:client3_1_lookup_cbk] 0-debug-gluster-rep-client-0:  exit stack strict
[2013-06-07 08:52:54.481433] D [afr-self-heal-common.c:139:afr_sh_print_pending_matrix] 0-debug-gluster-rep-replicate-0: pending_matrix: [ 0 0 ]
[2013-06-07 08:52:54.481469] D [afr-self-heal-common.c:139:afr_sh_print_pending_matrix] 0-debug-gluster-rep-replicate-0: pending_matrix: [ 0 0 ]
[2013-06-07 08:52:54.481484] D [afr-self-heal-common.c:829:afr_mark_sources] 0-debug-gluster-rep-replicate-0: Number of sources: 0
[2013-06-07 08:52:54.488214] D [afr-self-heal-data.c:871:afr_lookup_select_read_child_by_txn_type] 0-debug-gluster-rep-replicate-0: returning read_child: 0
[2013-06-07 08:52:54.488240] D [afr-common.c:1294:afr_lookup_select_read_child] 0-debug-gluster-rep-replicate-0: Source selected as 0 for /xxx
[2013-06-07 08:52:54.488254] D [afr-common.c:1097:afr_lookup_build_response_params] 0-debug-gluster-rep-replicate-0: Building lookup response from 0
[2013-06-07 08:52:54.488272] T [afr-common.c:1885:afr_lookup_done] 0-debug-gluster-rep-replicate-0:  exit stack strict
[2013-06-07 08:52:54.488283] T [dht-common.c:659:dht_revalidate_cbk] 0-debug-gluster-rep-dht:  exit stack strict
[2013-06-07 08:52:54.488291] T [defaults.c:38:default_lookup_cbk] 0-debug-gluster-rep-write-behind:  exit stack strict
[2013-06-07 08:52:54.488298] T [defaults.c:38:default_lookup_cbk] 0-debug-gluster-rep-read-ahead:  exit stack strict
[2013-06-07 08:52:54.488308] T [io-cache.c:224:ioc_lookup_cbk] 0-debug-gluster-rep-io-cache: locked inode(0x2461620)
[2013-06-07 08:52:54.488315] T [io-cache.c:233:ioc_lookup_cbk] 0-debug-gluster-rep-io-cache: unlocked inode(0x2461620)
[2013-06-07 08:52:54.488322] T [io-cache.c:128:ioc_inode_flush] 0-debug-gluster-rep-io-cache: locked inode(0x2461620)
[2013-06-07 08:52:54.488329] T [io-cache.c:132:ioc_inode_flush] 0-debug-gluster-rep-io-cache: unlocked inode(0x2461620)
[2013-06-07 08:52:54.488335] T [io-cache.c:242:ioc_lookup_cbk] 0-debug-gluster-rep-io-cache: locked table(0x23f11a0)
[2013-06-07 08:52:54.488342] T [io-cache.c:247:ioc_lookup_cbk] 0-debug-gluster-rep-io-cache: unlocked table(0x23f11a0)
[2013-06-07 08:52:54.488350] T [io-cache.c:256:ioc_lookup_cbk] 0-debug-gluster-rep-io-cache:  exit stack strict
[2013-06-07 08:52:54.488358] T [quick-read.c:466:qr_lookup_cbk] 0-debug-gluster-rep-quick-read:  exit stack strict
[2013-06-07 08:52:54.488369] T [md-cache.c:685:mdc_lookup_cbk] 0-debug-gluster-rep-md-cache:  exit stack strict
[2013-06-07 08:52:54.488377] T [io-stats.c:1467:io_stats_lookup_cbk] 0-debug-gluster-rep:  exit stack strict
[2013-06-07 08:52:54.488385] T [fuse-bridge.c:246:fuse_entry_cbk] 0-glusterfs-fuse: 144: LOOKUP() /xxx => -8285903198915972757
[2013-06-07 08:52:54.488518] T [fuse-bridge.c:2379:fuse_readdir_resume] 0-glusterfs-fuse: 146: READDIR (0x24471ac, size=4096, offset=2147483647)
[2013-06-07 08:52:54.488621] T [fuse-bridge.c:2382:fuse_readdir_resume] 0-fuse:  enter stack
[2013-06-07 08:52:54.488633] T [io-stats.c:2307:io_stats_readdir] 0-debug-gluster-rep:  enter stack
[2013-06-07 08:52:54.488646] T [md-cache.c:1782:mdc_readdir] 0-debug-gluster-rep-md-cache:  enter stack
[2013-06-07 08:52:54.488654] T [defaults.c:1204:default_readdirp] 0-debug-gluster-rep-quick-read:  enter stack
[2013-06-07 08:52:54.488662] T [io-cache.c:1401:ioc_readdirp] 0-debug-gluster-rep-io-cache:  enter stack
[2013-06-07 08:52:54.488669] T [defaults.c:1204:default_readdirp] 0-debug-gluster-rep-read-ahead:  enter stack
[2013-06-07 08:52:54.488675] T [defaults.c:1204:default_readdirp] 0-debug-gluster-rep-write-behind:  enter stack
[2013-06-07 08:52:54.488687] T [dht-common.c:3030:dht_do_readdir] 0-debug-gluster-rep-dht:  enter stack
[2013-06-07 08:52:54.488697] D [afr-common.c:704:afr_get_call_child] 0-debug-gluster-rep-replicate-0: Returning 0, call_child: 1, last_index: -1
[2013-06-07 08:52:54.488705] T [afr-dir-read.c:706:afr_do_readdir] 0-debug-gluster-rep-replicate-0:  enter stack cookie
[2013-06-07 08:52:54.488728] T [rpc-clnt.c:1305:rpc_clnt_record] 0-debug-gluster-rep-client-1: Auth Info: pid: 3161, uid: 0, gid: 0, owner: 0000000000000000
[2013-06-07 08:52:54.488741] T [rpc-clnt.c:1185:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 308, payload: 212, rpc hdr: 96
[2013-06-07 08:52:54.488799] T [rpc-clnt.c:1504:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x143x Program: GlusterFS 3.1, ProgVers: 330, Proc: 40) to rpc-transport (debug-gluster-rep-client-1)
[2013-06-07 08:52:54.492752] T [rpc-clnt.c:682:rpc_clnt_reply_init] 0-debug-gluster-rep-client-1: received rpc message (RPC XID: 0x143x Program: GlusterFS 3.1, ProgVers: 330, Proc: 40) from rpc-transport (debug-gluster-rep-client-1)
[2013-06-07 08:52:54.492784] T [client3_1-fops.c:2354:client3_1_readdirp_cbk] 0-debug-gluster-rep-client-1:  exit stack strict
[2013-06-07 08:52:54.492797] T [afr-dir-read.c:617:afr_readdirp_cbk] 0-debug-gluster-rep-replicate-0:  exit stack strict
[2013-06-07 08:52:54.492811] T [dht-common.c:2868:dht_readdirp_cbk] 0-debug-gluster-rep-dht:  exit stack strict
[2013-06-07 08:52:54.492822] T [defaults.c:431:default_readdirp_cbk] 0-debug-gluster-rep-write-behind:  exit stack strict
[2013-06-07 08:52:54.492832] T [defaults.c:431:default_readdirp_cbk] 0-debug-gluster-rep-read-ahead:  exit stack strict
[2013-06-07 08:52:54.492842] T [io-cache.c:1391:ioc_readdirp_cbk] 0-debug-gluster-rep-io-cache:  exit stack strict
[2013-06-07 08:52:54.492852] T [defaults.c:431:default_readdirp_cbk] 0-debug-gluster-rep-quick-read:  exit stack strict
[2013-06-07 08:52:54.492861] T [md-cache.c:1750:mdc_readdirp_cbk] 0-debug-gluster-rep-md-cache:  exit stack strict
[2013-06-07 08:52:54.492871] T [io-stats.c:1394:io_stats_readdir_cbk] 0-debug-gluster-rep:  exit stack strict
[2013-06-07 08:52:54.492881] T [fuse-bridge.c:2333:fuse_readdir_cbk] 0-glusterfs-fuse: 146: READDIR => 0/4096,2147483647
[2013-06-07 08:52:54.492950] T [fuse-bridge.c:2423:fuse_releasedir] 0-glusterfs-fuse: 147: RELEASEDIR 0x24471ac
[2013-06-07 08:52:54.492969] D [client3_1-fops.c:2801:client_fdctx_destroy] 0-debug-gluster-rep-client-0: sending releasedir on fd
[2013-06-07 08:52:54.492987] T [rpc-clnt.c:1305:rpc_clnt_record] 0-debug-gluster-rep-client-0: Auth Info: pid: 0, uid: 0, gid: 0, owner:
[2013-06-07 08:52:54.493001] T [rpc-clnt.c:1185:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 92, payload: 28, rpc hdr: 64
[2013-06-07 08:52:54.493134] T [rpc-clnt.c:1504:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x98x Program: GlusterFS 3.1, ProgVers: 330, Proc: 42) to rpc-transport (debug-gluster-rep-client-0)
[2013-06-07 08:52:54.493161] D [client3_1-fops.c:2801:client_fdctx_destroy] 0-debug-gluster-rep-client-1: sending releasedir on fd
[2013-06-07 08:52:54.493177] T [rpc-clnt.c:1305:rpc_clnt_record] 0-debug-gluster-rep-client-1: Auth Info: pid: 0, uid: 0, gid: 0, owner:
[2013-06-07 08:52:54.493191] T [rpc-clnt.c:1185:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 92, payload: 28, rpc hdr: 64
[2013-06-07 08:52:54.493228] T [rpc-clnt.c:1504:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x144x Program: GlusterFS 3.1, ProgVers: 330, Proc: 42) to rpc-transport (debug-gluster-rep-client-1)
[2013-06-07 08:52:54.493289] T [rpc-clnt.c:682:rpc_clnt_reply_init] 0-debug-gluster-rep-client-0: received rpc message (RPC XID: 0x98x Program: GlusterFS 3.1, ProgVers: 330, Proc: 42) from rpc-transport (debug-gluster-rep-client-0)
[2013-06-07 08:52:54.493372] T [rpc-clnt.c:682:rpc_clnt_reply_init] 0-debug-gluster-rep-client-1: received rpc message (RPC XID: 0x144x Program: GlusterFS 3.1, ProgVers: 330, Proc: 42) from rpc-transport (debug-gluster-rep-client-1)

 

 

原创粉丝点击