Flume的安装和测试

来源：互联网发布：淘宝如何打印发货单编辑：程序博客网时间：2024/06/12 20:22

Flume的安装和测试

标签： flume流处理

2016-11-02 00:53 246人阅读评论(0)收藏举报

本文章已收录于：

分类：

kafka（8）

作者同类文章X

Flume原理、安装和使用
1.flume是分布式的日志收集系统，把收集来的数据传送到目的地去。
2.flume里面有个核心概念，叫做agent。agent是一个Java进程，运行在日志收集节点。
3.agent里面包含3个核心组件：source、channel、sink。
3.1 source组件是专用于收集日志的，可以处理各种类型各种格式的日志数据,包括avro、thrift、exec、jms、spooling directory、netcat、sequence generator、syslog、http、legacy、自定义。
source组件把数据收集来以后，临时存放在channel中。
3.2 channel组件是在agent中专用于临时存储数据的，可以存放在memory、jdbc、file、自定义。
channel中的数据只有在sink发送成功之后才会被删除。
3.3 sink组件是用于把数据发送到目的地的组件，目的地包括hdfs、logger、avro、thrift、ipc、file、null、Hbase、solr、自定义。
4.在整个数据传输过程中，流动的是event。事务保证是在event级别。
5.flume可以支持多级flume的agent，支持扇入(fan-in)、扇出(fan-out)。

安装
1、先解压

[root@slave2 ~]# tar -xvf apache-flume-1.7.0-bin.tar -C /opt/1
1

2、修改配置文件

[root@slave2 apache-flume-1.7.0-bin]# cd conf/[root@slave2 conf]# lsflume-conf.properties.template  flume-env.ps1.template  flume-env.sh.template  log4j.properties[root@slave2 conf]# lltotal 16-rw-r--r--. 1 root root 1661 Sep 26 06:49 flume-conf.properties.template-rw-r--r--. 1 root root 1455 Sep 26 06:49 flume-env.ps1.template-rw-r--r--. 1 root root 1565 Sep 26 06:49 flume-env.sh.template-rw-r--r--. 1 root root 3107 Sep 26 06:49 log4j.properties[root@slave2 conf]# cp flume-env.sh.template flume-env.sh[root@slave2 conf]# cp flume-conf.properties.template  flume-conf.properties1
2
3
4
5
6
7
8
9
10
11
1
2
3
4
5
6
7
8
9
10
11

3、修改系统配置文件
在/etc/profile增加

export FLUME_HOME=/opt/apache-flume-1.7.0-binexport FLUME_CONF=$FLUME_HOME/confexport PATH=$PATH:$FLUME_HOME/bin1
2
3
1
2
3

4、修改JAVA_HOME和JAVA_OPTS

[root@slave2 conf]# vim flume-env.sh# Licensed to the Apache Software Foundation (ASF) under one# or more contributor license agreements.  See the NOTICE file# distributed with this work for additional information# regarding copyright ownership.  The ASF licenses this file# to you under the Apache License, Version 2.0 (the# "License"); you may not use this file except in compliance# with the License.  You may obtain a copy of the License at##     http://www.apache.org/licenses/LICENSE-2.0## Unless required by applicable law or agreed to in writing, software# distributed under the License is distributed on an "AS IS" BASIS,# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.# See the License for the specific language governing permissions and# limitations under the License.# If this file is placed at FLUME_CONF_DIR/flume-env.sh, it will be sourced# during Flume startup.# Enviroment variables can be set here. export JAVA_HOME=/usr/local/java/java7# Give Flume more memory and pre-allocate, enable remote monitoring via JMX export JAVA_OPTS="-Xms100m -Xmx200m -Dcom.sun.management.jmxremote"# Let Flume write raw event data and configuration information to its log files for debugging# purposes. Enabling these flags is not recommended in production,# as it may result in logging sensitive user information or encryption secrets.# export JAVA_OPTS="$JAVA_OPTS -Dorg.apache.flume.log.rawdata=true -Dorg.apache.flume.log.printconfig=true "# Note that the Flume conf directory is always included in the classpath.#FLUME_CLASSPATH=""1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35

5、创建一个配置文件

[root@slave2 conf]# vim flume_conf.conf a1.sources.r1.type = netcata1.sources.r1.bind = slave2a1.sources.r1.port = 44444# example.conf: A single-node Flume configuration# Name the components on this agenta1.sources = r1a1.sinks = k1a1.channels = c1# Describe/configure the sourcea1.sources.r1.type = exec  a1.sources.r1.command = tail -F /root/flume/log_exec_tail# Describe the sinka1.sinks.k1.type = logger# Use a channel which buffers events in memorya1.channels.c1.type = memorya1.channels.c1.capacity = 1000a1.channels.c1.transactionCapacity = 100# Bind the source and sink to the channela1.sources.r1.channels = c1a1.sinks.k1.channel = c11
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26

6、启动flume-ng

[root@slave2 apache-flume-1.7.0-bin]# ./flume-ng agent --conf ./conf --conf-file ../conf/flume_conf.conf --name a1 -Dflume.root.logger=INFO,console1
1

7、另起终端往文件里面追加内容

[root@slave2 flume]# for i in {1..100}> do> echo "exec tail$i">> log_exec_tail> done[root@slave2 flume]# 1
2
3
4
5
1
2
3
4
5

8、查看服务上面打印的日志信息
16/11/01 09:35:50 INFO node.Application: Starting Channel c1
16/11/01 09:35:51 INFO instrumentation.MonitoredCounterGroup: Monitored counter group for type: CHANNEL, name: c1: Successfully registered new MBean.
16/11/01 09:35:51 INFO instrumentation.MonitoredCounterGroup: Component type: CHANNEL, name: c1 started
16/11/01 09:35:51 INFO node.Application: Starting Sink k1
16/11/01 09:35:51 INFO node.Application: Starting Source r1
16/11/01 09:35:51 INFO source.ExecSource: Exec source starting with command:tail -F /root/flume/log_exec_tail
16/11/01 09:35:51 INFO instrumentation.MonitoredCounterGroup: Monitored counter group for type: SOURCE, name: r1: Successfully registered new MBean.
16/11/01 09:35:51 INFO instrumentation.MonitoredCounterGroup: Component type: SOURCE, name: r1 started
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 31 exec tail1 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 32 exec tail2 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 33 exec tail3 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 34 exec tail4 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 35 exec tail5 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 36 exec tail6 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 37 exec tail7 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 38 exec tail8 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 39 exec tail9 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 31 30 exec tail10 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 31 31 exec tail11 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 31 32 exec tail12 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 31 33 exec tail13 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 31 34 exec tail14 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 31 35 exec tail15 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 31 36 exec tail16 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 31 37 exec tail17 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 31 38 exec tail18 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 31 39 exec tail19 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 32 30 exec tail20 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 32 31 exec tail21 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 32 32 exec tail22 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 32 33 exec tail23 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 32 34 exec tail24 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 32 35 exec tail25 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 32 36 exec tail26 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 32 37 exec tail27 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 32 38 exec tail28 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 32 39 exec tail29 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 33 30 exec tail30 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 33 31 exec tail31 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 33 32 exec tail32 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 33 33 exec tail33 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 33 34 exec tail34 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 33 35 exec tail35 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 33 36 exec tail36 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 33 37 exec tail37 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 33 38 exec tail38 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 33 39 exec tail39 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 34 30 exec tail40 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 34 31 exec tail41 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 34 32 exec tail42 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 34 33 exec tail43 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 34 34 exec tail44 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 34 35 exec tail45 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 34 36 exec tail46 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 34 37 exec tail47 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 34 38 exec tail48 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 34 39 exec tail49 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 35 30 exec tail50 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 35 31 exec tail51 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 35 32 exec tail52 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 35 33 exec tail53 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 35 34 exec tail54 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 35 35 exec tail55 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 35 36 exec tail56 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 35 37 exec tail57 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 35 38 exec tail58 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 35 39 exec tail59 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 36 30 exec tail60 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 36 31 exec tail61 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 36 32 exec tail62 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 36 33 exec tail63 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 36 34 exec tail64 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 36 35 exec tail65 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 36 36 exec tail66 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 36 37 exec tail67 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 36 38 exec tail68 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 36 39 exec tail69 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 37 30 exec tail70 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 37 31 exec tail71 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 37 32 exec tail72 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 37 33 exec tail73 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 37 34 exec tail74 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 37 35 exec tail75 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 37 36 exec tail76 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 37 37 exec tail77 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 37 38 exec tail78 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 37 39 exec tail79 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 38 30 exec tail80 }
16/11/01 09:37:33 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 38 31 exec tail81 }
16/11/01 09:37:34 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 38 32 exec tail82 }
16/11/01 09:37:34 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 38 33 exec tail83 }
16/11/01 09:37:34 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 38 34 exec tail84 }
16/11/01 09:37:34 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 38 35 exec tail85 }
16/11/01 09:37:34 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 38 36 exec tail86 }
16/11/01 09:37:34 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 38 37 exec tail87 }
16/11/01 09:37:34 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 38 38 exec tail88 }
16/11/01 09:37:34 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 38 39 exec tail89 }
16/11/01 09:37:34 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 39 30 exec tail90 }
16/11/01 09:37:34 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 39 31 exec tail91 }
16/11/01 09:37:34 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 39 32 exec tail92 }
16/11/01 09:37:34 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 39 33 exec tail93 }
16/11/01 09:37:34 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 39 34 exec tail94 }
16/11/01 09:37:34 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 39 35 exec tail95 }
16/11/01 09:37:34 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 39 36 exec tail96 }
16/11/01 09:37:34 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 39 37 exec tail97 }
16/11/01 09:37:34 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 39 38 exec tail98 }
16/11/01 09:37:34 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 39 39 exec tail99 }
16/11/01 09:37:34 INFO sink.LoggerSink: Event: { headers:{} body: 65 78 65 63 20 74 61 69 6C 31 30 30 exec tail100 }
^C16/11/01 09:38:01 INFO source.ExecSource: Command [tail -F /root/flume/log_exec_tail] exited with 130
16/11/01 09:38:01 INFO lifecycle.LifecycleSupervisor: Stopping lifecycle supervisor 10
16/11/01 09:38:01 INFO source.ExecSource: Stopping exec source with command:tail -F /root/flume/log_exec_tail
16/11/01 09:38:01 INFO instrumentation.MonitoredCounterGroup: Component type: SOURCE, name: r1 stopped
16/11/01 09:38:01 INFO instrumentation.MonitoredCounterGroup: Shutdown Metric for type: SOURCE, name: r1. source.start.time == 1478018151412
16/11/01 09:38:01 INFO instrumentation.MonitoredCounterGroup: Shutdown Metric for type: SOURCE, name: r1. source.stop.time == 1478018281820
16/11/01 09:38:01 INFO instrumentation.MonitoredCounterGroup: Shutdown Metric for type: SOURCE, name: r1. src.append-batch.accepted == 0
16/11/01 09:38:01 INFO instrumentation.MonitoredCounterGroup: Shutdown Metric for type: SOURCE, name: r1. src.append-batch.received == 0
16/11/01 09:38:01 INFO instrumentation.MonitoredCounterGroup: Shutdown Metric for type: SOURCE, name: r1. src.append.accepted == 0
16/11/01 09:38:01 INFO instrumentation.MonitoredCounterGroup: Shutdown Metric for type: SOURCE, name: r1. src.append.received == 0
16/11/01 09:38:01 INFO instrumentation.MonitoredCounterGroup: Shutdown Metric for type: SOURCE, name: r1. src.events.accepted == 100
16/11/01 09:38:01 INFO instrumentation.MonitoredCounterGroup: Shutdown Metric for type: SOURCE, name: r1. src.events.received == 100
16/11/01 09:38:01 INFO instrumentation.MonitoredCounterGroup: Shutdown Metric for type: SOURCE, name: r1. src.open-connection.count == 0
16/11/01 09:38:01 INFO node.PollingPropertiesFileConfigurationProvider: Configuration provider stopping
16/11/01 09:38:01 INFO instrumentation.MonitoredCounterGroup: Component type: CHANNEL, name: c1 stopped
16/11/01 09:38:01 INFO instrumentation.MonitoredCounterGroup: Shutdown Metric for type: CHANNEL, name: c1. channel.start.time == 1478018151169
16/11/01 09:38:01 INFO instrumentation.MonitoredCounterGroup: Shutdown Metric for type: CHANNEL, name: c1. channel.stop.time == 1478018281824
16/11/01 09:38:01 INFO instrumentation.MonitoredCounterGroup: Shutdown Metric for type: CHANNEL, name: c1. channel.capacity == 1000
16/11/01 09:38:01 INFO instrumentation.MonitoredCounterGroup: Shutdown Metric for type: CHANNEL, name: c1. channel.current.size == 0
16/11/01 09:38:01 INFO instrumentation.MonitoredCounterGroup: Shutdown Metric for type: CHANNEL, name: c1. channel.event.put.attempt == 100
16/11/01 09:38:01 INFO instrumentation.MonitoredCounterGroup: Shutdown Metric for type: CHANNEL, name: c1. channel.event.put.success == 100
16/11/01 09:38:01 INFO instrumentation.MonitoredCounterGroup: Shutdown Metric for type: CHANNEL, name: c1. channel.event.take.attempt == 119
16/11/01 09:38:01 INFO instrumentation.MonitoredCounterGroup: Shutdown Metric for type: CHANNEL, name: c1. channel.event.take.success == 100

顶: 0

踩: 0

我的同类文章

kafka（8）

http://blog.csdn.net

•flume和kafka对接2016-12-19阅读267
•apache kafka系列之在zookeeper中存储结构2016-12-19阅读216
•Flume入门笔记2016-12-13阅读381
•Flume内部原理2016-11-14阅读140

•Kafka文件存储机制那些事2016-12-19阅读243
•Kafka入门操作2016-12-19阅读290
•Apache kafka 工作原理介绍2016-12-06阅读558
•kafka管理工具2016-10-16阅读161

0 0