Flume-ng:avro源发送日志

来源:互联网 发布:淘宝保证金在哪里退 编辑:程序博客网 时间:2024/06/07 06:30

agent1向agent3发送日志

agent3 配置

agent3.channels.ch1.type = memory

agent3.sources.avro-source1.channels = ch1

agent3.sources.avro-source1.type = avro

agent3.sources.avro-source1.bind = 0.0.0.0

agent3.sources.avro-source1.port = 12343

agent3.sinks.log-sink1.channel = ch1

agent3.sinks.log-sink1.type = logger

 

agent3.channels = ch1

agent3.sources = avro-source1

agent3.sinks = log-sink1

agent1配置

agent1.sources=avro-sour

agent1.sinks=avro-forward-sink

agent1.channels=jdbc-channel

agent1.sources.avro-sour.channels=jdbc-channel

agent1.sources.avro-sour.type=netcat

agent1.sources.avro-sour.bind=0.0.0.0

agent1.sources.avro-sour.port=12343

agent1.sinks.avro-forward-sink.channel=jdbc-channel

agent1.sinks.avro-forward-sink.type=avro

agent1.sinks.avro-forward-sink.hostname=10.1.72.97

agent1.sinks.avro-forward-sink.port=12343

agent1.channels.jdbc-channel.type=memory

agent1客户端命令:

flume-ng avro-client -c /etc/flume-ng/conf -H localhost -p 12343 -F /etc/passwd




1 0