logstash的配置
来源:互联网 发布:手机磁盘清理软件 编辑:程序博客网 时间:2024/06/10 22:37
flow-es:input { file { type => "flow" path => "/var/nginx_logs/*.log" discover_interval => 5 start_position => "beginning" }}output { if [type] == "flow" { elasticsearch { index => "flow-%{+YYYY.MM.dd}" hosts => ["172.16.0.14:9200", "172.16.0.15:9200", "172.16.0.16:9200"] } } }flow-kafka:input { file { path => "/var/nginx_logs/*.log" discover_interval => 5 start_position => "beginning" }}output {kafka { topic_id => "accesslog" codec => plain {format => "%{message}"charset => "UTF-8" } bootstrap_servers => "172.16.0.11:9092,172.16.0.12:9092,172.16.0.13:9092"}}gameserver-kafka:input { file {codec => plain { charset => "GB2312" } path => "D:/MirServer/LogServer/BaseDir/*/*.txt" discover_interval => 30 start_position => "beginning" }}output { kafka { topic_id => "itcast" codec => plain { format => "%{message}"charset => "GB2312" } bootstrap_servers => "172.16.0.11:9092,172.16.0.12:9092,172.16.0.13:9092" }}kafka-es:input { kafka { type => "level-one" auto_offset_reset => "smallest" codec => plain { charset => "GB2312" }group_id => "es"topic_id => "itcast"zk_connect => "172.16.0.11:2181,172.16.0.12:2181,172.16.0.13:2181" }}filter { mutate { split => { "message" => "" } add_field => { "event_type" => "%{message[3]}" "current_map" => "%{message[4]}" "current_X" => "%{message[5]}" "current_y" => "%{message[6]}" "user" => "%{message[7]}" "item" => "%{message[8]}" "item_id" => "%{message[9]}" "current_time" => "%{message[12]}" } remove_field => [ "message" ] } }output { elasticsearch { index => "level-one-%{+YYYY.MM.dd}" codec => plain { charset => "GB2312" } hosts => ["172.16.0.14:9200", "172.16.0.15:9200", "172.16.0.16:9200"] } }
阅读全文
0 0
- logstash的配置
- logstash配置
- logstash配置
- Logstash配置
- logstash indexer和shipper的配置
- logstash日志分析的配置和使用
- logstash日志分析的配置和使用
- logstash日志分析的配置和使用
- logstash日志分析的配置和使用
- logstash日志分析的配置和使用
- Logstash日志分析的配置和使用
- Elasticsearch+Logstash+Kibana配置
- logstash配置java环境
- Logstash 入门教程 -配置案例
- Logstash Filter 配置
- mysql logstash 配置
- logstash 配置使用
- logstash 详细配置
- LeetCode题目:Roman to Integer
- 学习笔记——JavaEE基础<1>HTML基础
- C# 委托实现多线程调用窗体
- tomcat之 JDK8.0安装、tomcat-8.5.15安装
- DataTable-输出Excel添加额外行的实现
- logstash的配置
- Quartz将定时任务持久化到数据库
- 37. 输入3个学生4门课的成绩,完成maxaver函数实现如下功能:输出平均成绩最高的学生的所有成绩。
- linux基础入门之cal命令
- 更改jupyter notebook的主题颜色(theme) 包括pycharm
- Android_自定义控件之两圆点之间来回移动加载进度
- Ubuntu上安装Python 3.6
- Kotlin笔记(七)——委托属性(Delegated Properties)
- PAT 1030 Travel Plan(单源最短路径+优化Dijkstra)