欢迎使用CSDN-markdown编辑器

来源:互联网 发布:淘宝客活动报名审核 编辑:程序博客网 时间:2024/06/06 02:06

启动zookeeper

zkServer.sh startJMX enabled by defaultUsing config: /usr/software/zookeeper-3.3.6/bin/../conf/zoo.cfgStarting zookeeper ... STARTED

下载、启动kafka

https://www.apache.org/dyn/closer.cgi?path=/kafka/0.11.0.1/kafka_2.12-0.11.0.1.tgz

# 解压tar -xzvf kafka_2.12-0.11.0.1.tgz# 启动bin/kafka-server-start.sh config/server.properties# 创建topicbin/kafka-topics.sh --zookeeper 192.168.2.225:2181 --create --topic my_logs --replication-factor 2 --partitions 10

elasticsearch

下载地址 https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-5.6.3.tar.gz

# 解压# 启动bin/elasticsearch

查看是否正常 http://localhost:9200/

kibana

下载地址 https://artifacts.elastic.co/downloads/kibana/kibana-5.6.3-linux-x86_64.tar.gz

# 解压# 启动bin/kibana

http://localhost:5601

logstash

下载地址 https://artifacts.elastic.co/downloads/logstash/logstash-5.6.3.tar.gz

在config目录下创建logstash.conf文件

input {    kafka {            bootstrap_servers => "localhost:9092"            topics => ["my_logs"]            codec => "json"            }}filter {        #Only matched data are send to output.}output {        # stdout{}        elasticsearch {                hosts => ["localhost:9200"]manage_template => false                }}
# 启动bin/logstash -f config/logstash.conf

使用logback向kafka写日志

查看日志 http://localhost:5601

使用kibana查看日志