Linux setup kafka

来源：互联网发布：金字塔软件免费版编辑：程序博客网时间：2024/06/06 01:12

.make sure ubuntu is updated sudo apt-get update -ysudo apt-get upgrade -y.install javasudo add-apt-repository -y ppa:webupd8team/javasudo apt-get updatesudo apt-get install oracle-java8-installer -ycheck:sudo java -version.install zookeepersudo apt-get install zookeeperdcheck :netstat -ant | grep :2181.install kafka serverhttp://kafka.apache.org/downloadsunzip files to /opt/kafkastart kafka server :sudo  /opt/Kafka/kafka_2.11-0.11.0.0/bin/kafka-server-start.sh /opt/Kafka/kafka_2.11-0.11.0.0/config/server.propertiescreate topic :sudo /opt/Kafka/kafka_2.11-0.11.0.0/bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1  --partitions 1 --topic testinglist topic :sudo /opt/Kafka/kafka_2.11-0.11.0.0/bin/kafka-topics.sh --list --zookeeper localhost:2181produce message:sudo /opt/Kafka/kafka_2.11-0.11.0.0/bin/kafka-console-producer.sh --broker-list localhost:9092 --topic testingconsume message:udo /opt/Kafka/kafka_2.11-0.11.0.0/bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic testing --from-beginning

python操作kafka 示例：

from kafka import KafkaConsumer,KafkaProducerdef run():    print('Step1');    consumer = KafkaConsumer(bootstrap_servers='localhost:9092', auto_offset_reset='earliest')    print('Step2');    consumer.subscribe(['testing'])    print('Step3');    for message in consumer:        print (message)    print('Step4');def produce1():    print('prducing 1');    producer = KafkaProducer(bootstrap_servers='localhost:9092')    producer.send('testing', 'message from producer.').get(timeout=30)produce1();run();

参考链接：

https://devops.profitbricks.com/tutorials/install-and-configure-apache-kafka-on-ubuntu-1604-1/
http://kafka-python.readthedocs.io/en/master/

阅读全文

1 0