Kafka常用命令集合

Kafka常用命令集合

1、创建一个topic

kafka-topics –create –zookeeper 195.1.10.157:2181/kafka –topic DW_LITE_STD –partitions 3 –replication-factor 3

说明：partitions指topic分区数，replication-factor指topic每个分区的副本数，其值不能大于broker个数，否则会报错。

2、已创建topic增加分区

kafka-topics –alter –topics DW_LITE_STD –partitions 5 –zookeeper 195.1.10.157:2181/kafka_data

说明：partition只能增加，不能减少。如果原有分散策略是hash的方式，将会受影响

3、删除topic

kafka-topics –delete –zookeeper 195.1.10.157:2181/kafka_data –topic DW_LITE_STD

4、查看已创建的topic

kafka-topics –list –zookeeper 195.1.10.157:2181/kafka_data
kafka-topics –zookeeper 195.1.10.157:2181/kafka_data –describe |grep Isr

5、查看指定topic的信息

Kafka-topics –zookeeper 195.1.10.157:2181/kafka_data –describe –topic DW_LITE_STD

6、查看topic最新（最旧偏移量）

*Kafka-run-class kafka.tools.GetOffsetShell –broker-list 195.1.10.159:29092 –topic DW_LITE_STD –time -1（-2）

说明：注：time为-1表示最大值，time为-2表示最小值

7、消费者命令

Kafka-console-consumer –zookeeper 195.1.10.157:2181/kafka_data –topic DW_LITE_STD –from-beginning

说明： –from-beginning 从头开始读取

8、生产者命令

Kafka-console-producer –zookeeper 195.1.10.157:2181/kafka_data –topic DW_LITE_STD

9、下线broker

Kafka-run-class kafka.admin.ShutdownBroker –zookeeper 195.1.10.157:2181 –broker #brokerId# –num.retries 3 –retry.int shutdown broker