kafka topic增加replica报错解决

刚开始测试环境中给一个业务方建的topic没有增加replica，导致前天虚拟机down掉，业务方反馈无法写入的问题。于是决定将所有replica为1的topic改为2，于是照着官方文档上的说明试试，但由于编辑json文件出错了，却手贱地执行了 --execute，后面即使改对，也无法成功。总是报错：

bin/kafka-reassign-partitions.sh --zookeeper localhost:2181 --reassignment-json-file topics-to-move.json --executeCurrent partition replica assignment{"version":1,"partitions":[{"topic":"production_process_flow_dev","partition":2,"replicas":[1]},{"topic":"production_process_flow_dev","partition":1,"replicas":[3]},{"topic":"production_process_flow_dev","partition":3,"replicas":[2]},{"topic":"production_process_flow_dev","partition":0,"replicas":[2]}]}Save this to use as the --reassignment-json-file option during rollbackPartitions reassignment failed due to Partition reassignment currently in progress for Map(). Aborting operationkafka.common.AdminCommandFailedException: Partition reassignment currently in progress for Map(). Aborting operationat kafka.admin.ReassignPartitionsCommand.reassignPartitions(ReassignPartitionsCommand.scala:216)at kafka.admin.ReassignPartitionsCommand$.executeAssignment(ReassignPartitionsCommand.scala:133)at kafka.admin.ReassignPartitionsCommand$.main(ReassignPartitionsCommand.scala:47)at kafka.admin.ReassignPartitionsCommand.main(ReassignPartitionsCommand.scala)

经过一番源代码跟踪，最后确定应该是zk上创建了/admin/reassign_partitions，而这个是由于误操作创建又没有成功结束残留下来的，导致正常的reassigin都没办法进行，于是只能命令行登陆zk，直接删除该节点：

[zk: localhost:2181(CONNECTED) 0] ls /[zookeeper, admin, consumers, config, controller, brokers, controller_epoch][zk: localhost:2181(CONNECTED) 1] ls /admin/reassign_partitions[][zk: localhost:2181(CONNECTED) 2] get /admin/reassign_partitions{"version":1,"partitions":[]}cZxid = 0xd00008216ctime = Mon Oct 26 14:47:30 CST 2015mZxid = 0xd00008216mtime = Mon Oct 26 14:47:30 CST 2015pZxid = 0xd00008216cversion = 0dataVersion = 0aclVersion = 0ephemeralOwner = 0x0dataLength = 29numChildren = 0[zk: localhost:2181(CONNECTED) 3] rmr /admin/reassign_partitions[zk: localhost

之后再次之行：

bin/kafka-reassign-partitions.sh --zookeeper localhost:2181 --reassignment-json-file topics-to-move.json --executeCurrent partition replica assignment{"version":1,"partitions":[{"topic":"production_process_flow_dev","partition":2,"replicas":[1]},{"topic":"production_process_flow_dev","partition":1,"replicas":[3]},{"topic":"production_process_flow_dev","partition":3,"replicas":[2]},{"topic":"production_process_flow_dev","partition":0,"replicas":[2]}]}Save this to use as the --reassignment-json-file option during rollbackSuccessfully started reassignment of partitions {"version":1,"partitions":[{"topic":"production_process_flow_dev","partition":0,"replicas":[2,1]},{"topic":"production_process_flow_dev","partition":1,"replicas":[3,2]},{"topic":"production_process_flow_dev","partition":2,"replicas":[1,3]},{"topic":"production_process_flow_dev","partition":3,"replicas":[2,1]}]}bin/kafka-reassign-partitions.sh --zookeeper localhost:2181 --reassignment-json-file topics-to-move.json --verifyStatus of partition reassignment:Reassignment of partition [production_process_flow_dev,0] completed successfullyReassignment of partition [production_process_flow_dev,1] completed successfullyReassignment of partition [production_process_flow_dev,2] completed successfullyReassignment of partition [production_process_flow_dev,3] completed successfully