keepalived脑裂问题
来源:互联网 发布:linux oracle 自启动 编辑:程序博客网 时间:2024/04/29 14:35
keepalived脑裂问题
今天又被坑了,同事提供机器的时候没有仔细检查,然后keepalived,mysql就部署,项目上线了。
中午服务器故障宕机重启,发现log异常,脑裂现象,检查半天,改什么优先级,什么master和backup,还有那个号,
都不行,最后仔细一看发现iptables启动着的,悲剧,这个锅啊。
A机
Nov 29 16:25:44 ip-192-168-1-190 Keepalived_vrrp[3914]: VRRP_Instance(id175) Transition to MASTER STATE
Nov 29 16:25:45 ip-192-168-1-190 Keepalived_vrrp[3914]: VRRP_Instance(id175) Entering MASTER STATE
Nov 29 16:25:45 ip-192-168-1-190 Keepalived_vrrp[3914]: VRRP_Instance(id175) setting protocol VIPs.
Nov 29 16:25:45 ip-192-168-1-190 Keepalived_vrrp[3914]: VRRP_Instance(id175) Sending gratuitous ARPs on bond0 for 192.168.1.175
Nov 29 16:25:45 ip-192-168-1-190 Keepalived_healthcheckers[3913]: Netlink reflector reports IP 192.168.1.175 added
Nov 29 16:25:50 ip-192-168-1-190 Keepalived_vrrp[3914]: VRRP_Instance(id175) Sending gratuitous ARPs on bond0 for 192.168.1.175
Nov 29 16:25:52 ip-192-168-1-190 Keepalived[3912]: Stopping Keepalived v1.2.13 (03/19,2015)
Nov 29 16:25:52 ip-192-168-1-190 Keepalived_vrrp[3914]: VRRP_Instance(id175) sending 0 priority
Nov 29 16:25:52 ip-192-168-1-190 Keepalived_vrrp[3914]: VRRP_Instance(id175) removing protocol VIPs.
Nov 29 16:25:52 ip-192-168-1-190 Keepalived_healthcheckers[3913]: Removing service [192.168.1.190]:3306 from VS [192.168.1.175]:3306
Nov 29 16:25:52 ip-192-168-1-190 kernel: IPVS: __ip_vs_del_service: enter
B机
Nov 29 16:25:51 ip-192-168-1-191 Keepalived_vrrp[4795]: VRRP_Instance(id175) Sending gratuitous ARPs on bond0 for 192.168.1.175
Nov 29 16:25:52 ip-192-168-1-191 Keepalived_vrrp[4795]: VRRP_Instance(id175) Received lower prio advert, forcing new election
Nov 29 16:25:52 ip-192-168-1-191 Keepalived_vrrp[4795]: VRRP_Instance(id175) Sending gratuitous ARPs on bond0 for 192.168.1.175
Nov 29 16:25:52 ip-192-168-1-191 Keepalived_vrrp[4795]: VRRP_Instance(id175) Received lower prio advert, forcing new election
Nov 29 16:25:52 ip-192-168-1-191 Keepalived_vrrp[4795]: VRRP_Instance(id175) Sending gratuitous ARPs on bond0 for 192.168.1.175
关闭防火墙后正常
Nov 29 16:46:49 ip-192-168-1-190 Keepalived_vrrp[4098]: Configuration is using : 62527 Bytes
Nov 29 16:46:49 ip-192-168-1-190 Keepalived_vrrp[4098]: Using LinkWatch kernel netlink reflector...
Nov 29 16:46:49 ip-192-168-1-190 Keepalived_vrrp[4098]: VRRP_Instance(id175) Entering BACKUP STATE
Nov 29 16:46:49 ip-192-168-1-190 Keepalived_vrrp[4098]: VRRP sockpool: [ifindex(7), proto(112), unicast(0), fd(10,11)]
Nov 29 16:46:49 ip-192-168-1-190 Keepalived_healthcheckers[4097]: Using LinkWatch kernel netlink reflector...
Nov 29 16:46:49 ip-192-168-1-190 Keepalived_healthcheckers[4097]: Activating healthchecker for service [192.168.1.190]:3306
今天又被坑了,同事提供机器的时候没有仔细检查,然后keepalived,mysql就部署,项目上线了。
中午服务器故障宕机重启,发现log异常,脑裂现象,检查半天,改什么优先级,什么master和backup,还有那个号,
都不行,最后仔细一看发现iptables启动着的,悲剧,这个锅啊。
A机
Nov 29 16:25:44 ip-192-168-1-190 Keepalived_vrrp[3914]: VRRP_Instance(id175) Transition to MASTER STATE
Nov 29 16:25:45 ip-192-168-1-190 Keepalived_vrrp[3914]: VRRP_Instance(id175) Entering MASTER STATE
Nov 29 16:25:45 ip-192-168-1-190 Keepalived_vrrp[3914]: VRRP_Instance(id175) setting protocol VIPs.
Nov 29 16:25:45 ip-192-168-1-190 Keepalived_vrrp[3914]: VRRP_Instance(id175) Sending gratuitous ARPs on bond0 for 192.168.1.175
Nov 29 16:25:45 ip-192-168-1-190 Keepalived_healthcheckers[3913]: Netlink reflector reports IP 192.168.1.175 added
Nov 29 16:25:50 ip-192-168-1-190 Keepalived_vrrp[3914]: VRRP_Instance(id175) Sending gratuitous ARPs on bond0 for 192.168.1.175
Nov 29 16:25:52 ip-192-168-1-190 Keepalived[3912]: Stopping Keepalived v1.2.13 (03/19,2015)
Nov 29 16:25:52 ip-192-168-1-190 Keepalived_vrrp[3914]: VRRP_Instance(id175) sending 0 priority
Nov 29 16:25:52 ip-192-168-1-190 Keepalived_vrrp[3914]: VRRP_Instance(id175) removing protocol VIPs.
Nov 29 16:25:52 ip-192-168-1-190 Keepalived_healthcheckers[3913]: Removing service [192.168.1.190]:3306 from VS [192.168.1.175]:3306
Nov 29 16:25:52 ip-192-168-1-190 kernel: IPVS: __ip_vs_del_service: enter
B机
Nov 29 16:25:51 ip-192-168-1-191 Keepalived_vrrp[4795]: VRRP_Instance(id175) Sending gratuitous ARPs on bond0 for 192.168.1.175
Nov 29 16:25:52 ip-192-168-1-191 Keepalived_vrrp[4795]: VRRP_Instance(id175) Received lower prio advert, forcing new election
Nov 29 16:25:52 ip-192-168-1-191 Keepalived_vrrp[4795]: VRRP_Instance(id175) Sending gratuitous ARPs on bond0 for 192.168.1.175
Nov 29 16:25:52 ip-192-168-1-191 Keepalived_vrrp[4795]: VRRP_Instance(id175) Received lower prio advert, forcing new election
Nov 29 16:25:52 ip-192-168-1-191 Keepalived_vrrp[4795]: VRRP_Instance(id175) Sending gratuitous ARPs on bond0 for 192.168.1.175
关闭防火墙后正常
Nov 29 16:46:49 ip-192-168-1-190 Keepalived_vrrp[4098]: Configuration is using : 62527 Bytes
Nov 29 16:46:49 ip-192-168-1-190 Keepalived_vrrp[4098]: Using LinkWatch kernel netlink reflector...
Nov 29 16:46:49 ip-192-168-1-190 Keepalived_vrrp[4098]: VRRP_Instance(id175) Entering BACKUP STATE
Nov 29 16:46:49 ip-192-168-1-190 Keepalived_vrrp[4098]: VRRP sockpool: [ifindex(7), proto(112), unicast(0), fd(10,11)]
Nov 29 16:46:49 ip-192-168-1-190 Keepalived_healthcheckers[4097]: Using LinkWatch kernel netlink reflector...
Nov 29 16:46:49 ip-192-168-1-190 Keepalived_healthcheckers[4097]: Activating healthchecker for service [192.168.1.190]:3306
阅读全文
0 0
- keepalived脑裂问题
- 解决keepalived脑裂问题
- 记一次keepalived脑裂问题查找
- keepalived配置及问题
- keepalived vrrp iptables问题
- lvs+keepalived防火墙问题
- 搭建keepalived遇到的问题
- keepalived
- keepalived
- keepalived
- Keepalived
- keepalived
- keepalived
- keepalived
- Keepalived
- keepalived
- keepalived
- keepalived
- cloudera cdh 5.11 编译 启动spark thrift server spark sql
- jQuery扩展插件封装
- “戏”说Spark-Spark核心-RDD 持久化机制详解
- 素数(质数)判断方法
- error: Microsoft Visual C++ 9.0 is required (Unable to find vcvarsall.bat)
- keepalived脑裂问题
- oracle触发器
- HTML
- eclipse SDK配置Java EE的WEB开发环境
- 解决webpack本地开发环境无法用IP访问
- 关于SqlServer2012,附加数据库 失败的一个解决办法
- TCP收到RST的几种情况
- hadoop2.6.5+spark2.1.0+hbase1.2.6完全分布式环境部署
- ES6函数扩展