广东省项目（肇庆）MYSQL故障处理

广东省网肇庆MYSQL故障处理

1.1.1 项目名称

广东省项目-肇庆地市

1.1.2 问题描述

运维反馈数据库有很多锁资源，为了释放锁资源重启了数据库，重启之前发现数据库起不来，报错如下：

141202 15:18:55  InnoDB:Starting shutdown...

141202 15:18:57  InnoDB:Shutdown completed; log sequence number 63 1895745318

141202 15:18:57 [Note]

141202 15:18:57 mysqld_safe mysqld from pid file/var/lib/mysql/mysql01.pid ended

141202 15:20:06 mysqld_safe Starting mysqld daemon with databasesfrom /var/lib/mysql

141202 15:20:06 [ERROR] Error message file'/usr/share/mysql/english/errmsg.sys' had only 472 error messages,

but it should contain at least 641 error messages.

Check that the above file is the right version for this program!

141202 15:20:06 [Note] Plugin 'FEDERATED' is disabled.

141202 15:20:08  InnoDB:Started; log sequence number 63 1895745318

141202 15:20:08 [ERROR] Aborting

原主的数据库切换成备库，出现Secondary/Secondary 状态。经过运维修复把DRBD状态变成Primary/Secondary，

 

1.1.3 影响范围

全网

1.1.4 问题分析

运维反馈数据库有很多锁资源，为了释放锁资源重启了数据库，重启之前发现数据库起不来，报错如下：

原主的数据库切换成备库，出现Secondary/Secondary 状态。经过运维修复把DRBD状态变成Primary/Secondary，

 经过处理drbd恢复/primary/secondary状态

141202 15:18:55  InnoDB:Starting shutdown...

141202 15:18:57  InnoDB:Shutdown completed; log sequence number 63 1895745318

141202 15:18:57 [Note]

141202 15:18:57 mysqld_safe mysqld from pid file/var/lib/mysql/mysql01.pid ended

141202 15:20:06 mysqld_safe Starting mysqld daemon with databasesfrom /var/lib/mysql

141202 15:20:06 [ERROR] Error message file'/usr/share/mysql/english/errmsg.sys' had only 472 error messages,

but it should contain at least 641 error messages.

Check that the above file is the right version for this program!

141202 15:20:06 [Note] Plugin 'FEDERATED' is disabled.

141202 15:20:08  InnoDB:Started; log sequence number 63 1895745318

141202 15:20:08 [ERROR] Aborting

141202 15:20:08  InnoDB:Starting shutdown...

141202 15:20:09  InnoDB:Shutdown completed; log sequence number 63 1895745318

141202 15:20:09 [Note]

141202 15:20:09 mysqld_safe mysqld from pid file/var/lib/mysql/mysql01.pid ended

141202 15:24:44 mysqld_safe Starting mysqld daemon with databasesfrom /var/lib/mysql

141202 15:24:44 [ERROR] Error message file'/usr/share/mysql/english/errmsg.sys' had only 472 error messages,

but it should contain at least 641 error messages.

Check that the above file is the right version for this program!

141202 15:24:44 [Note] Plugin 'FEDERATED' is disabled.

141202 15:24:45  InnoDB:Started; log sequence number 63 1895745318

141202 15:24:45 [ERROR] Aborting

 

141202 15:24:45  InnoDB:Starting shutdown...

141202 15:24:47  InnoDB:Shutdown completed; log sequence number 63 1895745318

141202 15:24:47 [Note]

141202 15:24:47 mysqld_safe mysqld from pid file/var/lib/mysql/mysql01.pid ended

发现MYSQL01服务器里还有MYSQL-5.0.45版本的MYSQL而现网使用的是5.1.42,数据库在安装5.1.42版本时未卸载5.0.45版本干净 

1.1.5 解决方案

1) cp /usr/share/mysql/english/errmsg.sys/usr/share/mysql/english/errmsg.sys.backup

2) wgethttp://downloads.mysql.com/archives/mysql-5.1/mysql-5.1.50.tar.gz

3) tar -xzvfhttp://downloads.mysql.com/archives/mysql-5.1/mysql-5.1.50.tar.gz

4) cp mysql-5.1.50/sql/share/english/errmsg.sys/usr/share/mysql/english/errmsg.sys

5）servicemysqld strart

6) mysql_upgrade -uroot -p******

1.1.8 参考资料

goole 百度