ZooKeeper监控

来源:互联网 发布:网剧悬疑题材盛行知乎 编辑:程序博客网 时间:2024/05/21 14:04

在公司内部,有不少应用已经强依赖zookeeper,zookeeper的工作状态直接影响它们的正常工作。目前开源世界中暂没有一个比较成熟的zookeeper-monitor, 于是开始zookeeper监控这块工作。

目前zookeeper-monitor能做哪些事情,讲到这个,首先来看看哪些因素对zookeeper正常工作比较大的影响:

  1. 用于zookeeper写日志的目录要有足够大小,并且强烈建议在单独的磁盘(挂载点)上,这是影响ZK性能最大因素之一。
  2. 连接数。
  3. 注册的Watcher数。
  4. ZNode是否可读,可写。
  5. ZK事件通知的延时是否过大。

围绕以上几点展开,完成了taokeeper一期的开发,目前主要完成以下方面的监控:(项目地址:https://github.com/alibaba/taokeeper)

l  CPU/MEM/LOAD的监控

l  ZK日志目录所在磁盘剩余空间监控

l  单机连接数的峰值报警

l  单机 Watcher数的峰值报警

l  节点自检:是指对集群中每个IP所在ZK节点上的PATH: /YINSHI.MONITOR.ALIVE.CHECK 定期进行三次如下流程 : 节点连接 – 数据发布 – 修改通知 – 获取数据 – 数据对比, 在指定的延时内,三次流程均成功视为该节点处于正常状态。

  • ZooKeeper集群实时状态 (点击图片查看大图)

monitor-interface

点击查看按钮可以查看当前服务器上所有订阅者的详细信息:

zookeeper_monitor_view_watch

  ZooKeeper监控报警设置 (点击图片查看大图)

alarm-setting-interface1

ZooKeeper集群状态趋势图 (点击图片查看大图)

taokeeper_monitor_trend_chart

如何安装部署

首先,对之前使用 maven-war-plugin 来进行配置管理的方式,表示遗憾。不少开发人员反馈部署比较困难,另外还有一些对maven不熟悉的开发人员也是这样认为。现在有了改进,将配置与程序分离开来。对此给大家带来的不便,深表歉意。

一、直接部署

1. 下载taokeeper.sql,初始化数据库(Mysql).
2. 下载taokeeper-monitor.war文件,解压到tomcat的webapps目前下,确保最后目录结构如下:  %TOMCAT_HOME%\webapps\taokeeper-monitor.war

3. 下载 taokeeper-monitor-config.properties文件,存放到一个指定目录,比如

/home/xiaoming/taokeeper-monitor/config/taokeeper-monitor-config.properties, 其中内容如下,根据需要自己修改下。

<span class="pun">----------------------------------------------------------------</span><span class="pln" style="color: rgb(0, 0, 0);">systemInfo</span><span class="pun">.</span><span class="pln" style="color: rgb(0, 0, 0);">envName</span><span class="pun">=</span><span class="pln" style="color: rgb(0, 0, 0);">TEST</span><span class="com">#DBCP</span><span class="pln" style="color: rgb(0, 0, 0);">dbcp</span><span class="pun">.</span><span class="pln" style="color: rgb(0, 0, 0);">driverClassName</span><span class="pun">=</span><span class="pln" style="color: rgb(0, 0, 0);">com</span><span class="pun">.</span><span class="pln" style="color: rgb(0, 0, 0);">mysql</span><span class="pun">.</span><span class="pln" style="color: rgb(0, 0, 0);">jdbc</span><span class="pun">.</span><span class="typ">Driver</span><span class="pln" style="color: rgb(0, 0, 0);">dbcp</span><span class="pun">.</span><span class="pln" style="color: rgb(0, 0, 0);">dbJDBCUrl</span><span class="pun">=</span><span class="pln" style="color: rgb(0, 0, 0);">jdbc</span><span class="pun">:</span><span class="pln" style="color: rgb(0, 0, 0);">mysql</span><span class="pun">:</span><span class="com">//1.1.1.1:3306/taokeeper</span><span class="pln" style="color: rgb(0, 0, 0);">dbcp</span><span class="pun">.</span><span class="pln" style="color: rgb(0, 0, 0);">characterEncoding</span><span class="pun">=</span><span class="pln" style="color: rgb(0, 0, 0);">GBKdbcp</span><span class="pun">.</span><span class="pln" style="color: rgb(0, 0, 0);">username</span><span class="pun">=</span><span class="pln" style="color: rgb(0, 0, 0);">xiaomingdbcp</span><span class="pun">.</span><span class="pln" style="color: rgb(0, 0, 0);">password</span><span class="pun">=</span><span class="lit">123456</span><span class="pln" style="color: rgb(0, 0, 0);">dbcp</span><span class="pun">.</span><span class="pln" style="color: rgb(0, 0, 0);">maxActive</span><span class="pun">=</span><span class="lit">30</span><span class="pln" style="color: rgb(0, 0, 0);">dbcp</span><span class="pun">.</span><span class="pln" style="color: rgb(0, 0, 0);">maxIdle</span><span class="pun">=</span><span class="lit">10</span><span class="pln" style="color: rgb(0, 0, 0);">dbcp</span><span class="pun">.</span><span class="pln" style="color: rgb(0, 0, 0);">maxWait</span><span class="pun">=</span><span class="lit">10000</span><span class="pln" style="color: rgb(0, 0, 0);"></span><span class="com">#SystemConstant</span><span class="pln" style="color: rgb(0, 0, 0);"></span><span class="typ">SystemConstent</span><span class="pun">.</span><span class="pln" style="color: rgb(0, 0, 0);">dataStoreBasePath</span><span class="pun">=</span><span class="str">/home/</span><span class="pln" style="color: rgb(0, 0, 0);">xiaoming</span><span class="pun">/</span><span class="pln" style="color: rgb(0, 0, 0);">taokeeper</span><span class="pun">-</span><span class="pln" style="color: rgb(0, 0, 0);">monitor</span><span class="pun">/</span><span class="typ">ZookeeperStore</span><span class="pln" style="color: rgb(0, 0, 0);"></span><span class="com">#SSH account of zk server</span><span class="pln" style="color: rgb(0, 0, 0);"></span><span class="typ">SystemConstant</span><span class="pun">.</span><span class="pln" style="color: rgb(0, 0, 0);">userNameOfSSH</span><span class="pun">=</span><span class="pln" style="color: rgb(0, 0, 0);">xiaoming</span><span class="typ">SystemConstant</span><span class="pun">.</span><span class="pln" style="color: rgb(0, 0, 0);">passwordOfSSH</span><span class="pun">=</span><span class="lit">123456</span><span class="pln" style="color: rgb(0, 0, 0);"></span><span class="pun">------------------------------------------------------------------</span><span class="pln" style="color: rgb(0, 0, 0);"></span><span class="lit">4.</span><span class="pln" style="color: rgb(0, 0, 0);"> </span><span class="pun">在</span><span class="pln" style="color: rgb(0, 0, 0);">tomcat</span><span class="pun">启动脚本中添加</span><span class="pln" style="color: rgb(0, 0, 0);">JAVA_OPTS</span><span class="pun">:</span><span class="pln" style="color: rgb(0, 0, 0);"></span><span class="str"><strong></span><span class="pln" style="color: rgb(0, 0, 0);">windows</span><span class="pun"><</span><span class="str">/strong>上:<strong>set</</span><span class="pln" style="color: rgb(0, 0, 0);">strong</span><span class="pun">></span><span class="pln" style="color: rgb(0, 0, 0);"> JAVA_OPTS</span><span class="pun">=-</span><span class="typ">DconfigFilePath</span><span class="pun">=</span><span class="str">"D:servertomcatwebappstaokeeper-monitor-config.properties"</span><span class="pln" style="color: rgb(0, 0, 0);"></span><span class="str"><strong></span><span class="pln" style="color: rgb(0, 0, 0);">linux</span><span class="pun"><</span><span class="str">/strong>上:JAVA_OPTS=-DconfigFilePath="/</span><span class="pln" style="color: rgb(0, 0, 0);">home</span><span class="pun">/</span><span class="pln" style="color: rgb(0, 0, 0);">xiaoming</span><span class="pun">/</span><span class="pln" style="color: rgb(0, 0, 0);">taokeeper</span><span class="pun">-</span><span class="pln" style="color: rgb(0, 0, 0);">monitor</span><span class="pun">/</span><span class="pln" style="color: rgb(0, 0, 0);">config</span><span class="pun">/</span><span class="pln" style="color: rgb(0, 0, 0);">taokeeper</span><span class="pun">-</span><span class="pln" style="color: rgb(0, 0, 0);">monitor</span><span class="pun">-</span><span class="pln" style="color: rgb(0, 0, 0);">config</span><span class="pun">.</span><span class="pln" style="color: rgb(0, 0, 0);">properties</span><span class="str">"</span>

5. 启动tomcat服务器

6. 正常启动后,访问:http://127.0.0.1:8080/taokeeper-monitor

二、从源代码开始

1. Check out 源代码:git@github.com:nileader/taokeeper.git

2. 修改代码…

3.  实现 com.taobao.taokeeper.reporter.alarm.MessageSender 接口,用于发送报警信息。(可选)

4. 到taokeeper根目录下执行 package.cmd 命令,打成一个war包,之后进行部署

如何使用
1. taokeeper-monitor启动后,还没有配置任何zookeeper集群,点击“加入监控”进行集群添加。

taokeeper_monitor_add_cluster
2. 配置zookeeper集群信息(点击查看大图)

taokeeper_monitor_config_cluster

 

0 0
原创粉丝点击