Monitoring Hadoop Clusters using Ganglia
来源:互联网 发布:淘宝联盟佣金结算时间 编辑:程序博客网 时间:2024/05/17 03:13
I spent a couple of days this week working with my Forward colleague Abs configuringGanglia to monitor ourHadoop cluster and automating the installation to our production servers. The goal of this article is to provide an overview of the Ganglia architecture combined with our experience of getting it to play nicely with Hadoop.
Ganglia Overview
Ganglia is comprised of three components:
- Ganglia Monitoring Deamon (gmond) – The Ganglia Monitoring Deamon (gmond) needs to be installed on each machine that you want to monitor. In our case this included our slave and master Hadoop nodes. The gmond service collects server metrics and exposes them over TCP.
- Ganglia Meta Deamon (gmetad) – The meta Deamon polls all of the available gmond data sources (over TCP) and makes the data available for the web interace. We decided to use a dedicated server for the collection and presentation of the gathered metrics.
- Ganglia Web Application – Provides a PHP based web app that presents various visualisation around server performance over various time periods.
Installing gmond on your Hadoop servers.
We found the following installation guide, Installing ganglia-3.1.1 on Ubuntu 8.04 Hardy Heron, helpful when installing gmond on our Hadoop servers.
We placed the gmond configuration in the default location: /etc/ganglia/gmond.conf and made the following changed to the defaults.
cluster { name = "hadoop" owner = "your company" latlong = "unspecified" url = "unspecified"}/* Specifies the port that gmond will receive data on */udp_recv_channel { port = 8649}/* Specifies the port and host that this gmond service will send data to. Our gmond services post to themselves rather than gmond services on other machines */udp_send_channel { host = your.hadoop.host.name port = 8649 ttl = 1}/* Specifies the port that metrics can be retrieved from */tcp_accept_channel { port = 8650}
Start gmond using sudo gmond. To ensure that gmond is collecting stats correctly use: telnet localhost 8650. This should output a stream of XML containing collected stats.
Configuring Hadoop to send metrics to gmond
Fortunately for us, Hadoop provides gmond monitoring integration through org.apache.hadoop.metrics.ganglia.GangliaContext31, which is configured in hadoop-metrics.properties. A restart of the tasktracker is required for hadoop specific metrics to appear in the Ganglia web app.
/etc/init.d/hadoop-tasktracker restart
Ganglia Monitoring Server
We decided to install gmetad and the Ganglia web app on a standalone machine. Once again we found Installing ganglia-3.1.1 on Ubuntu 8.04 Hardy Heron very helpful in installing these two components. Once gmetad has been installed it needs to know which datasources to poll for metrics. To do this we added the following entries into /etc/ganglia/gmetad.conf:
data_source "master" master.hadoop:8650data_source "slave1" slave1.hadoop:8650data_source "slave2" slave2.hadoop:8650data_source "slave3" slave3.hadoop:8650data_source "slave4" slave4.hadoop:8650data_source "slave5" slave5.hadoop:8650
Finally, start gmetad to be see server metrics in the Ganglia web app (http://your.ganglia.host/ganglia).
0 0
- Monitoring Hadoop Clusters using Ganglia
- Monitoring Clusters With SNMP
- Monitoring with Ganglia
- 《Monitoring with Ganglia》 Chapter 1 Introducing Ganglia
- Monitoring WebLogic using JMX
- Monitoring WebLogic using JMX
- Continuous Monitoring Using CCMS
- activeMQ monitoring using JMX
- 《Monitoring with Ganglia》Chapter 2 Installing and Configuring Ganglia
- hadoop ganglia configuration
- 使用Ganglia监控Hadoop
- Ganglia监控Hadoop
- ganglia监控hadoop集群
- 利用ganglia调优hadoop
- Ganglia meeting Hadoop
- ganglia 监控 hadoop
- 用ganglia监控hadoop
- 安装Ganglia监控hadoop
- sql中 vacuum命令:回收空白空间,减少数据库大小
- Sql Server 2008/2005 数据库还原出现 3154错误(转)
- ReactiveCocoa链接专题
- sql的limit
- SVM对简单验证码的识别
- Monitoring Hadoop Clusters using Ganglia
- 学习分层和目标管理 适用于大多数大型项目 虽然这里是指学习开源项目 但有共通性
- 内联函数与宏
- linux内核线程的创建与销毁
- oracle之查询ddl建表语句
- YII后台admin登陆的代码
- Windows添加路径到PATH
- Ganglia meeting Hadoop
- 将一颗心在寂静中安放