Wednesday, 23 July 2014

Ganglia on Amazon Linux (and other RedHat derivatives)

The below is for setting up unicast, not multicast. AWS does not support multicast networking.

Key concepts: gmond daemons run on every server and use C code to collect the server's stats; this data is stored in local memory. Multiple gmonds can send their data on to one central gmond to hold, call this a gmond "bank"; this "bank" also uses only memory to store the server stats. gmetad comes along and collects the data from the gmond "banks" and stores in it rrds, these are files; the web interface uses these rrd files, and it usually runs on the same server as gmetad.

Cluster name: cluster name is key in grouping data and getting it from gmond to gmond and then on to gmetad. data_source is the way gmetad find the "banks"; and, by the way, you can have redundant "banks" for one cluster data_source.

Getting rid of multicast settings: comment out all references to multicast: bind_hostname, mcast_join, bind. Comment them all out.

UDP vs TCP, and port 8649: port 8649 is the default. UDP traffic on port 8649 is used for gmond intercommunication. And TCP traffic on port 8649 is used by the gmetad daemon to pull data from all your gmond "banks". Run "tcpdump -i any -nn port 8649" ALL THE TIME ON EVERY SERVER in a separate terminal when debugging.

Source: http://www.admin-magazine.com/HPC/Articles/Monitoring-HPC-Systems
  1. mkdir ganglia_rpms
  2. cd ganglia_rpms/
  3. wget http://vuksan.com/centos/RPMS-6/x86_64/ganglia-gmond-3.6.0-1.x86_64.rpm
  4. wget http://vuksan.com/centos/RPMS-6/x86_64/libganglia-3.6.0-1.x86_64.rpm
  5. wget http://vuksan.com/centos/RPMS-6/x86_64/ganglia-debuginfo-3.6.0-1.x86_64.rpm
  6. wget http://vuksan.com/centos/RPMS-6/x86_64/ganglia-devel-3.6.0-1.x86_64.rpm
  7. wget http://vuksan.com/centos/RPMS-6/x86_64/ganglia-gmetad-3.6.0-1.x86_64.rpm
  8. wget http://vuksan.com/centos/RPMS-6/x86_64/ganglia-gmond-modules-python-3.6.0-1.x86_64.rpm
  9. wget http://vuksan.com/centos/RPMS-6/x86_64/libconfuse-2.6-2.el6.rf.x86_64.rpm
  10. wget http://vuksan.com/centos/RPMS-6/x86_64/libconfuse-devel-2.6-2.el6.rf.x86_64.rpm
  11. yum localinstall ganglia-*.rpm lib*.rpm
  12. yum install httpd
  13. yum install php
  14. cd
  15. mkdir ganglia-web-dev
  16. cd ganglia-web-dev/
  17. wget http://downloads.sourceforge.net/project/ganglia/ganglia-web/3.5.12/ganglia-web-3.5.12.tar.gz
  18. tar zxvf ganglia-web-3.5.12.tar.gz
  19. cd ganglia-web-3.5.12
  20. vi Makefile 
    1. GDESTDIR = /var/www/html/ganglia
    2. APACHE_USER = apache
  21. make install
  22. cp apache.conf /etc/httpd/conf.d/ganglia.conf
  23. vi /etc/httpd/conf.d/ganglia.conf 
    1. /usr/share/ganglia-webfrontend -> /var/www/html/ganglia
  24. service httpd start
  25. setenforce 0 
    1. not needed on Amazon Linux
  26. vi /etc/ganglia/gmond.conf
  27. vi /etc/ganglia/gmetad.conf
  28. service gmond start
  29. service gmetad start

No comments:

Post a Comment

Note: only a member of this blog may post a comment.

Interview questions: 2020-12

Terraform provider vs provisioner Load balancing Network Load Balancer vs Application Load Balancer  Networking Layer 1 vs Layer 4 haproxy u...