Page MenuHomePhabricator

Jenkins: report metrics to statsd
Closed, ResolvedPublic

Description

bug 47884 was requesting some metrics to be reported regarding Jenkins using statsd. Since it was not possible at that time, the workaround was to use a Ganglia plugin (for gallium, the current Jenkins master: http://ganglia.wikimedia.org/latest/?c=Miscellaneous%20eqiad&h=gallium.wikimedia.org)

We recently reenabled statsd in the infrastructure using tungsten.eqiad.wmnet as an entry point. Hence I am copy pasting the original bug 47884 request:


Someone wrote a script to run in a cron that would send metrics about Jenkins
build executors:

http://velohacker.com/2012/01/12/graphing-jenkins-statistics/

https://github.com/katzj/jenkins-to-graphite

Would be nice to use this. We can then display the graph on the integration

portal or zuul status page.


Version: wmf-deployment
Severity: normal

Details

Reference
bz55412

Event Timeline

bzimport raised the priority of this task from to Needs Triage.Nov 22 2014, 2:12 AM
bzimport set Reference to bz55412.
bzimport added a subscriber: Unknown Object (MLST).

I have deployed the plugin a few days ago. The stats are send to Statsd and available in graphite under:

stats.jenkins.ci
stats.timers.jenkins.ci

Not sure what to do with them now though.

Note, I have build the jenkins-statsd-plugin available at https://github.com/joemiller/jenkins-statsd-plugin using the statsd prefix jenkins.ci

There is no informations regarding the jobs executors/queue status as provided by https://github.com/katzj/jenkins-to-graphite

I have filled https://github.com/joemiller/jenkins-statsd-plugin/issues/5 to ask features from the jenkins-to-graphite script to be ported in the Java plugin.

We are no more using this plugin. It was meant to generate graph for the executor queues but the Jenkins plugin does not collect them. Since reporting a metric for each of the jobs overkills Graphite, the plugin has been removed.

See:

https://phabricator.wikimedia.org/T1075 "something (reqstats?) puts many different metrics into graphite, allocating a lot of disk space"
https://phabricator.wikimedia.org/T1278 "Remove statsd plugin from Jenkins"