Page MenuHomePhabricator

Bugzilla Weekly Report to wikitech-l@ fails due to move: "DB connection failure FAILED"
Closed, ResolvedPublic

Description

See http://lists.wikimedia.org/pipermail/wikitech-l/2014-February/074511.html

Sent from kaulen in pmtpa, but BZ got moved to zirconium in eqiad.

Sam guesses it's not using db9/db10 which is the problem.


Version: unspecified
Severity: major

Details

Reference
bz61453

Event Timeline

bzimport raised the priority of this task from to Unbreak Now!.Nov 22 2014, 2:59 AM
bzimport set Reference to bz61453.
bzimport added a subscriber: Unknown Object (MLST).

(In reply to Alex Monk from comment #0)

See http://lists.wikimedia.org/pipermail/wikitech-l/2014-February/074511.html

Sent from kaulen in pmtpa, but BZ got moved to zirconium in eqiad.

Sam guesses it's not using db9/db10 which is the problem.

It being bugzilla. I'm guessing the script is still using db9/10

I'm also guessing this cronjob is probably not puppeti[sz]ed? ;)

deleted old cron jobs on kaulen. the actual problem was just removing the old crons on the old server, I'd say. remember, puppet doesn't remove anything and we sure did not want to keep it as "ensure => absent" on kaulen forever.

Sam, actually.. no, I puppetized that:) We also had DB host and pass replaced by variables.. but the oversight was a hardcoded value left for the db _name. We just switched that from "bugzilla3" to simply "bugzilla" on db1001, because we wanted to clean up the old databases and by now it's BZ4 anyways..

https://gerrit.wikimedia.org/r/#/c/113961/

arg, yea yea, the script was puppetized, the user was.. all but the actual cron command. I added it manually and sent the report to Krenair and Andre.. Now we just gotta check if wikitech-l accepts the sender. I'll fix the cron before the next report.

haha, nice, wikitech-l sender filters: reporter@isidore.wikimedia.org

<-- set to zirconium instead (how did this ever work from kaulen?:)

Filter rules to match against the headers of a message.:python vs php

wut?:)

so after fixing the sender filter on the list side and also fixing the mail command (it changed between distros):

http://lists.wikimedia.org/pipermail/wikitech-l/2014-February/074555.html

please keep open to make me put the manual change into puppet

(In reply to Daniel Zahn from comment #7)

please keep open to make me put the manual change into puppet

ping

merged, confirmed on zirconium.

that just puppetized the live hack which was already working. so we should be done here.

notice: /Stage[main]/Bugzilla::Reporter/Cron[bugzilla_reporter_cron]/ensure: created

before, manual tmp. fix:

0 03 * * mon php -q /home/reporter/bugzilla_report.php | mail -s "Bugzilla Weekly Report" wikitech-l@lists.wikimedia.org > /dev/null

now, puppet:

0 3 * * 1 php -q /home/reporter/bugzilla_report.php | mail -s "Bugzilla Weekly Report" wikitech-l@lists.wikimedia.org > /dev/null

also removed the manual one and ran puppet twice. closing.