Page MenuHomePhabricator

Schedule jobs to run "extensions/UploadWizard/test/api/upload-wizard_tests.py' at appropriate times.
Closed, ResolvedPublic

Description

Author: aarcos.wiki

Description:
Basic smoke tests for the UploadWizard have been created, they need to be run for the following use cases:

0) Sanity checks before deployment of a release to any of our environments (alpha, beta, prod). These and other integration/end-to-end tests should be run and if failures found the deployment stops.

  1. These tests and other end-to-end tests can be run continuously against production to check the sanity of the UploadWizard functionality, once/twice a day.

Version: master
Severity: enhancement

Details

Reference
bz58923

Event Timeline

bzimport raised the priority of this task from to Medium.Nov 22 2014, 2:23 AM
bzimport added a project: UploadWizard.
bzimport set Reference to bz58923.

aarcos.wiki wrote:

First step will be to run this agains production every 6h and notify 'multimedia@lists.wikimedia.org' and #wikimedia-multimedia if something goes wrong.

Hi Aaron, I think it's good to figure out some visible place for these alerts, but please don't use the multimedia@ mailing list (or any mailing list primarily focused on human discussion) for automated alerts. There are 120 subscribers to the mailing list right now, most of which can't do anything about the alerts, and some of which don't particularly care about production issues on our sites because they're interested in multimedia features in MediaWiki on their sites. If we need to use a currently existing mailing list, we should ask about using operations@, since that one already has ample precedent for automated alerts of system health.

Change 108924 had a related patch set uploaded by Zfilipin:
WIP Run UploadWizard API tests at CloudBees

https://gerrit.wikimedia.org/r/108924

For related discussion on QA mailing list, search for "Run UploadWizard API integration test against production" at http://lists.wikimedia.org/pipermail/qa/2014-January/date.html#start

I have started working on this[1][2]. Looks like there is a problem[3]:

...
+ DEV/bin/pip install -rtest/api/requirements.txt
Downloading/unpacking wikitools>=1.1 (from -r test/api/requirements.txt (line 1))

Downloading wikitools-1.1.1.tar.gz
Running setup.py (path:/scratch/jenkins/workspace/UploadWizard-commons.wikimedia.org/DEV/build/wikitools/setup.py) egg_info for package wikitools

Downloading/unpacking poster>=0.8 (from -r test/api/requirements.txt (line 2))

Downloading poster-0.8.1.tar.gz
Running setup.py (path:/scratch/jenkins/workspace/UploadWizard-commons.wikimedia.org/DEV/build/poster/setup.py) egg_info for package poster

Downloading/unpacking PIL>=1.1.7 (from -r test/api/requirements.txt (line 3))

Could not find any downloads that satisfy the requirement PIL>=1.1.7 (from -r test/api/requirements.txt (line 3))
Some externally hosted files were ignored (use --allow-external PIL to allow).

Cleaning up...
No distributions at all found for PIL>=1.1.7 (from -r test/api/requirements.txt (line 3))
...

1: https://wmf.ci.cloudbees.com/view/r-uw/
2: https://gerrit.wikimedia.org/r/#/c/108924/
3: https://wmf.ci.cloudbees.com/view/r-uw/job/UploadWizard-commons.wikimedia.org/2/console

Change 109080 had a related patch set uploaded by Zfilipin:
WIP Using PIL 1.1.6 instead of 1.1.7

https://gerrit.wikimedia.org/r/109080

Change 109080 merged by jenkins-bot:
Change requirements.txt so that PIL actually installs on Cloudbees

https://gerrit.wikimedia.org/r/109080

Change 109661 had a related patch set uploaded by Zfilipin:
MEDIAWIKI_PASSWORD_VARIABLE environment variable points to the variable that contains the password

https://gerrit.wikimedia.org/r/109661

Change 109680 had a related patch set uploaded by Zfilipin:
WIP Run UploadWizard API integration test

https://gerrit.wikimedia.org/r/109680

Change 108924 abandoned by Zfilipin:
WIP Run UploadWizard API tests at CloudBees

Reason:
moved to https://gerrit.wikimedia.org/r/#/c/109680/

https://gerrit.wikimedia.org/r/108924

Change 109680 merged by Cmcmahon:
WIP Run UploadWizard API integration test

https://gerrit.wikimedia.org/r/109680

Change 109871 had a related patch set uploaded by Zfilipin:
WIP Run UploadWizard API integration test

https://gerrit.wikimedia.org/r/109871

Change 109661 merged by jenkins-bot:
Add functionality to specify the MEDIAWIKI_PASSWORD_VARIABLE environment variable that points to the variable that contains the password

https://gerrit.wikimedia.org/r/109661

Marked as resolved. Please reopen is something still needs to be done.

Change 109871 merged by jenkins-bot:
Run UploadWizard API integration test

https://gerrit.wikimedia.org/r/109871

Gilles raised the priority of this task from Medium to Unbreak Now!.Dec 4 2014, 10:24 AM
Gilles moved this task from Untriaged to Done on the Multimedia board.
Gilles lowered the priority of this task from Unbreak Now! to Medium.Dec 4 2014, 11:23 AM