Page MenuHomePhabricator
Create Task
Maniphest T50407

Jenkins: Setup Vagrant for some jobs (tracking)
Closed, DeclinedPublic
Actions

Description

We could use Vagrant virtual boxes to run some tests. For example when the test need root access on a server or needs to alter a service which is already on the box (such as apache).

This is a tracking bug

Version: wmf-deployment
Severity: enhancement

Details

Reference
bz48407

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedhasharT60772 common gating job for mediawiki core and extensions
 ResolvedhasharT69216 Have unit tests of all wmf deployed extensions pass when installed together, in both PHP-Zend and HHVM (tracking)
 InvalidRyasmeenT90647 Create Jenkins builds for Editing across repositories (MobileFrontend, VisualEditor etc)
 DeclinedNoneT50407 Jenkins: Setup Vagrant for some jobs (tracking)
 ResolvedhasharT38443 have Jenkins build Debian packages for us
 ResolvedNoneT52318 Jenkins: debian package building should run piuparts
 DeclinedNoneT45266 Write and implement tests for Wikimedia's Apache configuration (redirects.conf, etc.)
 ResolvedhasharT47499 [EPIC] Run CI jobs in disposable VMs
 ResolvedhasharT55594 Jenkins: Configure jobs to be runnable on any slaves
 ResolvedhasharT55683 [OPS] publish Zuul git repositories over git protocol
 ResolvedhasharT56762 find a way to deploy PHPUnit on production machines
 ResolvedhasharT58317 Jenkins: Use phpunit from deployment system (srv/deployment/integration/phpunit) instead of local pear install
 DuplicateNoneT55978 Create labs project for continuous integration nodepool
 Resolvedbd808T53556 Investigate Linux containers
 DuplicateNoneT84988 Create labs project for CI disposables instances + OpenStack API credentials
 DeclinedNoneT84989 Support dedicating a specific virt node to a specific nova project
 DeclinedhasharT84940 Acquire old production API servers for use in CI
 ResolvedhasharT85933 Evaluate JClouds Jenkins plugin
 DeclinedNoneT86168 Isolate contintcloud nova project from the rest of the wmflabs cloud
 Declined• chasempT85611 Neutron networking, with IPv6 at eqiad
 DeclinedNoneT85609 Labs available in the new data centre (with Neutron/IPv6)
 ResolvedcorenT85605 Set storage service up in codfw
 InvalidhasharT86172 Write a migration plan for CI infra to the disposable VMs infrastructure
 ResolvedhasharT86171 Design the Jenkins isolation architecture
 DeclinedhasharT97472 Create a Trusty labs image for CI isolation project
 Resolved• CmjohnsonT86658 Phase out lanthanum.eqiad.wmnet
 Resolved• CmjohnsonT105901 wipe disks for lanthanum
 ResolvedhasharT86659 Migrate all jobs to labs slaves
 ResolvedKrinkleT86175 Migrate jsduck jobs to run in labs (and jsduck-publish via integration-publisher)
 ResolvedKrinkleT86174 Migrate JSDuck to Ubuntu Trusty
 ResolvedKrinkleT93143 Migrate .*testextension-zend jobs to labs slaves
 ResolvedhasharT93559 Migrate mediawiki-core-code-coverage job to labs
 ResolvedKrinkleT93558 Add publishing macro for integration.wikimedia.org/cover
 ResolvedhasharT96463 Move integration-zuul-layout* jobs to labs slaves
 ResolvedhasharT95675 Migrate Jenkins job "Global-Dev Dashboard Data" to JJB and Zuul trigger
 ResolvedhasharT98737 Migrate operations-dns-lint Jenkins job to labs instances
 ResolvedhasharT101966 Remove use of label "hasSlaveScripts" in jobs
 ResolvedhasharT87294 Nodepool images need Gerrit mirror for git-clone performance
 ResolvedAndrewT113394 Evaluate impact of giant VM images on labs infrastructure
 ResolvedKrinkleT91996 Consolidate jobs to test entry points
 ResolvedhasharT91997 Replace project-specific "{name}-thing" jobs with generic "thing" ones
 ResolvedKrinkleT91854 Migrate jsduck-publish to use a single job and variable destination path
 ResolvedPaladoxT90943 Convert existing legacy phpcs jobs to use composer entry point + versioning
 ResolvedLegoktmT91176 Create composer validate --no-check-publish job for MediaWiki extensions
 ResolvedLegoktmT92557 Create generic "tox" jobs
 ResolvedLegoktmT94326 Create generic qunit job for MediaWiki extensions
 ResolvedLegoktmT94327 Create generic phpunit job for MediaWiki extensions
 ResolvedPaladoxT126682 Convert all MediaWiki extension phpunit jobs to use generic jobs
 ResolvedLegoktmT127362 Switch passing mwext-*-jslint jobs to jshint/jsonlint
 ResolvedLegoktmT96690 Have extensions with dependencies use the generic mwext-testextension-* job
 ResolvedhasharT109913 [keyresult] boot instances from OpenStack API
 ResolvedhasharT86170 OpenStack API account to control `contintcloud` labs project
 ResolvedyuvipandaT86167 Create labs project for CI disposables instances

Event Timeline

• bzimport raised the priority of this task from to Medium.Nov 22 2014, 1:31 AM
• bzimport added a project: Continuous-Integration-Infrastructure.
• bzimport set Reference to bz48407.
• bzimport added a subscriber: Unknown Object (MLST).
hashar created this task.May 13 2013, 4:25 PM
Krinkle added a comment.Jun 25 2013, 7:37 PM
    1. Dependencies
  • Have one or more Jenkins slave(s)
  • Set up Zuul/Gerrit replication to those as well so that stuff is fast
    1. One time setup when we create/change or VM environment
  • Create an Ubuntu VM in Vagrant
  • Populate it with all the packages we need
  • Pause it
  • Upload to the Jenkins slave(s)
    1. On job
  • Jenkins master sends job to slave
  • Slave performs merge commit in its git repo
  • Copies our paused VM and boots the copy
  • Read-only mount our local git replication
  • SSH into VM
  • git-clone the repo by reference from the mounted directory
  • Start regular job commands
Krinkle added a comment.Jun 25 2013, 7:49 PM

Antoine and myself are both interested in this but we can't prioritise it right now due to other higher priorities.

We may get to it sporadically but otherwise we expect to start working on this in November 2013.

hashar added a comment.May 6 2014, 3:48 PM

Phasing this bug out in favor of the tracking bug:

Bug 45499 Jenkins should run tests in disposable sandboxes

Tgr mentioned this in T52614: Configure a Jenkins job for Vagrant builds.Feb 26 2015, 9:59 PM
Aklapper added a project: Tracking-Neverending.Aug 23 2015, 3:27 PM
Aklapper subscribed.

[adding the Tracking-Neverending project to tasks blocking (now deprecated) T4007 as part of T93366]

• demon unsubscribed.Aug 23 2015, 3:57 PM
Quiddity removed a parent task: T4007: [DO NOT USE] Tracking bug [superseded by #Tracking].Jul 14 2016, 2:05 AM
hashar closed subtask T45266: Write and implement tests for Wikimedia's Apache configuration (redirects.conf, etc.) as Declined.Sep 30 2016, 7:33 AM
Liuxinyu970226 moved this task from Tag to Transition completed / Archived on the Tracking-Neverending board.Dec 23 2018, 11:09 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL