Test duration
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	jayvdb
	Jul 27 2014, 11:37 AM

Description

The following tests take longer than 10s on travis-ci for the enwp py2.7 build

testQueryApiGetter (tests.wikidataquery_tests.TestApiSlowFunctions) ... 10.522s ok
...
testLinkMethods (tests.site_tests.TestSiteObject)
Test site methods for getting links to and from a page ... Retrieving 5 pages from wikipedia:en.
344.035s ok
...
testWebCiteOlder (tests.weblib_tests.TestArchiveSites) ... 16.051s ok
...
testLinks (tests.page_tests.TestPageObject) ... 15.409s ok
...

https://travis-ci.org/wikimedia/pywikibot-core/jobs/30944822

testLinkMethods is the worst, and many parts of it do not depend on the initialisation at the beginning of the method.

Version: core-(2.0)
Severity: major

Details

Reference: bz68671

	Subject	Repo	Branch	Lines +/-
	Run only site tests on fr.wikt and test.wd	pywikibot/core	master	+14 -3

Customize query in gerrit

Related Objects

Mentioned In: rPWBC37a9ea87ba4b: Run only site tests on fr.wikt and test.wd

Event Timeline

• bzimport raised the priority of this task from to Needs Triage.Nov 22 2014, 3:40 AM

• bzimport added a project: Pywikibot-tests.

• bzimport set Reference to bz68671.

• bzimport added a subscriber: Unknown Object (????).

jayvdb created this task.Jul 27 2014, 11:37 AM

Change 160192 had a related patch set uploaded by John Vandenberg:
Disable very slow tests

https://gerrit.wikimedia.org/r/160192

still need to fix the tests

https://travis-ci.org/wikimedia/pywikibot-core/jobs/40468767 - ar.wikipedia

testLinkMethods (tests.site_tests.TestSiteObject)
Test site methods for getting links to and from a page. ... Sleeping for 120.0 seconds, 2014-11-09 17:05:51
No output has been received in the last 10 minutes, this potentially indicates a stalled build or something wrong with the build itself.
The build has been terminated

All tests which use statically configured sites (aka family/code set or sites) only need to be run once. Maybe we can set a environment variable which doesn't execute such tests.

In fact there are also tests which don't need a site at all. Those together with the static sites could run the tests only once per version.

Aklapper added a project: Pywikibot.Nov 27 2014, 4:14 PM

jayvdb moved this task from Backlog to Framework on the Pywikibot-tests board.Nov 29 2014, 4:58 PM

Another locked up build, this time in ..

testLinks (tests.page_tests.TestPageObject) ...
No output has been received in the last 10 minutes, this potentially indicates a stalled build or something wrong with the build itself.
The build has been terminated

https://travis-ci.org/wikimedia/pywikibot-core/jobs/42813049

Change 178070 had a related patch set uploaded (by John Vandenberg):
Run only site tests on fr.wikt and test.wd

https://gerrit.wikimedia.org/r/178070

Patch-For-Review

Change 178070 merged by jenkins-bot:
Run only site tests on fr.wikt and test.wd

https://gerrit.wikimedia.org/r/178070

XZise mentioned this in rPWBC37a9ea87ba4b: Run only site tests on fr.wikt and test.wd.Mar 4 2015, 8:46 AM