Page MenuHomePhabricator

preloading using multiple properties does not work
Closed, ResolvedPublic

Description

interwiki uses the templates=True and langlinks=True functionality provided by APISite.preloadpages

site.preloadpages(pageGroup, templates=True, langlinks=True)

However, it does not work. Continuation for langlinks & templates fails. Only the revisions continuation is performed.

I presume it has never worked, as the commit that added it did not do anything related to handling of multiple continuations

http://git.wikimedia.org/commit/pywikibot%2Fcore.git/aa8739dc5ff876b71e42cc8158df42f2860261c8


Version: core-(2.0)
Severity: major

Details

Reference
bz73461

Event Timeline

bzimport raised the priority of this task from to High.Nov 22 2014, 4:00 AM
bzimport set Reference to bz73461.
bzimport added a subscriber: Unknown Object (????).

Change 173499 had a related patch set uploaded by John Vandenberg:
Preloading tests

https://gerrit.wikimedia.org/r/173499

As far as I can see, only interwiki uses this.
This bug is not causing errors, but langlinks & templates are not being preloaded, so interwiki is operating much slower than it would in compat.

A quick update: https://gerrit.wikimedia.org/r/#/c/173630/ improved the efficiency of the query generator underneath preloading , so much that it actually removed (hid) some of the preloading bugs.

test_preload_templates is consistently passing on en.wp, test.wd, fr.wikt, however it occasionally fails on ar.wp; usually all platforms fail together. e.g.
https://travis-ci.org/wikimedia/pywikibot-core/builds/42379426
https://travis-ci.org/wikimedia/pywikibot-core/builds/42379426

I'm not able to deduce what might be causing those irregular failures; my only (and probably wrong) guess is that the test is finding pages on ar.wp that dont have any templates.

Xqt claimed this task.
Xqt subscribed.

Tests passes