Page MenuHomePhabricator

Mirrors built with `mwxml2sql' do not show list under Special:Gadgets, while mirrors built with `importDump.php' do
Open, LowPublic

Description

0) Abstract

If I build a mirror of zuwiki' with importDump.php', then I can see a list of gadgets on http://zu.wikipedia.site/wiki/Special:Gadgets.

If I build a mirror of zuwiki' with mwxml2sql', then I get no list of gadgets on http://zu.wikipedia.site/wiki/Special:Gadgets.

This difference also appears with `simplewiki'.

  1. Setup

1.1) Hardware and Debian distribution

(shell) uname -a
Linux darkstar-5 3.2.0-4-amd64 #1 SMP Debian 3.2.54-2 x86_64 GNU/Linux
(shell) cat /etc/debian_version
7.4

1.2) mediawiki and extensions

I clone' latest version of mediawiki' (currently 1.23) and many of its extensions including `Gadget'.

(shell) git clone https://gerrit.wikimedia.org/r/p/mediawiki/core
(shell) cd extensions
(shell) git clone https://gerrit.wikimedia.org/r/p/mediawiki/extensions/Gadgets.git

`LocalSettings.php' includes the line:
require_once( "$IP/extensions/Gadgets/Gadgets.php" );

1.3) mwxml2sql

I use the version that I patched (to be compatible with `mediawiki' 1.23) and uploaded to gerrit for review.

1.4) dumps

(shell) rsync ftpmirror.your.org::wikimedia-dumps/zuwiki/20140225/zuwiki-20140225-categorylinks.sql.gz
(shell) rsync ftpmirror.your.org::wikimedia-dumps/zuwiki/20140225/zuwiki-20140225-category.sql.gz
(shell) rsync ftpmirror.your.org::wikimedia-dumps/zuwiki/20140225/zuwiki-20140225-externallinks.sql.gz
(shell) rsync ftpmirror.your.org::wikimedia-dumps/zuwiki/20140225/zuwiki-20140225-imagelinks.sql.gz
(shell) rsync ftpmirror.your.org::wikimedia-dumps/zuwiki/20140225/zuwiki-20140225-image.sql.gz
(shell) rsync ftpmirror.your.org::wikimedia-dumps/zuwiki/20140225/zuwiki-20140225-interwiki.sql.gz
(shell) rsync ftpmirror.your.org::wikimedia-dumps/zuwiki/20140225/zuwiki-20140225-iwlinks.sql.gz
(shell) rsync ftpmirror.your.org::wikimedia-dumps/zuwiki/20140225/zuwiki-20140225-langlinks.sql.gz
(shell) rsync ftpmirror.your.org::wikimedia-dumps/zuwiki/20140225/zuwiki-20140225-pagelinks.sql.gz
(shell) rsync ftpmirror.your.org::wikimedia-dumps/zuwiki/20140225/zuwiki-20140225-page_props.sql.gz
(shell) rsync ftpmirror.your.org::wikimedia-dumps/zuwiki/20140225/zuwiki-20140225-page_restrictions.sql.gz
(shell) rsync ftpmirror.your.org::wikimedia-dumps/zuwiki/20140225/zuwiki-20140225-pages-articles.xml.bz2
(shell) rsync ftpmirror.your.org::wikimedia-dumps/zuwiki/20140225/zuwiki-20140225-protected_titles.sql.gz
(shell) rsync ftpmirror.your.org::wikimedia-dumps/zuwiki/20140225/zuwiki-20140225-redirect.sql.gz
(shell) rsync ftpmirror.your.org::wikimedia-dumps/zuwiki/20140225/zuwiki-20140225-site_stats.sql.gz
(shell) rsync ftpmirror.your.org::wikimedia-dumps/zuwiki/20140225/zuwiki-20140225-stub-articles.xml.gz
(shell) rsync ftpmirror.your.org::wikimedia-dumps/zuwiki/20140225/zuwiki-20140225-templatelinks.sql.gz

  1. Build mirror with `importDump.php'

mysql> drop database zuwiki;
mysql> create database zuwiki;
(shell) bunzip2 zuwiki-20140225-pages-articles.xml.bz2
(shell) php /usr/share/mediawiki/maintenance/importDump.php zuwiki-20140225-pages-articles.xml

Test:

http://zu.wikipedia.site/wiki/Special:Gadgets displays a list of gadgets.

  1. Build mirror with `mwxml2sql'

mysql> drop database zuwiki;
mysql> create database zuwiki;
(shell) mwxml2sql -m 1.23 -s zuwiki-20140225-stub-articles.xml -t zuwiki-20140225-pages-articles.xml -f zuwiki-20140225.sql
(shell) mysql --host=localhost --user=root --password zuwiki < zuwiki-20140225-createtables.sql-1.23
(shell) mysql --host=localhost --user=root --password zuwiki < zuwiki-20140225-page.sql-1.23
(shell) mysql --host=localhost --user=root --password zuwiki < zuwiki-20140225-revision.sql-1.23
(shell) mysql --host=localhost --user=root --password zuwiki < zuwiki-20140225-text.sql-1.23
(shell) mysql --host=localhost --user=root --password zuwiki < zuwiki-20140225-categorylinks.sql
(shell) mysql --host=localhost --user=root --password zuwiki < zuwiki-20140225-category.sql
(shell) mysql --host=localhost --user=root --password zuwiki < zuwiki-20140225-externallinks.sql
(shell) mysql --host=localhost --user=root --password zuwiki < zuwiki-20140225-imagelinks.sql
(shell) mysql --host=localhost --user=root --password zuwiki < zuwiki-20140225-image.sql
(shell) mysql --host=localhost --user=root --password zuwiki < zuwiki-20140225-interwiki.sql
(shell) mysql --host=localhost --user=root --password zuwiki < zuwiki-20140225-iwlinks.sql
(shell) mysql --host=localhost --user=root --password zuwiki < zuwiki-20140225-pagelinks.sql
(shell) mysql --host=localhost --user=root --password zuwiki < zuwiki-20140225-page_props.sql
(shell) mysql --host=localhost --user=root --password zuwiki < zuwiki-20140225-page_restrictions.sql
(shell) mysql --host=localhost --user=root --password zuwiki < zuwiki-20140225-protected_titles.sql
(shell) mysql --host=localhost --user=root --password zuwiki < zuwiki-20140225-redirect.sql
(shell) mysql --host=localhost --user=root --password zuwiki < zuwiki-20140225-site_stats.sql
(shell) mysql --host=localhost --user=root --password zuwiki < zuwiki-20140225-templatelinks.sql

Test:

http://zu.wikipedia.site/wiki/Special:Gadgets does not show a list of gadgets.


Version: unspecified
Severity: normal
OS: Linux
Platform: PC

Details

Reference
bz62560

Event Timeline

bzimport raised the priority of this task from to Low.Nov 22 2014, 3:02 AM
bzimport set Reference to bz62560.

(In reply to wp mirror from comment #0)

1.3) mwxml2sql

I use the version that I patched (to be compatible with `mediawiki' 1.23)
and uploaded to gerrit for review.

Link to the Gerrit change welcome.

(In reply to Andre Klapper from comment #1)

(In reply to wp mirror from comment #0)

1.3) mwxml2sql

I use the version that I patched (to be compatible with `mediawiki' 1.23)
and uploaded to gerrit for review.

Link to the Gerrit change welcome.

https://gerrit.wikimedia.org/r/#/c/113124/

See https://gerrit.wikimedia.org/r/#/c/347625/ which should address these issues. Note that shortly these utilities will move to their own repo (TBA once it's available) and removed from the dumps ariel branch.

Aklapper added subscribers: ArielGlenn, Aklapper.

@ArielGlenn: Hi, I'm resetting the task assignee due to inactivity. Please feel free to reclaim this task if you plan to work on this - it would be welcome! Also see https://www.mediawiki.org/wiki/Bug_management/Assignee_cleanup for more information - thanks!