Page MenuHomePhabricator
Create Task
Maniphest T31961

Special:Export of a single page with huge history occasionally forgets </page> and </mediawiki> closing tags
Open, MediumPublic
Actions

Description

Titles which gave problems

I exported some pages (one at time) with huge histories (700-1200 MiB) on http://wiki.guildwars.com/ and I got this: http://p.defau.lt/?T1uU_47VU1PSgvqoeIHbog

If you want to dig (not that it's useful, we know Special:Export and Special:Import are just crazy)...
Number of revisions etc.: http://p.defau.lt/?xmcOCZY6XANVbTILv_7Vtg
I fixed the xml in a stupid way: http://p.defau.lt/?eT1TFHvidKzMM4uZsoIpYg
Titles are attached (the first ones) and you can try to export them although I don't suggest to. Server is quite fast, I downloaded them at about 400 KiB/s if I remember correctly (usually such exports almost kill the server).
I'm compressing the xml files and I'll publish them soon.

Version: unspecified
Severity: minor

Attached:

RemovedTitles.txt280 BDownload

Details

Reference
bz29961

Related Objects

Event Timeline

• bzimport raised the priority of this task from to Medium.Nov 21 2014, 11:34 PM
• bzimport added a project: MediaWiki-Core-Snapshots.
• bzimport set Reference to bz29961.
• bzimport added a subscriber: Unknown Object (MLST).
Nemo_bis created this task.Jul 19 2011, 6:51 AM
• brion added a comment.Jul 19 2011, 4:40 PM

This probably indicates a fatal PHP error during output...

• brion added a comment.Jul 19 2011, 4:42 PM

If you have direct server access or can reach the site admin, check the web server error logs for messages.

Nemo_bis added a comment.Jul 19 2011, 5:15 PM

A fatal error that has as effect only those two missing tags, or do you mean that perhaps some more horrible thing happened (for instance some missing revisions)?
Files are here: http://www.archive.org/details/wiki.guildwars.com
Now I'll check the revisions and I'll try to contact sysadmins.

• bzimport added a comment.Jul 19 2011, 11:02 PM

EN.WP.ST47 wrote:

Probably that some more horrible thing happened. We're not unfamiliar with import and export crashing spontaneously on certain revisions, and it would be reasonable to assume that if export choked on a revision, it would simply stop output, resulting in no closing page tag, but with the last successfully exported revision being fully output. Did the pages get fully exported?

• brion added a comment.Jul 21 2011, 9:22 PM

*nod* export aggressively disables output buffering so it can push out arbitrarily long data. A failure between revisions, or between buffer flushes, would be expected to produce output that just stops between revisions or such.

Nemo_bis added a comment.Jul 21 2011, 9:30 PM

Yes, there were several thousands missing revisions. The actual numbers would be:
ArenaNet:Guild Wars 2 suggestions/Scratchpad (7832)
ArenaNet:Guild Wars suggestions/bigArchive (6107)
User talk:Gaile Gray (18192)
User talk:Isaiah Cartwright/Temp (8257)
User talk:Linsey Murdock/Temp (10474)
User talk:Regina Buenaobra/Temp (11452)

I redownloaded one of them but seems to have failed again. Probably not much to do except downloading history in chunks, but it would be nice to have a proper xml in some way.
Also, [[m:Help:Export#2._Perform_the_export]] says: «Open the XML file in a text editor. Scroll to the bottom to check for error messages», so apparently there are or used to be some error messages.

Nemo_bis added a comment.Aug 25 2012, 6:57 AM

(In reply to comment #6)

Also, [[m:Help:Export#2._Perform_the_export]] says: «Open the XML file in a
text editor. Scroll to the bottom to check for error messages», so apparently
there are or used to be some error messages.

Some there still are, see bug 39639.

Umherirrender mentioned this in T41639: Special:Export gives an invalid XML without warning upon fatals.Jan 2 2015, 3:46 PM
TTO mentioned this in T207974: Export with full history creates broken XML (missing end tag </page>).Oct 29 2018, 6:47 AM
ArielGlenn moved this task from Backlog to Snapshot export on the MediaWiki-Core-Snapshots board.Oct 29 2018, 10:06 AM
Stang subscribed.Apr 7 2022, 5:13 PM
Umherirrender mentioned this in T277766: PHP Warning: XMLReader::read(): .Nov 1 2022, 12:21 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL