Page MenuHomePhabricator
Create Task
Maniphest T29110

XML dumps development issues/bugs for 2011
Closed, DeclinedPublic
Actions

Description

Tracker bug for development issues/bugs for XML dumps development for 2011; see also
http://wikitech.wikimedia.org/view/Dumps/Development_2011
and
http://wikitech.wikimedia.org/view/Dumps/Development_status_2011

Version: unspecified
Severity: enhancement

Details

Reference
bz27110

Event Timeline

• bzimport raised the priority of this task from to Medium.Nov 21 2014, 11:23 PM
• bzimport added projects: Datasets-General-or-Unknown, Tracking-Neverending.
• bzimport set Reference to bz27110.
ArielGlenn created this task.Feb 2 2011, 6:32 PM
ArielGlenn closed subtask T29113: be able to restart history dump after breakage, from where it was interrupted as Declined.Nov 9 2015, 9:58 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 9 2015, 9:58 AM
ArielGlenn closed subtask T29125: Reruns of an old job should autodetect chunk and page range settings as Resolved.Feb 28 2016, 9:03 PM
Danny_B added a comment.Jul 8 2016, 11:17 PM

@ArielGlenn Title mentions 2011 - should be either retitled or closed... Please do whatever you think is most suitable... Thanks.

ArielGlenn added a comment.Jul 11 2016, 11:36 AM

There are some of these bugs that were imported from bugzilla and are no longer relevant. I need to go through and do a cleanup at some point.

ArielGlenn closed this task as Declined.Jul 14 2016, 7:00 PM
ArielGlenn removed subtasks: T29153: should be able to specify chunk numbers of job to rerun, as option on command line, T29148: output written to the console during a dump run should go to a local log file as well, T29122: When running one job from older dump date, all "latest" links are pointed to the old files, T29125: Reruns of an old job should autodetect chunk and page range settings, T29124: Progress bar for parallelized jobs shows report from only the chunk that updated last, T29123: Should be able to run some jobs from an XML dump at the same time, T29126: The bzip2 python stuff is really ugly. Maybe parts should be redone in C., T29121: ETA for XML dumps should give % prefetch for last 5 minutes as well as overall, T29117: "Progress bar" for jobs in parallel should have process ID in it, T29115: ETA for jobs that run in parallel is completely wrong, T29113: be able to restart history dump after breakage, from where it was interrupted, T29114: do we really need to recombine stub and page file chunks into single huge files?, T29112: Select of revisions for stub history files does not explicitly order revisions.

This task is going away. Any pending tasks are already in the Dumps-Generation project.

ArielGlenn moved this task from Backlog to Done on the Datasets-General-or-Unknown board.Jul 14 2016, 7:07 PM
Danny_B renamed this task from XML dumps development issues/bugs for 2011 (tracking) to XML dumps development issues/bugs for 2011.Jul 14 2016, 9:02 PM
Danny_B removed a parent task: T4007: [DO NOT USE] Tracking bug [superseded by #Tracking].
Danny_B removed a project: Tracking-Neverending.

Thanks for cleanup, @ArielGlenn

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL