Page MenuHomePhabricator

Create also 'stable versions only' dumps for wikis with FlaggedRevs
Open, LowestPublicFeature

Description

Author: Wiki.Melancholie

Description:
Create also 'stable versions only' dumps for wikis with FlaggedRevs.
Beside the 'latest' dumps there should be reliable latest stable ('reviewed') dumps.


Version: unspecified
Severity: enhancement
URL: http://download.wikimedia.org/backup-index.html

Details

Reference
bz17189

Event Timeline

bzimport raised the priority of this task from to Medium.Nov 21 2014, 10:29 PM
bzimport set Reference to bz17189.

Wiki.Melancholie wrote:

Is r47947 active for dump creation?
There is no 'stable dump' at http://download.wikimedia.org/dewiktionary/latest/ (2009-04-16).

The dumper must be run with -stable for wikis in the flaggedrevs dblist at worker.py. I can't tell how that file works. Brion, can you look at that?

Tomasz, can you poke at that when you have a chance? Thanks!

We'd want to pull flaggedrevs.dblist I suppose so we only run that on the wikis with FR set up.

Nemo_bis lowered the priority of this task from Medium to Lowest.Apr 9 2015, 7:12 AM
Nemo_bis added subscribers: Kelson, Nemo_bis.

I'm not sure this is really in scope for XML dumps. @Kelson, do you think such a feature can/should be implemented in mwoffliner.

It's for sure feasible. How much work is necessary to achieve this is unclear to me. My motivation is not on the top to work on that now, but "yes" this should probably be done sometime. I tend to think that Mediawiki instances using FlaggedRevision to curate their content should have HTML snapshots based on it (so no "stable" additional snapshots).

Thanks Kelson. Whoever is interested in this feature please send bugs/patches to the kiwix repo. :)

I see this has languished for some time. @Kelson, is this moving on the kiwix end? Should I just add this step to the regular xml dumps on our end?

Aklapper added a subscriber: ArielGlenn.

@ArielGlenn: Hi, I'm resetting the task assignee due to inactivity. Please feel free to reclaim this task if you plan to work on this - it would be welcome! Also see https://www.mediawiki.org/wiki/Bug_management/Assignee_cleanup for more information - thanks!

Aklapper changed the subtype of this task from "Task" to "Feature Request".Feb 4 2022, 11:02 AM
Aklapper removed a subscriber: Tfinc.