Page MenuHomePhabricator

Book upload customization
Open, LowPublicFeature

Description

The book upload customization is a suggested enhancement to the UploadWizart which would cater for the special needs of the Wikisource community. It would be activated as a campaign, and this parameter would activate some special features:

  • On the "Upload" screen there would be another button labeled as "Import book" which would activate a similar functionality as now provides the "Internet Archive Import tool" (https://toolserver.org/~tpt/iaUploadBot/step1.php).
  • On the "Describe" screen there would be an additional option to import external metadata from external sources either in MARC, BibJson or others. Currently MARCSMAN exists as a standalone tool (https://meta.wikimedia.org/wiki/MARCsman)
  • Extra data fields for books
  • Store all book meta data in the commons Template:Book (http://commons.wikimedia.org/wiki/Template:Book)
  • Create automatically an "Index:" page on Wikisource with the relevant data.
  • FUTURE: When Wikidata is deployed on Commons and Wikisoruce, create an item in Wikidata with book meta data and link the fields both in Commons and in Wikisource.

Version: unspecified
Severity: enhancement
See Also:
T51443: UW support for other templates than {{Information}} (eg {{Artwork}})

Event Timeline

bzimport raised the priority of this task from to Low.Nov 22 2014, 1:30 AM
bzimport added a project: UploadWizard.
bzimport set Reference to bz47561.
bzimport added a subscriber: Unknown Object (MLST).

This bug report covers several requests that should be in separate bug reports, as a bug report should only cover one request (otherwise it becomes unfixable). Could you split this please?

Just a note to say that Nazmul Chowdhury has submitted a GSoC proposal related to this report: http://www.mediawiki.org/wiki/User:Rasel160

Good luck!

Just a note to say that Tianhao Wang has submitted a GSoC proposal related to this report: https://www.mediawiki.org/wiki/User:Vvv214wth/UploadWizard

Increasing importance because this greatly impacts Wikisourcerors' ability to be effective in uploading.

From the POV of the Wikisource community, this project it is not only ESSENTIAL, it is CRUCIAL.

The reason is that currently, when a user wants to upload a book for it to be proofread in Wikisource, it has to go through the following painful process:

  1. upload the book file and fill out the fields thought for pictures (there are no special fields for book data)
  2. enter the book metadata manually (no possibility to import it from external sites)
  3. adjust (manually) the book metadata to the Template:Book in Commons
  4. create an "Index:" page in Wikisource and populate it with *exactly the same data*
  5. copy again *the same information* in the Author page.

The process is so long, confusing, exhausting and exasperating, that *discourages* users from uploading any book into Commons/Wikisource. Not to speak about the time wasted into repetitive tasks.

This process needs to be simplified and streamlined urgently so the user satisfaction can be increased. Happy contributors stay longer!

I assume the GSoC project would fix this bug/feature request.

GSoC "soft pencils down" date was yesterday and all coding must stop on 23 September. Has this project been completed?

Not as such - we got at least as far as implementing generic template support and integrating TemplateData, but Rasel160 has been busy (probably with school?) and we got tied up because of https://commons.wikimedia.org/wiki/Commons:Requests_for_comment/How_Commons_should_deal_with_TemplateData - this project will have to be in a semi-finished state, but there was good progress on it.

If you have open tasks or bugs left, one possibility is to list them at https://www.mediawiki.org/wiki/Google_Code-In and volunteer yourself as mentor.

We have heard from Google and free software projects participating in Code-in that students participating in this programs have done a great work finishing and polishing GSoC projects, many times mentores by the former GSoC student. The key is to be able to split the pending work in little tasks.

More information in the wiki page. If you have questions you can ask there or you can contact me directly.

Nazmul: Are you (still) working on this? If not, please reset the assignee to default and the status to NEW. Thanks!

Nazmul Chowdhury: I am resetting the assignee of this issue to default because there has been no progress in the last months. Feel free to take it again when you are actually planning to fix this. Thanks.

Status of this ticket is in comment 8.

(In reply to dacuetu from comment #0)

  • On the "Describe" screen there would be an additional option to import

external metadata from external sources either in MARC, BibJson or others.
Currently MARCSMAN exists as a standalone tool
(https://meta.wikimedia.org/wiki/MARCsman)

Was this done? Is there a bug report for it?

(In reply to Nemo from comment #12)

(In reply to dacuetu from comment #0)

  • On the "Describe" screen there would be an additional option to import

external metadata from external sources either in MARC, BibJson or others.
Currently MARCSMAN exists as a standalone tool
(https://meta.wikimedia.org/wiki/MARCsman)

Was this done? Is there a bug report for it?

No, it was not done and AFAIK there is no bug report for it. What was done can be found here:

https://www.mediawiki.org/wiki/Extension:UploadWizard/Book_upload_customization/Status

(In reply to dacuetu from comment #13)

No, it was not done and AFAIK there is no bug report for it.

Thanks. It would be useful to have a bug report with some requirement for one such minimal tool, see also my https://lists.wikimedia.org/pipermail/libraries/2014-October/000322.html

Change 66561 had a related patch set uploaded (by Nemo bis):
Will allow dynamic form generation in the details step

https://gerrit.wikimedia.org/r/66561

Change 66561 abandoned by Bartosz Dziewoński:
Will allow dynamic form generation in the details step

Reason:
I don't think this can be rescued, sorry :(

https://gerrit.wikimedia.org/r/66561

Filed https://meta.wikimedia.org/wiki/2017_Community_Wishlist_Survey/Multimedia_and_Commons/Improve_UploadWizard_campaigns . Shouldn't be too hard to do and would add the flexibility to upload other templates without cluttering up the main work flow.

Leaving aside the question of a book-oriented UploadWizard campaign, another solution to this ticket might be to add some extra functionality to IA Upload (which has continued development since this ticket was opened).

It already supports the {{book}} template, and imports metadata from the Internet Archive.

The missing parts are

  • importing metadata from MARC, BibJson etc.;
  • automatically creating Index pages (although the Index Fill gadget does this well);
  • creating a Wikidata item for the uploaded edition.

And the biggest difference to the proposed solution here is the additional step of uploading books to IA. This is a positive thing, though (I reckon!). Wikisource communities are very close with IA, as it's where a lot of books already exist, and so it makes sense to add to the archive there when we're adding to Wikisource.

Books in Wikimedia projects are present on all of Wikisource, Commons, Wikidata, and Internet Archive and so I think it makes sense to have a book-tool that's outside of these projects.

Aklapper changed the subtype of this task from "Task" to "Feature Request".Feb 4 2022, 11:13 AM