Page MenuHomePhabricator

Increase Commons file size upload limit to 40MB
Closed, ResolvedPublic

Description

Author: brianna.laugher

Description:
There are three main benefits to increasing the file size limit from the current 20MB to 40MB.

  1. Audio files - Spoken Wikipedia - avoid having to split one article into 2 sound files.
  2. Video - easily passes the 20mb limit quickly.
  3. DJVU files for Wikisource - avoid having to split one book into multiple files. See e.g. http://en.wikisource.org/wiki/Sacred_Books_of_the_East - some of the listed texts are currently hosted on the Internet Archive, but can't be uploaded at Commons without splitting or fiddling around with downsampling.

Last major discussion about it that I am aware of is http://lists.wikimedia.org/pipermail/wikitech-l/2007-October/034344.html
Tim: "My tentative answer would be that I don't think we're very far ahead of
the growth curve on storage. I don't know how expensive it will be or
whether we will be able to deploy new hardware fast enough. Our record for
deployment of storage hardware has been pretty poor."

So whenever that changes, please reconsider this bug.


Version: unspecified
Severity: enhancement

Details

Reference
bz12595

Event Timeline

bzimport raised the priority of this task from to Medium.Nov 21 2014, 10:05 PM
bzimport set Reference to bz12595.
bzimport added a subscriber: Unknown Object (MLST).

I don't think there would result in a much higher storage requirement by bumping up to 40 megs, first of is that splitted files wont take any more space than one combined, second is that most data will be far under that limit

rememberthedot wrote:

Ah. I've been wondering why I couldn't upload LibriVox recordings bigger than 20 MB. Please up the limit so that we can make Wikisource more accessible.

mlwadd01 wrote:

I have bumped into this limit when uploading ogg sound files of historic speeches, recordings of public domain works, and djvu files of books. It does not save space to split these files up (which is what I've been doing) -- in fact, it uses more space. And it is more work for uploaders like me, and a worse viewing or listening experience for users. 40meg would exceed any need I've so far encountered. All the best, User:Quadell.

lar wrote:

If there is a concern about space maybe a scheme that requires files over 20M to get "preapproval" might be an approach. Hopefully this is not needed but I thought I'd throw it out there. In fact with preapproval (by an admin?) the upper limit could be a lot higher than 40M, IMHO.

This would also be helpful for WikiProject Free music on Wikipedia:
http://en.wikipedia.org/wiki/Wikipedia:WikiProject_Free_music
I work mostly with classical music, and there are several works that I can't upload to Commons without reducing their quality because they are over 20 MB. See:
http://lists.wikimedia.org/pipermail/wikitech-l/2008-April/037523.html

mattwj2002 wrote:

We have started a discussion on the Wikimedia Commons http://commons.wikimedia.org/wiki/Commons:Village_pump#20_MB_upload_limit_is_too_low. Most people agree that the 20 MB limit is too low. There is a lot of video, audio, books, music, etc that is over the limit. With such a low limit we are reducing the quality and the quantity of the content available on the Commons. I also agree we need at very least need a way to over ride it. Whether or not you agree with these opinions, please come and leave a comment.

Bryan.TongMinh wrote:

(In reply to comment #6)

We have started a discussion on the Wikimedia Commons
http://commons.wikimedia.org/wiki/Commons:Village_pump#20_MB_upload_limit_is_too_low.
Most people agree that the 20 MB limit is too low. There is a lot of video,
audio, books, music, etc that is over the limit. With such a low limit we are
reducing the quality and the quantity of the content available on the Commons.
I also agree we need at very least need a way to over ride it. Whether or not
you agree with these opinions, please come and leave a comment.

As I already wrote in that thread brion has already commented on this:

Brion Vibber CTO: "When disk space is expanded... machines are on their way... :)"

Any news about this? BTW even 40 MB seems to be insufficient for DJVU files for Wikisource. I have several DJVU files larger than 40 MB.

40 MB will also be ineffective to assist Wikisource, which needs certain people to be able to upload much larger files in order for work to continue. For example, these djvu files are _large_:

http://homepages.uc.edu/~armstrty/statutes.html

Unless there is a 100MB limit, Wikisource contributors are going to need to split some of the volumes, like I have done with Volume 1.

http://en.wikisource.org/wiki/United_States_Statutes_at_Large/Volume_1

No news, still waiting on promised machines.

brianna.laugher wrote:

So, given the Frank Stanton Foundation donation announcement [http://lists.wikimedia.org/pipermail/foundation-l/2008-July/044905.html], can we expect this limit to be lifted "in a few months"?

Any news since August? Thanks, Yann

<Bryan> brion: when can we get larger uploads?
<brion> Bryan: when we have time to update the packages w/ updated configuration and ensure it's installed everywhere

The fundraiser stuff is the top priority right now, but this is "on the list."

mattwj2002 wrote:

Any idea how big the increase will be? I really hope it is a 100 MB or more. We need that size to be practical for video on the Commons and djvu files on Wikisource. Thanks, Matt.

brianna.laugher wrote:

According to Brion (via CNET) it will be 100MB.

http://news.cnet.com/8301-17939_109-10103177-2.html