Page MenuHomePhabricator

2000px thumbnail not deleted from (swift?) on action=purge
Closed, DeclinedPublic

Description

Author: rriuslaw

Description:
When uploading a new version of a file, the new version should displace the old one. However, the software is not behaving itself at Commons:File:41st_Can_Senate.svg. After four days and dozens of purges and hard reloads, as well as using different browsers and having others on En and Commons check, the old version of the image is still the one that displays on the file page, displays at articles where the image is used, and downloads when clicking the download button (and right click > save image as). Oddly, the thumbs updated correctly and the image will display correctly when adding a question mark and any text after the name of the file (e.g., http://upload.wikimedia.org/wikipedia/commons/4/41/41st_Can_Senate.svg is the old version, but http://upload.wikimedia.org/wikipedia/commons/4/41/41st_Can_Senate.svg?blah is the new).

See http://commons.wikimedia.org/wiki/Commons:Village_pump#Trouble_with_uploading_new_versions


Version: unspecified
Severity: normal
OS: Windows 7
Platform: PC
See Also:
https://bugzilla.wikimedia.org/show_bug.cgi?id=41130
https://bugzilla.wikimedia.org/show_bug.cgi?id=47087
https://bugzilla.wikimedia.org/show_bug.cgi?id=48927

Details

Reference
bz44269

Event Timeline

bzimport raised the priority of this task from to Medium.Nov 22 2014, 1:34 AM
bzimport set Reference to bz44269.
bzimport added a subscriber: Unknown Object (MLST).

This is a dupe of something. Not sure which bug is most appropriate.

  • This bug has been marked as a duplicate of bug 41130 ***

For the *original file* (not: thumbnail), https://commons.wikimedia.org/wiki/File:41st_Can_Senate.svg seems to list the correct version from Jan25?

While the main picture is correct, the 2000px thumbnail at http://upload.wikimedia.org/wikipedia/commons/thumb/4/41/41st_Can_Senate.svg/2000px-41st_Can_Senate.svg.png still shows the old version for me. This is covered in bug 41130.

rriuslaw wrote:

The main image is also correct for me, but you are right: something is wrong with the thumb you linked to. It is actually showing the version uploaded on 20 July 2012, 10 uploads ago.

The main image was bug 41130 and got fixed by in the brief period when that bug was "fixed" (in my opinion anyhow)

However the 2000px image is something else. It is not being cached by varnish so the bad thumb is coming directly out of swift (as far as I can tell. Not that familiar with swift). It does not appear to be deleted on action=purge of the image desc page. (Unduping to bug 41130)

Accessing via north america:
HTTP/1.1 200 OK
Server: nginx/1.1.19
Date: Mon, 28 Jan 2013 22:26:12 GMT
Content-Type: image/png
Content-Length: 12706
Connection: keep-alive
X-Object-Meta-Sha1base36: 6qmddcqcdyix5etlu1xrronvkhttqak
Last-Modified: Sat, 21 Jul 2012 19:20:18 GMT
Etag: dfbb5fab4a113944065657576e5e0c72
X-Timestamp: 1342898418.63822
Access-Control-Allow-Origin: *
X-Varnish: 3501037883, 1089133490
Via: 1.1 varnish, 1.1 varnish
Accept-Ranges: bytes
Age: 0
X-Cache: cp1021 miss (0), cp1030 frontend miss (0)

Of particular interest, always seems to be a cache miss. These headers are from the third time in a row that I accessed the image

(In reply to comment #4)

Of particular interest, always seems to be a cache miss. These headers are
from
the third time in a row that I accessed the image

Not always, from Europe, but result doesn't change.

$ wget -S https://upload.wikimedia.org/wikipedia/commons/thumb/4/41/41st_Can_Senate.svg/2000px-41st_Can_Senate.svg.png
[...]

HTTP/1.1 200 OK
Server: nginx/1.1.19
Date: Mon, 28 Jan 2013 21:45:01 GMT
Content-Type: image/png
Content-Length: 12706
Connection: keep-alive
X-Object-Meta-Sha1base36: 6qmddcqcdyix5etlu1xrronvkhttqak
Last-Modified: Sat, 21 Jul 2012 19:20:18 GMT
Etag: dfbb5fab4a113944065657576e5e0c72
X-Timestamp: 1342898418.63822
Access-Control-Allow-Origin: *
X-Varnish: 3497201383, 1468200824 1468081154, 1275272057
Via: 1.1 varnish, 1.1 varnish, 1.1 varnish
Accept-Ranges: bytes
Age: 67
X-Cache: cp1021 miss (0), cp3009 hit (1), cp3010 frontend miss (0)

Lunghezza: 12706 (12K) [image/png]

[...]

$ wget -S "http://commons.wikimedia.org/w/thumb.php?f=41st_Can_Senate.svg&w=2000"
[...]

HTTP/1.0 200 OK
Date: Mon, 28 Jan 2013 22:02:27 GMT
Server: Apache
X-Content-Type-Options: nosniff
Cache-Control: private, s-maxage=0, max-age=0, must-revalidate
Last-Modified: Sat, 21 Jul 2012 19:20:18 GMT
Content-Disposition: inline;filename*=UTF-8''41st_Can_Senate.svg.png
Content-Length: 12706
Content-Type: image/png
X-Cache: MISS from sq76.wikimedia.org
X-Cache-Lookup: MISS from sq76.wikimedia.org:3128
X-Cache: MISS from amssq35.esams.wikimedia.org
X-Cache-Lookup: MISS from amssq35.esams.wikimedia.org:3128
X-Cache: MISS from amssq42.esams.wikimedia.org
X-Cache-Lookup: MISS from amssq42.esams.wikimedia.org:80
Connection: keep-alive

Lunghezza: 12706 (12K) [image/png]

Interesting, maybe(In reply to comment #5)

(In reply to comment #4)

Of particular interest, always seems to be a cache miss. These headers are
from
the third time in a row that I accessed the image

Not always, from Europe, but result doesn't change.

$ wget -S
https://upload.wikimedia.org/wikipedia/commons/thumb/4/41/41st_Can_Senate.
svg/2000px-41st_Can_Senate.svg.png
[...]

HTTP/1.1 200 OK
Server: nginx/1.1.19
Date: Mon, 28 Jan 2013 21:45:01 GMT
Content-Type: image/png
Content-Length: 12706
Connection: keep-alive
X-Object-Meta-Sha1base36: 6qmddcqcdyix5etlu1xrronvkhttqak
Last-Modified: Sat, 21 Jul 2012 19:20:18 GMT
Etag: dfbb5fab4a113944065657576e5e0c72
X-Timestamp: 1342898418.63822
Access-Control-Allow-Origin: *
X-Varnish: 3497201383, 1468200824 1468081154, 1275272057
Via: 1.1 varnish, 1.1 varnish, 1.1 varnish
Accept-Ranges: bytes
Age: 67
X-Cache: cp1021 miss (0), cp3009 hit (1), cp3010 frontend miss (0)

Lunghezza: 12706 (12K) [image/png]

[...]

$ wget -S
"http://commons.wikimedia.org/w/thumb.php?f=41st_Can_Senate.svg&w=2000"
[...]

HTTP/1.0 200 OK
Date: Mon, 28 Jan 2013 22:02:27 GMT
Server: Apache
X-Content-Type-Options: nosniff
Cache-Control: private, s-maxage=0, max-age=0, must-revalidate
Last-Modified: Sat, 21 Jul 2012 19:20:18 GMT
Content-Disposition: inline;filename*=UTF-8''41st_Can_Senate.svg.png
Content-Length: 12706
Content-Type: image/png
X-Cache: MISS from sq76.wikimedia.org
X-Cache-Lookup: MISS from sq76.wikimedia.org:3128
X-Cache: MISS from amssq35.esams.wikimedia.org
X-Cache-Lookup: MISS from amssq35.esams.wikimedia.org:3128
X-Cache: MISS from amssq42.esams.wikimedia.org
X-Cache-Lookup: MISS from amssq42.esams.wikimedia.org:80
Connection: keep-alive

Lunghezza: 12706 (12K) [image/png]

Hmm, the age header for me is much longer when I visit via europe (and get a squid)

wolff@bluenose:~/mw$ wget -S --header 'Host: upload.wikimedia.org' -U bawolff http://upload-lb.esams.wikimedia.org/wikipedia/commons/thumb/4/41/41st_Can_Senate.svg/2000px-41st_Can_Senate.svg.png
--2013-01-29 13:43:32-- http://upload-lb.esams.wikimedia.org/wikipedia/commons/thumb/4/41/41st_Can_Senate.svg/2000px-41st_Can_Senate.svg.png
Resolving upload-lb.esams.wikimedia.org... 91.198.174.234, 2620:0:862:ed1a::b
Connecting to upload-lb.esams.wikimedia.org|91.198.174.234|:80... connected.
HTTP request sent, awaiting response...

HTTP/1.0 200 OK
X-Object-Meta-Sha1base36: 6qmddcqcdyix5etlu1xrronvkhttqak
Last-Modified: Sat, 21 Jul 2012 19:20:18 GMT
ETag: dfbb5fab4a113944065657576e5e0c72
X-Timestamp: 1342898418.63822
Accept-Ranges: bytes
Content-Length: 12706
Content-Type: image/png
Access-Control-Allow-Origin: *
Date: Mon, 28 Jan 2013 16:11:11 GMT
X-Cache: MISS from sq86.wikimedia.org
X-Cache-Lookup: MISS from sq86.wikimedia.org:3128
Age: 91941
X-Cache: HIT from amssq58.esams.wikimedia.org
X-Cache-Lookup: HIT from amssq58.esams.wikimedia.org:3128
X-Cache: MISS from knsq20.knams.wikimedia.org
X-Cache-Lookup: MISS from knsq20.knams.wikimedia.org:80
Connection: keep-alive

Length: 12706 (12K) [image/png]
Saving to: `2000px-41st_Can_Senate.svg.png.24'

100%[======================================>] 12,706 --.-K/s in 0.1s

2013-01-29 13:43:32 (114 KB/s) - `2000px-41st_Can_Senate.svg.png.24' saved [12706/12706]

In any case, when the varnishes do cache (I was now able to get a couple of cached versions when accessing from N. America) they always seem to have a really short age header.

Doing ?action=purge doesn't seem to have any affect on clearing things, I don't know what that means. I think the real issue is at the MW/Swift layer though.

CC'ing Ariel, Faidon and Aaron as this is a thumbnail purging issue (see comment 7). Could any of you take a look at this?

The 2000px version of https://commons.wikimedia.org/wiki/File:41st_Can_Senate.svg shows correctly now (but it had been changed several times since this report was created).

Gilles raised the priority of this task from Medium to Unbreak Now!.Dec 4 2014, 10:24 AM
Gilles moved this task from Untriaged to Done on the Multimedia board.
Gilles lowered the priority of this task from Unbreak Now! to Medium.Dec 4 2014, 11:23 AM