Author: jcsahnwaldt

Description:
lighttpd at http://download.wikipedia.org currently does not set the Last-Modified header in the response for most files.

Example: the response to a GET or HEAD request for http://download.wikipedia.org/enwiki/latest/enwiki-latest-interwiki.sql.gz does not include a Last-Modified header, but the response for http://download.wikipedia.org/enwiki/latest/enwiki-latest-interwiki.sql.gz-rss.xml does.

The reason is probably this: "If there is no content-type set, we remove the Last-Modified header" http://redmine.lighttpd.net/issues/1236

To fix this, it should suffice to add the following lines to the lighttpd config file:

mimetype.assign = (
".gz" => "application/x-gzip",
".bz2" => "application/x-bzip"
)

The Last-Modified header would be helpful for many things, e.g. to set the correct timestamp for the local copy of the file and to use wget timestamping.

Version: unspecified
Severity: normal
URL: http://download.wikipedia.org