Page MenuHomePhabricator

Search index outdated (articles 9 months), became worse with LuceneSearch 2.1 activation
Closed, ResolvedPublic

Description

Author: Wiki.Melancholie

Description:
At least on alswiki the search index is totally outdated (not updated anymore?), for several months now. In contrast, on dewiktionary the index is properly working and only some hours to one day old.

A user reported on April 17 that none of his articles he created this year got indexed, see [[als:User_talk:Melancholie#Suech_isch_nöd_aktualisiert]]. That is confirmed.

Everything got worse with the LuceneSearch 2.1 activation yesterday. On May 27 I was able to find a fresh contribution to my talk page via search, not so today! Not sure whether this is a Google-like effect, because of different servers having different indexes, but there is proof that all articles that are even more than one month old havn't got indexed so far, see
http://als.wikipedia.org/w/index.php?ns0=1&ns1=1&ns2=1&ns3=1&ns4=1&ns5=1&ns6=1&ns7=1&ns8=1&ns9=1&ns10=1&ns11=1&ns12=1&ns13=1&ns14=1&ns15=1&ns100=1&ns101=1&ns102=1&ns103=1&ns104=1&ns105=1&ns106=1&ns107=1&ns108=1&ns109=1&ns110=1&ns111=1&redirs=1&search=%E2%80%8EAppetenzverhalten&title=Spezial%3ASuech&fulltext=Advanced+search&fulltext=Suech
(article: [[als:Appetenzverhalten]])


Please move to [MediaWiki > Search] or [MediaWiki extensions > Lucene Search] if necessary.


Version: unspecified
Severity: enhancement
URL: http://als.wikipedia.org/w/index.php?ns0=1&ns1=1&ns2=1&ns3=1&ns4=1&ns5=1&ns6=1&ns7=1&ns8=1&ns9=1&ns10=1&ns11=1&ns12=1&ns13=1&ns14=1&ns15=1&ns100=1&ns101=1&ns102=1&ns103=1&ns104=1&ns105=1&ns106=1&ns107=1&ns108=1&ns109=1&ns110=1&ns111=1&redirs=1&search=%E2%80%8EAppetenzverhalten&title=Spezial%3ASuech&fulltext=Advanced+search&fulltext=Suech

Details

Reference
bz19008

Event Timeline

bzimport raised the priority of this task from to Medium.Nov 21 2014, 10:37 PM
bzimport set Reference to bz19008.

Wiki.Melancholie wrote:

  1. Articles created at the end of August 2008 got properly indexed (9 months ago). http://als.wikipedia.org/w/index.php?ns0=1&search=Vindeliker&title=Spezial%3ASuech&fulltext=Advanced+search&fulltext=Suech
  2. Articles created in September (e.g. [[als:Eibe]]) and later haven't! http://als.wikipedia.org/w/index.php?ns0=1&search=Eibe&title=Spezial%3ASuech&fulltext=Advanced+search&fulltext=Suech
  3. There seems to be a difference between articles and other namespaces (see initial report).

Wiki.Melancholie wrote:

Cut-off date seems to be September 17/18, with [[als:Eibe]] being one of the first articles missing in index.
The index has not been updated properly (for articles not at all) since that date.

rainman wrote:

Looks like the incremental indexer is broken, september is the initial index build. Going to fix it after the indexer is done building weekly spellcheck snapshots.

rainman wrote:

Updated and should keep updating fine from now.

jz53x wrote:

The same problem is on be-x-oldwiki. The cut-off date I found is between September 16 and September 19, and after this date articles are not indexed anymore, so the reason of this seems to be the same as for alswiki.

Could you please fix this as well? I reopen the bug.

rainman wrote:

For some reason i though it's a closed wiki so didn't bother to fix it.. Sorry and fixed now.