Page MenuHomePhabricator
Create Task
Maniphest T46529

Wikidata search problems (tracking)
Open, MediumPublic
Actions

Description

Tracking bug for search problems specific to Wikidata, or particularly painful for Wikidata (there's several).

I'm adding this in lucene-search-2 component because wikidata has a keyword, but search doesn't have that nor a tracking bug.

Details

Reference
bz44529

Related Objects
Search...

StatusSubtypeAssignedTask
 OpenNoneT46529 Wikidata search problems (tracking)
 ResolvedAddshoreT44686 Special:ItemDisambiguation should support case-insensitive matches.
 ResolvedNoneT46501 description should be shown in the search results in repo
 DuplicateNoneT48251 [Task] Make search suggestions work for pages outside the main namespace on Wikidata
 ResolvedNoneT44992 Optimize TermSqlCache::saveTermsOfEntity to only update the table if actually neccessary
 ResolvedNoneT45020 Auto-suggest in the search box should work on item labels
 ResolvedNoneT45066 Replace search box with item selector
 OpenNoneT46773 property search in entity selector should not be prefix-only
 ResolvedNoneT45238 Wrong ordering of search results
 ResolvedNoneT45261 search suggestions come up though term exists as item, suggestion are English only
 ResolvedNoneT48638 entityselector-based search should also search in Wikidata: namespace
 ResolvedthiemowmdeT55476 fix the issue of people not seeing the suggestion in the main search box
 ResolvedSmalyshevT55652 Special:Search doesn't use labels and descriptions for suggestions but just the item ID
 ResolvedNoneT43890 Show terms in search results
 ResolvedNoneT49114 Autocomplete during data entry should do a diacritic-insensitive search
 InvalidNoneT47158 Prepare solr deployment on wikidata.org
 ResolvedNoneT47529 use composite indexes for efficient term search
 OpenFeatureNoneT49215 "Go" search with "Wikipedia:" prefix on Wikidata redirects to Wikipedia
 ResolvedAddshoreT45962 Special:ItemDisambiguation should include aliases in search, not just labels.
 ResolvedNoneT44234 Full text search index is corrupt (index rebuild ignores content model)
 ResolvedNoneT43532 Make OAI aware of ContentHandler
 ResolvedNoneT56201 ElasticSearch for Wikibase
 InvalidNoneT47983 Enable creation of dumps dedicated to feeding a search index
 DeclinedNoneT46092 Add "See also" field to wikidata pages
 ResolvedNoneT47860 No results for some search terms
 ResolvedRicordisamoaT58032 create item link on Special:Search assumes ordinary wikitext pages
 ResolvedAddshoreT59656 Special:ItemDisambiguation ranking
 OpenNoneT59657 [Story] option for Special:ItemDisambiguation to redirect to Special:Search if no results
 ResolvedNoneT59712 Special:ItemDisambiguation to show link to Special:Search if no results are found
 InvalidNoneT58626 Include claims in search text
 OpenNoneT63948 Entity selector doesn't go directly to existing page when the exact title is entered
 DeclinedNoneT90868 Special:Search suggestions on Wikidata are confusing
 ResolvedaudeT110648 [Bug] high-ranking items seemed to have dropped significantly in Special:Search results for wikidata
 ResolvedSmalyshevT119067 Adjust rescoring config for Wikidata to consider sitelink count
 ResolvedaudeT119066 Add sitelink count to search index for Wikidata
 ResolvedNoneT120217 [Task] Add CirrusSearch and Elastica as dependencies of Wikibase on Jenkins
 ResolvedSmalyshevT64367 Highlight search matches for titles in entity namespaces
 ResolvedSmalyshevT118852 Add mechanism (hook?) to allow extensions to define additional special syntax keywords in search
 ResolvedthiemowmdeT119492 [Bug] Simple search suggestions box appears over Wikidata suggestions if search box is selected early
 OpenNoneT129779 Searching for QID of deleted item should open it, not showing useless search results
 InvalidNoneT161334 Stemming for item suggestions, e.g. "the" vs. no "the" on Wikidata
 ResolvedSmalyshevT143706 Implement TermLookup based on Elastic
 ResolvedNoneT121863 [Story] Allow labels with diacritics to be found when searching using plain ascii
 ResolvedLucas_Werkmeister_WMDET104344 Change wbsearchentities to explicitly return display terms and matched term.
 DeclinedNoneT116738 API wbsearchentities : the label and description are always in english with all the languages
ResolvedSmalyshevT148411 Item search for statements ranks disambiguation items too highly
 ResolvedNoneT170779 Wikidata search suggestions do not display on screen if character whose decomposition contains nukta is present in search query
 ResolvedSmalyshevT78157 [Story] Use ElasticSearch for entity search on wikidata.org
 ResolvedLydia_PintscherT88535 [Task] Investigate preconditions & constraints for using Elastic directly
 DuplicateSmalyshevT117520 Index Wikidata labels, aliases and descriptions as separate fields in ElasticSearch
 ResolvedSmalyshevT125500 [Epic] Index Wikidata labels and descriptions as separate fields in ElasticSearch
 InvalidNoneT132444 [Task] Create repository for WikibaseElastic
 ResolvedSmalyshevT150891 Find a good way to represent multi-lingual text fields in Elastic
 ResolvedSmalyshevT155139 'ContentHandlerForModelID' hook allows creating of handlers that aren't registered
 ResolvedSmalyshevT157604 Make Wikibase register all its content handlers
ResolvedSmalyshevT157626 ContentHandlerSanityTest assumes every handler can create empty content, but Wikibase can't
 ResolvedSmalyshevT171548 Wikidata Elastic search ignores limit
 ResolveddebtT172422 Add stats marker to wikidata entity search
 ResolvedSmalyshevT172467 Make good prefix search profile for Wikidata entities
 ResolvedSmalyshevT173231 Wikidata Elastic search drops results with matches in different language label
 ResolvedSmalyshevT175741 Set ElasticSearch implementation as default for wbsearchentites on Wikidata
 ResolvedSmalyshevT178851 Use label & description index for fulltext search
 ResolvedSmalyshevT176903 Index wikidata descriptions
 ResolvedSmalyshevT180169 Make list of languages where using stemmed analyzer for Wikibase is beneficial
 ResolvedSmalyshevT182271 Wikidata fulltext search should handle search syntax properly
 ResolveddcausseT182293 Tune wikidata fulltext search similarity parameters
 ResolvedSmalyshevT181426 Reindex wikidata to enable description index
 DuplicateNoneT117522 Create standard "completion suggestion" API for Search
 DeclinedNoneT120089 Add an internal completion or suggestions API to core SearchEngine
 DeclinedNoneT170392 Create gadget that enables the use of the elastic search backend for the entity selector
 ResolveddanielT170400 Define metrics for search result quality for the entity selector widget on wikidata.
 ResolvedLydia_PintscherT170405 Manually evaluate cirrus based entity search on test system
 OpenNoneT170547 Metrics to evaluate new search for item suggestor
 DeclinedNoneT170549 Provide A/B test for item suggestor
ResolvedSmalyshevT162292 Reindex wikidata to pick up labels/descriptions mappings
 ResolveddcausseT160926 Make noop script be able replace whole fields with nested subfields
 ResolveddcausseT166589 Update wikidata code to take advantage of nested fields noop script
 ResolvedSmalyshevT175199 Index certain statements for Wikidata items
 ResolvedSmalyshevT119080 [Task] Split/refactor search-related hooks code from Wikibase.hooks.php
 ResolvedPRODUCTION ERROREBernhardsonT124196 Fatal "cannot perform this operation with arrays" from CirrusSearch/ElasticaWrite (using JobQueueDB)
 Resolved• MarosteguiT219887 Change job table to use mediumblob for job_params field
 OpenNoneT170775 Feed Entity Suggester with ASCII equivalents of labels
 OpenNoneT86923 Entity suggester should show the exact match as first result
 InvalidNoneT176389 Searching for properties using "p:" hack is no longer useful
 OpenNoneT152944 Allow searching a person by their initials in the search engine
 ResolvedSmalyshevT156344 Property: namespace as content
 ResolvedSmalyshevT180382 Emptying description on Wikidata doesn't remove it from ElasticSearch database used by wbsearchentities
 ResolveddebtT179815 Enable searching by author name string
 ResolvedSmalyshevT163642 Index Wikidata strings in statements for fulltext search
 DeclinedNoneT78156 [Task] Cache wbsearchentities responses for short prefixes
 ResolvedSmalyshevT183053 New Wikidata items appear in search with a delay
 ResolvedSmalyshevT183054 Wikidata autocomplete search does not truncate trailing spaces
 ResolvedPRODUCTION ERROR• ImarlierT183101 Items missing from Wikidata index due to LinksUpdate lock failures
 OpenNoneT183243 The fulltext search engine should rank items with human edits higher than bot edits
 ResolvedSmalyshevT183510 Deboost Q13442814 (scientific article) in wikidata search
 InvalidNoneT185079 New items don't appear in Wikidata search
 OpenNoneT190454 Display entity & article namespace completion search together
 OpenNoneT189490 Solve search inconsistencies. Suggestion: Replace item selector search box with normal search box
 OpenNoneT189736 [Epic] Lexeme search
 OpenSmalyshevT189737 [Epic] Implement completion search for Lexemes
 OpenNoneT189744 Add hints parameter to wbsearchentities
 ResolvedSmalyshevT189745 Index Lexemes and Forms
 ResolvedSmalyshevT190970 Implement wbsearchentities search for Lexemes
 ResolvedSmalyshevT191906 Implement wbsearchentities search for Forms
 ResolvedSmalyshevT189739 [Epic] Implement fulltext search for Lexemes
 ResolvedSmalyshevT195912 Add Lexeme data to source text index
 ResolvedSmalyshevT196188 Implement Lexeme-only fulltext search
 DuplicateNoneT196809 Enable Lexeme namespace on Special:Search as a content namespace
 DuplicateNoneT197253 Make short prefix for Lexemes
 OpenNoneT90693 Allow the SearchEntities module to act as a generator to the GetEntities module
 ResolveddebtT206613 Search of wikidata string property values using haswbstatement is case sensitive
 OpenNoneT217768 The entity suggester should return properties
 OpenNoneT249989 Disable native OpenSearch suggestions in Wikibase wikis

Event Timeline

• bzimport raised the priority of this task from to Medium.Nov 22 2014, 1:24 AM
• bzimport added projects: Wikidata.org, Tracking-Neverending.
• bzimport set Reference to bz44529.
• bzimport added a subscriber: Unknown Object (MLST).
Nemo_bis created this task.Jan 31 2013, 9:23 AM
Aklapper added a comment.Oct 31 2013, 12:17 PM

[replacing wikidata keyword by adding CC - see bug 56417]

Addshore added a comment.Nov 27 2013, 2:59 PM
  • Bug 57658 has been marked as a duplicate of this bug. ***
• demon added a comment.Feb 14 2014, 10:17 PM

Moving from lsearchd -> Wikidata as Wikidata runs Cirrus now and most of these linked bugs have nothing to do with lsearchd anymore.

Lydia_Pintscher added a project: Wikidata.Dec 1 2014, 2:35 PM
Lydia_Pintscher removed a subscriber: Unknown Object (MLST).
Lydia_Pintscher removed a subscriber: Unknown Object (MLST).
• demon unsubscribed.Dec 16 2014, 7:57 PM
Lydia_Pintscher reopened subtask T55476: fix the issue of people not seeing the suggestion in the main search box as Open.Dec 18 2014, 8:25 PM
Tobi_WMDE_SW closed subtask T55476: fix the issue of people not seeing the suggestion in the main search box as Resolved.Jan 27 2015, 12:29 PM
Bugreporter added a subtask: T90868: Special:Search suggestions on Wikidata are confusing.Feb 26 2015, 2:39 PM
Lydia_Pintscher moved this task from incoming to hold on the Wikidata board.Mar 16 2015, 10:10 AM
daniel closed subtask T59656: Special:ItemDisambiguation ranking as Resolved.Jun 25 2015, 9:32 PM
Addshore closed subtask T44686: Special:ItemDisambiguation should support case-insensitive matches. as Resolved.Jul 2 2015, 8:53 PM
Addshore closed subtask T45962: Special:ItemDisambiguation should include aliases in search, not just labels. as Resolved.
whym unsubscribed.Jul 15 2015, 1:25 PM
daniel closed subtask T58032: create item link on Special:Search assumes ordinary wikitext pages as Resolved.Aug 27 2015, 2:02 PM
daniel added a subtask: T110648: [Bug] high-ranking items seemed to have dropped significantly in Special:Search results for wikidata.Sep 10 2015, 3:23 PM
matej_suchanek added a subtask: T64367: Highlight search matches for titles in entity namespaces.Sep 10 2015, 6:07 PM
aude added a subtask: T118852: Add mechanism (hook?) to allow extensions to define additional special syntax keywords in search.Nov 17 2015, 3:13 PM
matej_suchanek added a subtask: T119492: [Bug] Simple search suggestions box appears over Wikidata suggestions if search box is selected early.Jun 14 2016, 11:50 AM
• Phabricator_maintenance removed a parent task: T4007: [DO NOT USE] Tracking bug [superseded by #Tracking].Jul 28 2016, 2:33 AM
hoo closed subtask T119492: [Bug] Simple search suggestions box appears over Wikidata suggestions if search box is selected early as Resolved.Sep 26 2016, 12:30 AM
Esc3300 added a subtask: T129779: Searching for QID of deleted item should open it, not showing useless search results.Sep 26 2016, 2:27 PM
thiemowmde added a subtask: T161334: Stemming for item suggestions, e.g. "the" vs. no "the" on Wikidata.Mar 26 2017, 11:46 AM
Addshore unsubscribed.Mar 27 2017, 11:23 PM
Lydia_Pintscher closed subtask T58626: Include claims in search text as Invalid.Apr 23 2017, 3:16 PM
Lydia_Pintscher closed subtask T90868: Special:Search suggestions on Wikidata are confusing as Declined.Apr 23 2017, 3:34 PM
Lydia_Pintscher changed the status of subtask T55652: Special:Search doesn't use labels and descriptions for suggestions but just the item ID from Open to Stalled.Apr 23 2017, 4:09 PM
matej_suchanek added a subtask: T121863: [Story] Allow labels with diacritics to be found when searching using plain ascii.Apr 23 2017, 5:26 PM
matej_suchanek added subtasks: T104344: Change wbsearchentities to explicitly return display terms and matched term., T116738: API wbsearchentities : the label and description are always in english with all the languages .Apr 23 2017, 5:49 PM
Lydia_Pintscher closed subtask T161334: Stemming for item suggestions, e.g. "the" vs. no "the" on Wikidata as Invalid.May 5 2017, 2:37 PM
Sjoerddebruin added a subtask: T148411: Item search for statements ranks disambiguation items too highly.Jun 7 2017, 12:11 PM
Lydia_Pintscher added a subtask: T163642: Index Wikidata strings in statements for fulltext search.Jun 11 2017, 6:11 PM
Mahir256 added a subtask: T170779: Wikidata search suggestions do not display on screen if character whose decomposition contains nukta is present in search query.Jul 16 2017, 11:34 PM
Smalyshev subscribed.Jul 25 2017, 6:08 PM
Restricted Application added a subscriber: PokestarFan. · View Herald TranscriptJul 25 2017, 6:08 PM
Smalyshev mentioned this in T171630: Phabricator subtask view should have a filter showing just open tasks.Jul 25 2017, 6:08 PM
matej_suchanek added subtasks: T78157: [Story] Use ElasticSearch for entity search on wikidata.org, T119080: [Task] Split/refactor search-related hooks code from Wikibase.hooks.php, T124196: Fatal "cannot perform this operation with arrays" from CirrusSearch/ElasticaWrite (using JobQueueDB).Jul 30 2017, 8:58 AM
Sjoerddebruin added a subtask: T170775: Feed Entity Suggester with ASCII equivalents of labels.Aug 2 2017, 7:15 PM
Umherirrender closed subtask T170775: Feed Entity Suggester with ASCII equivalents of labels as Declined.Sep 17 2017, 2:11 PM
Izno reopened subtask T170775: Feed Entity Suggester with ASCII equivalents of labels as Open.Sep 17 2017, 4:46 PM
Sjoerddebruin added a subtask: T86923: Entity suggester should show the exact match as first result.Sep 21 2017, 3:14 PM
matej_suchanek added subtasks: T176389: Searching for properties using "p:" hack is no longer useful, T152944: Allow searching a person by their initials in the search engine, T156344: Property: namespace as content.Sep 21 2017, 3:22 PM
matej_suchanek updated the task description. (Show Details)
matej_suchanek closed subtask T176389: Searching for properties using "p:" hack is no longer useful as Invalid.Sep 23 2017, 8:25 AM
Smalyshev closed subtask T148411: Item search for statements ranks disambiguation items too highly as Resolved.Nov 1 2017, 11:10 PM
Sjoerddebruin added a subtask: T180382: Emptying description on Wikidata doesn't remove it from ElasticSearch database used by wbsearchentities.Nov 13 2017, 6:36 PM
Smalyshev closed subtask T170779: Wikidata search suggestions do not display on screen if character whose decomposition contains nukta is present in search query as Resolved.Nov 15 2017, 8:56 PM
Smalyshev closed subtask T180382: Emptying description on Wikidata doesn't remove it from ElasticSearch database used by wbsearchentities as Resolved.
Mahir256 reopened subtask T170779: Wikidata search suggestions do not display on screen if character whose decomposition contains nukta is present in search query as Open.Nov 17 2017, 8:45 PM
Mahir256 closed subtask T170779: Wikidata search suggestions do not display on screen if character whose decomposition contains nukta is present in search query as Resolved.Nov 21 2017, 4:43 AM
matej_suchanek added subtasks: T179815: Enable searching by author name string, T78156: [Task] Cache wbsearchentities responses for short prefixes.Nov 24 2017, 6:15 PM
Smalyshev closed subtask T78157: [Story] Use ElasticSearch for entity search on wikidata.org as Resolved.Nov 27 2017, 6:42 PM
Liuxinyu970226 subscribed.Nov 30 2017, 11:16 AM
Smalyshev reopened subtask T180382: Emptying description on Wikidata doesn't remove it from ElasticSearch database used by wbsearchentities as Open.Dec 3 2017, 9:43 PM
Smalyshev closed subtask T180382: Emptying description on Wikidata doesn't remove it from ElasticSearch database used by wbsearchentities as Resolved.Dec 7 2017, 8:08 PM
Smalyshev added a subtask: T183053: New Wikidata items appear in search with a delay.Dec 16 2017, 9:05 AM
Smalyshev added a subtask: T183054: Wikidata autocomplete search does not truncate trailing spaces.Dec 16 2017, 9:12 AM
Smalyshev added a subtask: T183101: Items missing from Wikidata index due to LinksUpdate lock failures.Dec 17 2017, 10:33 PM
jhsoby closed subtask T121863: [Story] Allow labels with diacritics to be found when searching using plain ascii as Resolved.Dec 18 2017, 12:59 AM
Smalyshev added a subtask: T183243: The fulltext search engine should rank items with human edits higher than bot edits.Dec 19 2017, 6:18 PM
Smalyshev closed subtask T183054: Wikidata autocomplete search does not truncate trailing spaces as Resolved.Jan 5 2018, 10:17 PM
Krinkle closed subtask T183101: Items missing from Wikidata index due to LinksUpdate lock failures as Resolved.Jan 16 2018, 3:00 PM
jhsoby added a subtask: T185079: New items don't appear in Wikidata search.Jan 17 2018, 10:00 AM
jhsoby closed subtask T185079: New items don't appear in Wikidata search as Invalid.Jan 17 2018, 11:08 AM
Smalyshev closed subtask T183053: New Wikidata items appear in search with a delay as Resolved.Mar 8 2018, 12:33 AM
Smalyshev added a subtask: T190454: Display entity & article namespace completion search together.Mar 22 2018, 8:56 PM
matej_suchanek closed subtask T119080: [Task] Split/refactor search-related hooks code from Wikibase.hooks.php as Resolved.Mar 25 2018, 11:03 AM
Lydia_Pintscher closed subtask T110648: [Bug] high-ranking items seemed to have dropped significantly in Special:Search results for wikidata as Resolved.Apr 3 2018, 6:22 PM
Smalyshev closed subtask T64367: Highlight search matches for titles in entity namespaces as Resolved.Apr 3 2018, 6:41 PM
Smalyshev closed subtask T118852: Add mechanism (hook?) to allow extensions to define additional special syntax keywords in search as Resolved.
Lydia_Pintscher changed the status of subtask T55652: Special:Search doesn't use labels and descriptions for suggestions but just the item ID from Stalled to Open.Apr 3 2018, 6:45 PM
Smalyshev closed subtask T163642: Index Wikidata strings in statements for fulltext search as Resolved.May 25 2018, 5:39 AM
Multichill reopened subtask T163642: Index Wikidata strings in statements for fulltext search as Open.May 30 2018, 10:15 AM
matej_suchanek added subtasks: T189736: [Epic] Lexeme search, T90693: Allow the SearchEntities module to act as a generator to the GetEntities module.Jul 11 2018, 8:14 AM
Lydia_Pintscher closed subtask T116738: API wbsearchentities : the label and description are always in english with all the languages as Declined.Aug 1 2018, 6:02 PM
Smalyshev closed subtask T156344: Property: namespace as content as Resolved.Aug 15 2018, 1:36 AM
Smalyshev closed subtask T163642: Index Wikidata strings in statements for fulltext search as Resolved.Sep 27 2018, 11:31 PM
debt closed subtask T179815: Enable searching by author name string as Resolved.Oct 5 2018, 4:00 PM
Mvolz added a subtask: T206613: Search of wikidata string property values using haswbstatement is case sensitive.Oct 10 2018, 10:40 AM
debt closed subtask T124196: Fatal "cannot perform this operation with arrays" from CirrusSearch/ElasticaWrite (using JobQueueDB) as Resolved.Apr 5 2019, 10:37 PM
debt closed subtask T55652: Special:Search doesn't use labels and descriptions for suggestions but just the item ID as Resolved.Jun 21 2019, 2:27 PM
debt closed subtask T206613: Search of wikidata string property values using haswbstatement is case sensitive as Resolved.Jul 19 2019, 3:44 PM
matej_suchanek added a subtask: T217768: The entity suggester should return properties.Sep 8 2019, 10:25 AM
Addshore closed subtask T78156: [Task] Cache wbsearchentities responses for short prefixes as Declined.Jul 16 2021, 8:53 AM
Lydia_Pintscher closed subtask T104344: Change wbsearchentities to explicitly return display terms and matched term. as Resolved.Mar 22 2022, 8:14 AM
MPhamWMF closed subtask T129779: Searching for QID of deleted item should open it, not showing useless search results as Declined.Aug 1 2022, 9:26 PM
Ladsgroup reopened subtask T129779: Searching for QID of deleted item should open it, not showing useless search results as Open.Aug 1 2022, 9:29 PM
Pols12 added a subtask: T249989: Disable native OpenSearch suggestions in Wikibase wikis.Nov 9 2023, 10:45 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL