Page MenuHomePhabricator
Create Task
Maniphest T53661

Handle Unicode characters outside the Basic Multilingual Plane correctly
Closed, DeclinedPublic
Actions

Description

According to the observations in bug 47770 the search treats all characters otside the BMP as pairs of surrogates and removes them as not indexable. Instead the indexer and the frontend should both treat them as normal characters and index and search for them if they are letters according to their Unicode General Category.

Version: unspecified
Severity: minor
Whiteboard: cirrus-fixed

Details

Reference
bz51661

Event Timeline

• bzimport raised the priority of this task from to Medium.Nov 22 2014, 1:48 AM
• bzimport added a project: MediaWiki-extensions-MWSearch.
• bzimport set Reference to bz51661.
• bzimport added a subscriber: Unknown Object (MLST).
Schnark created this task.Jul 19 2013, 8:06 AM
Aklapper added a comment.Jul 22 2013, 9:20 AM
  • Bug 51790 has been marked as a duplicate of this bug. ***
Aklapper added a comment.Feb 13 2014, 11:07 PM

Michael: If I wanted to test this, what would be steps and a specific testcase?

Schnark added a comment.Feb 14 2014, 8:46 AM

Feel free to close as WONTFIX, as I can confirm it is fixed with Cirrus:

https://de.wikipedia.org/w/index.php?search=%F0%AA%9C%80&title=Spezial%3ASuche

shows the error mentioned above with the old backend, but correctly finds Unicodeblock Vereinheitlichte CJK-Ideogramme, Erweiterung C with Cirrus.

• demon added a comment.Feb 14 2014, 6:05 PM

Resolving WONTFIX per comment 3 :)

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL