Page MenuHomePhabricator
Create Task
Maniphest T42017

Normalization at external wikis and non-normalized utf8
Closed, ResolvedPublic
Actions

Description

Mediawiki makes a silent UTF-8 normalization into NFC and this can/will make the later identification of the title fail. We can neglect to rewrite into NFC before the call out to the external wiki, but when we unwind the structure we get back we must make sure we test _with_ NFC as the result is silently turned into NFC.

Version: unspecified
Severity: normal
Whiteboard: storypoints: 2
See Also:
https://bugzilla.wikimedia.org/show_bug.cgi?id=27849

Details

Reference
bz40017

Event Timeline

• bzimport raised the priority of this task from to Low.Nov 22 2014, 1:05 AM
• bzimport added projects: MediaWiki-extensions-WikibaseRepository, patch-welcome.
• bzimport set Reference to bz40017.
• bzimport added a subscriber: Unknown Object (MLST).
jeblad created this task.Sep 5 2012, 6:34 PM
jeblad added a comment.Sep 5 2012, 6:40 PM

Quick-fix, normalize to NFC before we are sending the title to the external wiki. Should work for all languages except for the usual few failures for languages with illegal character sequences.

Denny added a comment.Sep 6 2012, 10:05 AM

Make sure the effect of bug 27849 is understood for Wikidata, and that a workaround is in place and taking care of it.

jeblad added a comment.Sep 6 2012, 4:30 PM

https://gerrit.wikimedia.org/r/#/c/22894/

Aklapper added a comment.Nov 4 2012, 6:34 PM

Patch in Gerrit has the status "Merged" - can this report get RESOLVED FIXED?

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL