Page MenuHomePhabricator
Create Task
Maniphest T44807

Invisible Unicode characters allowed on pagetitle (\u200E | \uFEFF | \u200B)
Open, MediumPublic
Actions

Description

The following two pages only different on an inivisible unicode character

https://bo.wikipedia.org/wiki/%E0%BD%94%E0%BD%BC%E0%BD%A3%E0%BC%8B%E0%BD%9D%E0%BC%8B%E0%BD%A3%E0%BD%BA%E0%BC%8B%E0%BD%A2%E0%BD%B2%E0%BC%8D

https://bo.wikipedia.org/wiki/%E0%BD%94%E0%BD%BC%E0%BD%A3%E2%80%8B%E0%BC%8B%E0%BD%9D%E0%BC%8B%E0%BD%A3%E0%BD%BA%E0%BC%8B%E0%BD%A2%E0%BD%B2%E0%BC%8D

the should point at the same page but they don't.

This causes a lot of interwiki bots to add invisible unicode characters (https://en.wikipedia.org/w/index.php?title=Paul_Val%C3%A9ry&diff=521762765&oldid=521723299)

The three characters that cause similar problems are \u200E|\uFEFF|\u200B

Version: 1.21.x
Severity: normal
See Also:
https://bugzilla.wikimedia.org/show_bug.cgi?id=27446
https://bugzilla.wikimedia.org/show_bug.cgi?id=14600
https://bugzilla.wikimedia.org/show_bug.cgi?id=5732

Details

Reference
bz42807

Related Objects
Search...

Event Timeline

• bzimport raised the priority of this task from to Medium.Nov 22 2014, 12:54 AM
• bzimport added a project: MediaWiki-Action-API.
• bzimport set Reference to bz42807.
• bzimport added a subscriber: Unknown Object (MLST).
Magioladitis created this task.Dec 7 2012, 12:53 AM
Magioladitis added a comment.Dec 7 2012, 2:33 PM

I suspect that due to these characters the page can't be called directly by typing its title.

Magioladitis added a comment.Dec 7 2012, 10:47 PM

I also left a message here: https://meta.wikimedia.org/wiki/Talk:Steward_requests/Bot_status#Remove_invisible_unicode_characters_from_pagetitles_in_various_projects

Magioladitis added a comment.Dec 10 2012, 10:32 AM

An example of how I resolved it manually by removing the invisible character
https://my.wikipedia.org/w/index.php?title=%E1%80%9C%E1%80%B0%E1%80%9D%E1%80%AE%E1%80%B8%E1%80%82%E1%80%BB%E1%80%AE_%E1%80%82%E1%80%AB%E1%80%9C%E1%80%BA%E1%80%97%E1%80%AC%E1%80%B8%E1%80%94%E1%80%AE&diff=prev&oldid=187495

Emaus added a comment.Dec 10 2012, 8:53 PM

Added some previous similar bugs.

Magioladitis added a comment.Jan 20 2013, 5:33 PM

The bug may cause serious problems to interwiki bots
https://km.wikipedia.org/w/index.php?title=%E1%9E%91%E1%9F%92%E1%9E%9A%E1%9E%B9%E1%9E%9F%E1%9F%92%E1%9E%8F%E1%9E%B8%E1%9E%94%E1%9E%91%E1%9E%80%E1%9E%BC%E1%9E%9F%E1%9F%8A%E1%9E%B8%E1%9E%93%E1%9E%BB%E1%9E%9F&action=history

Some bypass the redirect, some note, splitting the interwiki links around

Aklapper added a comment.Jan 21 2013, 7:15 AM

.

valhallasw added a comment.Oct 25 2013, 5:06 PM

See also b

Anomie edited projects, added MediaWiki-General; removed MediaWiki-Action-API.Feb 19 2015, 7:18 PM
Anomie set Security to None.
Aklapper mentioned this in T29446: U+200B ZERO WIDTH SPACE allowed in page titles.Jul 22 2015, 5:10 PM
Aklapper mentioned this in T133993: Prevent PUA characters in titles (Unicode Private Use Areas).Apr 29 2016, 5:04 PM
Dinoguy1000 mentioned this in T7732: MediaWiki allows characters in the U+0080 to U+009F range.Apr 11 2019, 9:35 AM
Aklapper added a subtask: T7732: MediaWiki allows characters in the U+0080 to U+009F range.May 4 2019, 10:23 PM
Aklapper added a subtask: T220675: U+200C ZERO WIDTH NON-JOINER invisible character allowed in file names.
Aklapper removed a subscriber: • wikibugs-l-list.Apr 12 2020, 9:55 AM
Aklapper removed a subscriber: Anomie.Oct 16 2020, 5:02 PM
Aklapper added a subtask: T266526: Prevent users from creating categories with U+FFFC OBJECT REPLACEMENT CHARACTER.Oct 27 2020, 4:18 PM
Baumgeist subscribed.Jul 14 2021, 10:32 AM
Umherirrender mentioned this in T177024: Function to replace invisible characters with blank.Sep 6 2022, 7:32 PM
Pppery reopened this task as Open.Thu, Mar 28, 8:01 PM
Pppery closed this task as a duplicate of T106344: Disallow invisible unicode characters in filenames (and article names?).
Pppery merged a task: T106344: Disallow invisible unicode characters in filenames (and article names?).
Pppery added a subtask: T353303: Deprecated, non-rendering Unicode character U+17B4 KHMER VOWEL INHERENT AQ allows bizarre mediawiki hax.
Pppery added subscribers: Josve05a, Base, Bawolff and 3 others.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL