Page MenuHomePhabricator
Create Task
Maniphest T60053

Pywikibot Python 3 compatibility (tracking)
Closed, ResolvedPublic
Actions

Description

Make Pywikibot also work under new versions of Python (3.8).

We are aiming for a multi-compatible codebase (3.5-3.7 and in the near future 3.9, 4.0 in few years), without a dependency on six. This means we do have some hacks (try-except import blocks, 'PYTHON_VERSION >= (3, 6): <do something different>', etc.

Details

Reference
bz58053

Revisions and Commits

rPWBC pywikibot
rPWBC40eded093856 Fix Python 3 KeyError

Related Objects
Search...

View Standalone Graph
This task is connected to more than 200 other tasks. Only direct parents and subtasks are shown here. Use View Standalone Graph to show more of the graph.
StatusSubtypeAssignedTask
· · ·
InvalidNoneT72936 Important tasks to be solved (tracking)
ResolvedXqtT60053 Pywikibot Python 3 compatibility (tracking)
ResolvedMloc-gciT70617 editarticle uses deprecated optparser
DeclinedXZiseT74236 Family.ignore_certificate_error does not work in py3
ResolvedjayvdbT67675 Invalid token for os.makedirs in generate_user_files.py
InvalidNoneT74603 'Maximum retries' api.py exception is not Python 3 compatible
ResolvedNoneT72969 ResourceWarning unclosed files py3
ResolvedNoneT72977 win32 py3 xmlreader test error
DuplicateXZiseT72976 codec encoding problems on win32
DuplicateNoneT72978 win32 py3 sub error
DeclinedNoneT72983 wikidataquery tests win32 py3 error
DeclinedNoneT75120 test_image_usage_no_redirect_filter failure
ResolvedXZiseT71664 WikibasePage.templatesWithParams fails without mwparserfromhell
ResolvedjayvdbT73786 verbose output on py3 fails during initialisation
ResolvedjayvdbT73788 version.getfileversion does not work on py3, and should be rewritten
ResolvedXqtT75704 Python 3 library support
ResolvedXZiseT90338 Password inputs in Python 3.4.2 show the question after the password is entered
ResolvedjayvdbT85750 httplib2 on py3 doesn't support proxies
ResolvedLadsgroupT101801 "TypeError: 'dict_keys' object does not support indexing" in cosmetic_changes.py (Python 3)
ResolvedDalbaT106224 Python 3.5/3.6 compatibility
ResolvedXqtT107523 listpages exception on Win32 Python 3
ResolvedjayvdbT110174 i18n.messages_available and twget_keys does not work on Python 3 with empty i18n package
ResolvedXZiseT91921 Can't login. TypeError: must be str, not bytes.
DeclinedNoneT63467 Login Error with Python 3
ResolvedXqtT113120 email.generator.BytesGenerator on Python 3 corrupts data by changing line endings
ResolvedMtDuT118674 Pywikibot reflinks.py doesn't work on Python 3 because of Unicode decoding error
ResolvedNoneT124287 weblinkchecker.LinkChecker does not work on Python 3
ResolvedXqtT128849 "step" is None but compared with an int inside site.loadrevisions
ResolvedDalbaT140506 revertbot doesn't work
ResolvedxSavitarT89589 Usage of unicode_literals from __future__ package
ResolvedDalbaT158640 DeprecationWarning: the imp module is deprecated in favour of importlib
ResolvedXqtT161457 pywikibot specialbots.py UploadRobot not working in python3
ResolvedXqtT163349 makecat.py fails under python 3: TypeError: can't concat bytes to str
ResolvedXqtT164253 unicode rawstring prefix ur"" gives a syntax error in py3.6
ResolvedXqtT166459 unclosed file in wikimedia_sites.py
ResolvedXqtT171051 welcome.py raises "TypeError: decoding str is not supported" (python3)
Resolvedmatej_suchanekT179115 Pages starting with "ß" (german sharp s) are saved as "SS..."
ResolvedXqtT134172 Python 3 fails with UnicodeDecodeError
ResolvedDvorapaT213804 Archivebot changes parameter order between Python 2 and 3
ResolvedXqtT241216 Scripts using pywikibot.editor.TextEditor raises AttributeError with Python 3.8
· · ·

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
gerritbot added a comment.Dec 7 2013, 8:12 PM

Change 100167 had a related patch set uploaded by Merlijn van Deen:
Bug 58053 - next(it) instead of it.next()

https://gerrit.wikimedia.org/r/100167

gerritbot added a comment.Dec 7 2013, 8:12 PM

Change 100168 had a related patch set uploaded by Merlijn van Deen:
Bug 58053 - iter{items,values,keys} -> items(),values(),keys()

https://gerrit.wikimedia.org/r/100168

gerritbot added a comment.Dec 7 2013, 8:12 PM

Change 100169 had a related patch set uploaded by Merlijn van Deen:
Bug 58053 - catch Exception *as*

https://gerrit.wikimedia.org/r/100169

gerritbot added a comment.Dec 7 2013, 8:12 PM

Change 100170 had a related patch set uploaded by Merlijn van Deen:
Bug 58053 - func_name -> name

https://gerrit.wikimedia.org/r/100170

gerritbot added a comment.Dec 7 2013, 8:12 PM

Change 100171 had a related patch set uploaded by Merlijn van Deen:
Bug 58053 - fix print & octal in generate_user_files

https://gerrit.wikimedia.org/r/100171

gerritbot added a comment.Dec 7 2013, 8:26 PM

Change 100166 merged by jenkins-bot:
Bug 58053 - exceptions cannot be strings anymore

https://gerrit.wikimedia.org/r/100166

gerritbot added a comment.Dec 7 2013, 8:28 PM

Change 100169 merged by jenkins-bot:
Bug 58053 - catch Exception *as*

https://gerrit.wikimedia.org/r/100169

gerritbot added a comment.Dec 7 2013, 8:31 PM

Change 100170 merged by jenkins-bot:
Bug 58053 - func_name -> name

https://gerrit.wikimedia.org/r/100170

gerritbot added a comment.Dec 7 2013, 8:33 PM

Change 100171 merged by jenkins-bot:
Bug 58053 - fix print & octal in generate_user_files

https://gerrit.wikimedia.org/r/100171

gerritbot added a comment.Dec 7 2013, 8:36 PM

Change 100167 merged by jenkins-bot:
Bug 58053 - next(it) instead of it.next()

https://gerrit.wikimedia.org/r/100167

gerritbot added a comment.Dec 7 2013, 8:38 PM

Change 100168 merged by jenkins-bot:
Bug 58053 - iter{items,values,keys} -> items(),values(),keys()

https://gerrit.wikimedia.org/r/100168

Aklapper added a comment.Feb 17 2014, 7:35 PM

Ignoring the MERGED patches, only patch left here is:
https://gerrit.wikimedia.org/r/#/c/98381/

gerritbot added a comment.Apr 21 2014, 8:23 AM

Change 98381 merged by jenkins-bot:
Bug 58053 - Fix relative imports in tests/

https://gerrit.wikimedia.org/r/98381

Ricordisamoa added a comment.Jul 24 2014, 3:22 PM

No more in-review patches.

jayvdb added a comment.Sep 17 2014, 10:46 AM

All tests now pass on py3

jayvdb added a subtask: T75704: Python 3 library support.Nov 24 2014, 1:05 AM
Aklapper added a project: Pywikibot.Nov 27 2014, 4:16 PM
XZise closed subtask T67675: Invalid token for os.makedirs in generate_user_files.py as Resolved.Nov 28 2014, 9:31 AM
jayvdb closed subtask T70617: editarticle uses deprecated optparser as Resolved.Dec 3 2014, 8:03 AM
jayvdb reopened subtask T71664: WikibasePage.templatesWithParams fails without mwparserfromhell as Open.Dec 11 2014, 7:29 PM
XZise added a subtask: T90338: Password inputs in Python 3.4.2 show the question after the password is entered.Feb 21 2015, 12:13 PM
jayvdb added a subtask: T85750: httplib2 on py3 doesn't support proxies.Mar 18 2015, 10:43 AM
jayvdb closed subtask T73788: version.getfileversion does not work on py3, and should be rewritten as Resolved.Mar 20 2015, 7:43 AM
jayvdb closed subtask T73786: verbose output on py3 fails during initialisation as Resolved.Apr 22 2015, 3:37 AM
jayvdb closed subtask T90338: Password inputs in Python 3.4.2 show the question after the password is entered as Resolved.May 2 2015, 10:55 PM
jayvdb closed subtask T71664: WikibasePage.templatesWithParams fails without mwparserfromhell as Resolved.May 3 2015, 12:08 AM
XZise closed subtask T74236: Family.ignore_certificate_error does not work in py3 as Declined.Jun 2 2015, 6:21 PM
jayvdb added a subtask: T101801: "TypeError: 'dict_keys' object does not support indexing" in cosmetic_changes.py (Python 3).Jun 9 2015, 3:10 AM
jayvdb triaged this task as Medium priority.Jun 9 2015, 5:29 AM
jayvdb removed a project: Pywikibot-General.
jayvdb set Security to None.
XZise added a subtask: T106209: inspect.getargspec is deprecated in 3.5 and going to be removed in Python 3.6.Jul 18 2015, 11:15 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 18 2015, 11:15 AM
XZise added a subtask: T106212: KeyError in urllib3 since Python 3.5.0b3.Jul 18 2015, 2:43 PM
jayvdb removed subtasks: T106212: KeyError in urllib3 since Python 3.5.0b3, T106209: inspect.getargspec is deprecated in 3.5 and going to be removed in Python 3.6.Jul 18 2015, 5:11 PM
jayvdb closed subtask T85750: httplib2 on py3 doesn't support proxies as Resolved.Jul 18 2015, 6:06 PM
jayvdb added a subtask: T107523: listpages exception on Win32 Python 3.Jul 30 2015, 10:50 PM
jayvdb added a subtask: T110174: i18n.messages_available and twget_keys does not work on Python 3 with empty i18n package.Aug 25 2015, 10:01 AM
jayvdb closed subtask T110174: i18n.messages_available and twget_keys does not work on Python 3 with empty i18n package as Resolved.Aug 28 2015, 2:24 AM
jayvdb added subtasks: T91921: Can't login. TypeError: must be str, not bytes., T63467: Login Error with Python 3, T113120: email.generator.BytesGenerator on Python 3 corrupts data by changing line endings.Sep 19 2015, 2:17 AM
XZise closed subtask T72976: codec encoding problems on win32 as Resolved.Oct 2 2015, 9:49 AM
jayvdb added a subtask: T118674: Pywikibot reflinks.py doesn't work on Python 3 because of Unicode decoding error.Jan 11 2016, 12:03 AM
jayvdb closed subtask T118674: Pywikibot reflinks.py doesn't work on Python 3 because of Unicode decoding error as Resolved.Jan 19 2016, 5:08 AM
jayvdb added a subtask: T124287: weblinkchecker.LinkChecker does not work on Python 3.Jan 21 2016, 2:38 PM
Ricordisamoa added a subtask: T128849: "step" is None but compared with an int inside site.loadrevisions.Mar 4 2016, 12:55 PM
Xqt closed subtask T128849: "step" is None but compared with an int inside site.loadrevisions as Resolved.Mar 4 2016, 1:33 PM
Danny_B added a project: Tracking-Neverending.May 5 2016, 7:35 PM
Danny_B renamed this task from [Tracking] Pywikibot Python 3 compatibility to Pywikibot Python 3 compatibility (tracking).May 27 2016, 5:45 PM
Danny_B moved this task from Tag to Should be workboard column instead on the Tracking-Neverending board.Jul 11 2016, 3:11 PM
Dalba added a subtask: T140506: revertbot doesn't work.Jul 16 2016, 4:23 PM
jayvdb added a commit: rPWBC40eded093856: Fix Python 3 KeyError.Aug 10 2016, 5:19 AM
Dalba added a subtask: T157215: piper.py fails on python3 when there are non-ascii characters in wikitext.Feb 5 2017, 11:32 AM
matej_suchanek added a subtask: T89589: Usage of unicode_literals from __future__ package.Feb 7 2017, 1:42 PM
matej_suchanek added a subtask: T158640: DeprecationWarning: the imp module is deprecated in favour of importlib.Feb 22 2017, 3:38 PM
Dalba closed subtask T158640: DeprecationWarning: the imp module is deprecated in favour of importlib as Resolved.Mar 25 2017, 1:30 PM
zhuyifei1999 added a subtask: T161457: pywikibot specialbots.py UploadRobot not working in python3.Mar 26 2017, 3:39 PM
Xqt closed subtask T161457: pywikibot specialbots.py UploadRobot not working in python3 as Resolved.Mar 26 2017, 6:29 PM
Dalba added a subtask: T163349: makecat.py fails under python 3: TypeError: can't concat bytes to str.Apr 19 2017, 4:32 PM
Xqt added a subtask: T164253: unicode rawstring prefix ur"" gives a syntax error in py3.6.May 2 2017, 8:52 AM
Xqt closed subtask T164253: unicode rawstring prefix ur"" gives a syntax error in py3.6 as Resolved.May 2 2017, 2:53 PM
Multichill closed subtask T72983: wikidataquery tests win32 py3 error as Declined.May 20 2017, 1:18 PM
Xqt added a subtask: T166459: unclosed file in wikimedia_sites.py.May 28 2017, 11:04 AM
Xqt raised the priority of this task from Medium to High.May 28 2017, 11:52 AM
Xqt closed subtask T166459: unclosed file in wikimedia_sites.py as Resolved.May 28 2017, 5:26 PM
Mpaa closed subtask T157215: piper.py fails on python3 when there are non-ascii characters in wikitext as Resolved.Jun 19 2017, 7:58 PM
Xqt reopened subtask T166459: unclosed file in wikimedia_sites.py as Open.Jul 13 2017, 9:22 AM
Xqt closed subtask T166459: unclosed file in wikimedia_sites.py as Resolved.Jul 14 2017, 5:45 AM
Xqt closed subtask T163349: makecat.py fails under python 3: TypeError: can't concat bytes to str as Resolved.Jul 15 2017, 1:08 PM
Dalba added a subtask: T171051: welcome.py raises "TypeError: decoding str is not supported" (python3).Jul 19 2017, 12:50 PM
Xqt closed subtask T171051: welcome.py raises "TypeError: decoding str is not supported" (python3) as Resolved.Jul 25 2017, 8:37 AM
binbot subscribed.Jul 25 2017, 8:52 AM
Dalba added a subtask: T174785: harvest_template.py uses clear() method available only in Python 3.3.Sep 1 2017, 1:36 PM
Dalba removed a subtask: T174785: harvest_template.py uses clear() method available only in Python 3.3.Sep 1 2017, 1:41 PM
Marsupium subscribed.Oct 4 2017, 10:06 AM
matej_suchanek closed subtask T101801: "TypeError: 'dict_keys' object does not support indexing" in cosmetic_changes.py (Python 3) as Resolved.Nov 3 2017, 7:43 PM
Liuxinyu970226 subscribed.Nov 4 2017, 5:33 AM
Xqt added a subtask: T179115: Pages starting with "ß" (german sharp s) are saved as "SS...".Nov 9 2017, 7:44 PM
matej_suchanek updated the task description. (Show Details)Nov 11 2017, 10:13 AM
Xqt closed subtask T179115: Pages starting with "ß" (german sharp s) are saved as "SS..." as Resolved.Nov 11 2017, 1:02 PM
Dvorapa closed subtask T124287: weblinkchecker.LinkChecker does not work on Python 3 as Resolved.Jan 31 2018, 5:04 PM
Dvorapa added a subtask: T134172: Python 3 fails with UnicodeDecodeError.Feb 1 2018, 11:17 AM
Dvorapa removed a subtask: T157215: piper.py fails on python3 when there are non-ascii characters in wikitext.Feb 12 2018, 10:30 PM
Dvorapa moved this task from Backlog to Tracking tasks on the Pywikibot board.Mar 18 2018, 3:40 PM
Dalba closed subtask T106224: Python 3.5/3.6 compatibility as Resolved.May 21 2018, 1:07 PM
Xqt updated the task description. (Show Details)May 26 2018, 10:58 PM
Xqt closed subtask T134172: Python 3 fails with UnicodeDecodeError as Resolved.Jul 23 2018, 8:51 AM
Xqt closed subtask T74603: 'Maximum retries' api.py exception is not Python 3 compatible as Invalid.Aug 3 2018, 7:28 PM
Xqt closed subtask T75120: test_image_usage_no_redirect_filter failure as Declined.Aug 3 2018, 7:30 PM
Xqt closed subtask T89589: Usage of unicode_literals from __future__ package as Resolved.Oct 2 2018, 6:55 PM
Dvorapa added a subtask: T213804: Archivebot changes parameter order between Python 2 and 3.Jan 15 2019, 10:45 AM
Xqt updated the task description. (Show Details)Jan 15 2019, 12:28 PM
Xqt closed subtask T213804: Archivebot changes parameter order between Python 2 and 3 as Resolved.Jan 31 2019, 6:38 PM
Xqt closed subtask T75704: Python 3 library support as Resolved.Jun 20 2019, 1:11 PM
Xqt closed subtask T107523: listpages exception on Win32 Python 3 as Resolved.Jun 20 2019, 1:17 PM
Dalba closed subtask T113120: email.generator.BytesGenerator on Python 3 corrupts data by changing line endings as Resolved.Jul 24 2019, 7:10 AM
Xqt added a subtask: T241216: Scripts using pywikibot.editor.TextEditor raises AttributeError with Python 3.8.Dec 20 2019, 11:42 AM
Xqt updated the task description. (Show Details)Dec 20 2019, 12:13 PM
Xqt closed subtask T241216: Scripts using pywikibot.editor.TextEditor raises AttributeError with Python 3.8 as Resolved.Dec 21 2019, 9:17 AM
Xqt closed this task as Resolved.Jan 27 2020, 2:39 PM
Xqt claimed this task.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL