Page MenuHomePhabricator

weblinkchecker.py should crawl every page querying prop=extlinks instead of downloading the page text
Closed, ResolvedPublicFeature

Description

This issue was converted from https://jira.toolserver.org/browse/PYWP-21.
Summary: Have weblinkchecker.py optionally crawl every page querying prop=extlinks instead of downloading the page text
Issue type: New Feature - A new feature of the product, which has yet to be developed.
Priority: Major
Status: Open
Assignee: Merlijn van Deen <valhallasw@arctus.nl>

On Tue, 17 Jan 2012 04:48:15, Jeff G. <jeff-wmj@usclec.net> opened the following bug:

Could it be "modified to crawl every page querying prop=extlinks
instead of downloading the page text"? per
http://en.wikipedia.org/wiki/Wikipedia:Bots/Requests_for_approval/JeffGBot
as posted in edit
http://en.wikipedia.org/w/index.php?title=Wikipedia:Bots/Requests_for_approval/JeffGBot&diff=415563042&oldid=415551182


Version: unspecified
Severity: major

Event Timeline

bzimport raised the priority of this task from to Needs Triage.Nov 22 2014, 2:17 AM
bzimport set Reference to bz58812.
bzimport added a subscriber: Unknown Object (????).
jayvdb renamed this task from PYWP-21 Have weblinkchecker.py optionally crawl every page querying prop=extlinks instead of downloading the page text to weblinkchecker.py should crawl every page querying prop=extlinks instead of downloading the page text.Jan 21 2016, 3:24 PM
jayvdb moved this task from Backlog to Ready to go on the Pywikibot-weblinkchecker.py board.
jayvdb set Security to None.
Aklapper triaged this task as Low priority.Feb 4 2022, 8:11 PM
Aklapper changed the subtype of this task from "Task" to "Feature Request".

Change 789784 had a related patch set uploaded (by Xqt; author: Xqt):

[pywikibot/core@master] [IMPR] Use Page.extlinks() to get external links

https://gerrit.wikimedia.org/r/789784

Change 789784 merged by jenkins-bot:

[pywikibot/core@master] [IMPR] Use Page.extlinks() to get external links

https://gerrit.wikimedia.org/r/789784