Please add a new option to filter [[Special:Newpages]] by page size. Thus, pages with very small size (which should be deleted per empty or no content) and pages with very large size (possibly copyright violations) could be easily found. (Hundreds of pages are created every day in largest wikis and it is very tiring to check them all manually.)
Description
Description
Details
Details
- Reference
- bz10817
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| New HTMLForm size filter field; add size filter to Special:Newpages | mediawiki/core | master | +93 -0 |
Related Objects
Related Objects
- Mentioned In
- E200: Code Review Office Hours
Event Timeline
Comment Actions
chughakshay16 wrote:
Posted a review in Gerrit , here is the link - https://gerrit.wikimedia.org/r/#/c/8036/
Comment Actions
Patch needs only minor code style changes and a commit message that explains what the patch does and does not refer to a previous versiosn of that same patch.
Akshay: Patch has been inactive for a while so I'll reset the assignee of this bug report, but please assign this bug report again to yourself if you plan to work on your patch again and fix the remaining small issues (which would be very welcome to get this bug fixed!).
Comment Actions
Change 8036 had a related patch set uploaded by Krinkle:
Filter Special:Newpages by page size
Comment Actions
Change 8036 had a related patch set uploaded (by TTO):
New HTMLForm size filter field; add size filter to Special:Newpages
Comment Actions
I've tested this query on all shards, several wikis, with special attention to all large wikis (enwiki, dewiki, commons, wikidata, frwiki, zhwiki) both in the regular traffic slaves and special slaves. I found this query to be as good as it gets, detailed results follow (I only show the results on enwiki because the other ones match this):
MariaDB MARIADB db1073.eqiad.wmnet enwiki > EXPLAIN SELECT /* IndexPager::buildQueryInfo (NewPagesPager) Bawolff */ rc_namespace,rc_title,rc_cur_id,rc_user,rc_user_text,rc_comment,rc_timestamp,rc_patrolled,rc_id,rc_deleted,page_len AS `length`,page_latest AS `rev_id`,rc_this_oldid,page_namespace,page_title,(SELECT GROUP_CONCAT(ct_tag SEPARATOR ',') FROM `change_tag` WHERE ct_rc_id=rc_id ) AS `ts_tags` FROM `recentchanges` INNER JOIN `page` ON ((page_id=rc_cur_id)) WHERE rc_new = '1' AND (page_len <= 1000) AND rc_namespace = '0' AND page_is_redirect = '0' ORDER BY rc_timestamp DESC LIMIT 51\G
*************************** 1. row ***************************
id: 1
select_type: PRIMARY
table: recentchanges
type: ref
possible_keys: rc_namespace_title,rc_cur_id,new_name_timestamp,rc_ns_usertext,rc_name_type_patrolled_timestamp
key: new_name_timestamp
key_len: 5
ref: const,const
rows: 116688
Extra: Using where
*************************** 2. row ***************************
id: 1
select_type: PRIMARY
table: page
type: eq_ref
possible_keys: PRIMARY,page_len,page_redirect_namespace_len
key: PRIMARY
key_len: 4
ref: enwiki.recentchanges.rc_cur_id
rows: 1
Extra: Using where
*************************** 3. row ***************************
id: 2
select_type: DEPENDENT SUBQUERY
table: change_tag
type: ref
possible_keys: change_tag_rc_tag
key: change_tag_rc_tag
key_len: 5
ref: enwiki.recentchanges.rc_id
rows: 1
Extra: Using index
3 rows in set (0.01 sec)
51 rows in set (0.07 sec)
+----------------------------+-------+
| Variable_name | Value |
+----------------------------+-------+
| Handler_commit | 1 |
| Handler_delete | 0 |
| Handler_discover | 0 |
| Handler_external_lock | 0 |
| Handler_icp_attempts | 0 |
| Handler_icp_match | 0 |
| Handler_mrr_init | 0 |
| Handler_mrr_key_refills | 0 |
| Handler_mrr_rowid_refills | 0 |
| Handler_prepare | 0 |
| Handler_read_first | 0 |
| Handler_read_key | 353 |
| Handler_read_last | 0 |
| Handler_read_next | 9 |
| Handler_read_prev | 300 |
| Handler_read_rnd | 0 |
| Handler_read_rnd_deleted | 0 |
| Handler_read_rnd_next | 0 |
| Handler_rollback | 0 |
| Handler_savepoint | 0 |
| Handler_savepoint_rollback | 0 |
| Handler_tmp_update | 0 |
| Handler_tmp_write | 0 |
| Handler_update | 0 |
| Handler_write | 0 |
+----------------------------+-------+
25 rows in set (0.00 sec)
MariaDB MARIADB db1055.eqiad.wmnet enwiki > EXPLAIN SELECT /* IndexPager::buildQueryInfo (NewPagesPager) Bawolff */ rc_namespace,rc_title,rc_cur_id,rc_user,rc_user_text,rc_comment,rc_timestamp,rc_patrolled,rc_id,rc_deleted,page_len AS `length`,page_latest AS `rev_id`,rc_this_oldid,page_namespace,page_title,(SELECT GROUP_CONCAT(ct_tag SEPARATOR ',') FROM `change_tag` WHERE ct_rc_id=rc_id ) AS `ts_tags` FROM `recentchanges` INNER JOIN `page` ON ((page_id=rc_cur_id)) WHERE rc_new = '1' AND (page_len <= 1000) AND rc_namespace = '0' AND page_is_redirect = '0' ORDER BY rc_timestamp DESC LIMIT 51\G
*************************** 1. row ***************************
id: 1
select_type: PRIMARY
table: recentchanges
type: ref
possible_keys: rc_namespace_title,rc_cur_id,new_name_timestamp,rc_ns_usertext,tmp_3,rc_name_type_patrolled_timestamp
key: new_name_timestamp
key_len: 5
ref: const,const
rows: 122688
Extra: Using where
*************************** 2. row ***************************
id: 1
select_type: PRIMARY
table: page
type: eq_ref
possible_keys: PRIMARY,page_len,page_redirect_namespace_len
key: PRIMARY
key_len: 4
ref: enwiki.recentchanges.rc_cur_id
rows: 1
Extra: Using where
*************************** 3. row ***************************
id: 2
select_type: DEPENDENT SUBQUERY
table: change_tag
type: ref
possible_keys: ct_rc_id,change_tag_rc_tag
key: ct_rc_id
key_len: 5
ref: enwiki.recentchanges.rc_id
rows: 1
Extra: Using index
3 rows in set (0.02 sec)
51 rows in set (0.00 sec)
+----------------------------+-------+
| Variable_name | Value |
+----------------------------+-------+
| Handler_commit | 1 |
| Handler_delete | 0 |
| Handler_discover | 0 |
| Handler_external_lock | 0 |
| Handler_icp_attempts | 0 |
| Handler_icp_match | 0 |
| Handler_mrr_init | 0 |
| Handler_mrr_key_refills | 0 |
| Handler_mrr_rowid_refills | 0 |
| Handler_prepare | 0 |
| Handler_read_first | 0 |
| Handler_read_key | 353 |
| Handler_read_last | 0 |
| Handler_read_next | 9 |
| Handler_read_prev | 300 |
| Handler_read_rnd | 0 |
| Handler_read_rnd_deleted | 0 |
| Handler_read_rnd_next | 0 |
| Handler_rollback | 0 |
| Handler_savepoint | 0 |
| Handler_savepoint_rollback | 0 |
| Handler_tmp_update | 0 |
| Handler_tmp_write | 0 |
| Handler_update | 0 |
| Handler_write | 0 |
+----------------------------+-------+
25 rows in set (0.01 sec)Comment Actions
Change 8036 merged by jenkins-bot:
New HTMLForm size filter field; add size filter to Special:Newpages