Page MenuHomePhabricator

Add some of the missing tables in commonswiki_f_p
Closed, ResolvedPublic

Description

commonswiki_p currently contains the following tables:

MariaDB [commonswiki_p]> show tables;
+-------------------------+

Tables_in_commonswiki_p

+-------------------------+

abuse_filter
abuse_filter_action
abuse_filter_history
abuse_filter_log
archive
archive_userindex
category
categorylinks
change_tag
externallinks
geo_killlist
geo_tags
geo_updates
global_block_whitelist
globalimagelinks
hashs
hitcounter
image
imagelinks
interwiki
ipblocks
ipblocks_ipindex
iwlinks
l10n_cache
langlinks
localisation
localisation_file_hash
logging
logging_logindex
logging_userindex
mark_as_helpful
math
module_deps
msg_resource
msg_resource_links
oldimage
oldimage_userindex
page
page_props
page_restrictions
pagelinks
pif_edits
povwatch_log
povwatch_subscribers
protected_titles
recentchanges
recentchanges_userindex
redirect
revision
revision_userindex
site_identifiers
site_stats
sites
tag_summary
templatelinks
transcode
updatelog
updates
user
user_former_groups
user_groups
valid_tag
wikilove_image_log
wikilove_log

+-------------------------+
64 rows in set (0.04 sec)

The federated version only contains a very small subset of these:

MariaDB [commonswiki_f_p]> show tables;
+---------------------------+

Tables_in_commonswiki_f_p

+---------------------------+

image
logging
logging_userindex
page
revision
revision_userindex
user

+---------------------------+
7 rows in set (0.04 sec)

I would like to see all the missing tables added, but that seems to be a bridge
to far at this moment. So to get about this deadlock please at least add these
tables:

  • categorylinks
  • globalimagelinks
  • imagelinks
  • langlinks
  • oldimage
  • oldimage_userindex
  • page_props
  • pagelinks
  • recentchanges
  • recentchanges_userindex
  • templatelinks

Version: unspecified
Severity: enhancement
See Also:
https://bugzilla.wikimedia.org/show_bug.cgi?id=68505

Details

Reference
bz59683

Related Objects

View Standalone Graph
This task is connected to more than 200 other tasks. Only direct parents and subtasks are shown here. Use View Standalone Graph to show more of the graph.

Event Timeline

bzimport raised the priority of this task from to High.Nov 22 2014, 2:19 AM
bzimport added a project: Toolforge.
bzimport set Reference to bz59683.

Why aren't those tables part of the federated version?

Change 123916 had a related patch set uploaded by coren:
Labs: automate federated table maintenance

https://gerrit.wikimedia.org/r/123916

Change 123916 merged by coren:
Labs: automate federated table maintenance

https://gerrit.wikimedia.org/r/123916

Federation now provides, by default, the set of public tables.

globalimagelinks is still missing

Also filearchive, filearchive_userindex, user_daily_contribs, user_properties and betafeatures_user_counts are missing compared to s4.labsdb.commonswiki_p

Hi Sean, I'm assigning this to you because Coren isn't available, this has been reopened and is needed for the Toolserver migration.
Can you help?

Best Silke

Federated filearchive, filearchive_userindex, user_daily_contribs, user_properties should now exist, pointing to the sanitized labsdb1002 commonswiki_p versions.

Need to get input from Coren on the replica maintenance scripts for globalimagelinks and betafeatures_user_counts.

On s5

SELECT * FROM commonswiki_f_p.recentchanges limit 1;

fails with an error:

ERROR 1296 (HY000): Got error 10000 'Error on remote system: 1054: Unknown column 'rc_moved_to_ns' in 'field list'' from FEDERATED

Also on s5 (others not testet)

SELECT * from commonswiki_f_p.page limit 3;

ERROR 1296 (HY000): Got error 10000 'Error on remote system: 1054: Unknown column 'page_content_model' in 'field list'' from FEDERATED

Seems to be a general problem.

Any chance we get this resolved? Please increase priority so that Merl can finish his migration, too.

There's a complicated issue with schema variation between databases that is causing probems. The one caused by rc_moved_to_ns is gone, I'm working on the other one now.

I'm also stuck with one or another script on the "Unknown column 'page_content_model' in 'field list'" problem.

Both views should now work properly.

Thanks, Coren! merl, can you please check and confirm this?

No, globalimagelinks is still missing (mentioned in comment #1 and #5):

$mysql -hs5.labsdb commonswiki_f_p -e "show tables like 'globalimagelinks'"
Empty Set

Also templatelinks problem on s5

select * from commonswiki_f_p.templatelinks limit 1;
ERROR 1296 (HY000): Got error 10000 'Error on remote system: 1054: Unknown column 'tl_from_namespace' in 'field list'' from FEDERATED

globalimagelinks added, tl_from_namespace has issues (being worked on)

BTW, now would be a good time to mention if there are other irregularities and not just after I fixed both of those. :-)

templatelinks updated to track the recent schema changes.