Page MenuHomePhabricator

Provide sql-sX-rr.labsdb and sql-sX-userdb.labsdb "dns" entries to access DBs by shard
Closed, ResolvedPublic

Description

Otherwise latency for all tools query hundreds of wikis is increased by a couple orders of magnitude.
See Platonides and Daniel for context/original proposal:
http://article.gmane.org/gmane.org.wikimedia.labs/1381
http://article.gmane.org/gmane.org.wikimedia.labs/1392
http://article.gmane.org/gmane.org.wikimedia.labs/1399


Version: unspecified
Severity: normal
See Also:
https://bugzilla.wikimedia.org/show_bug.cgi?id=55929

Details

Reference
bz58890

Event Timeline

bzimport raised the priority of this task from to Needs Triage.Nov 22 2014, 2:21 AM
bzimport added a project: Toolforge.
bzimport set Reference to bz58890.

They exist, but are named "sX.labsdb"

For instance, enwiki.labsdb is equal to s1.labsdb.

The latency issue is known, and will be fixed by the impending move of labs to Ashburn.

Right now, the latency (~26ms) is completely unavoidable since it's the actual transmission time between where Labs is and where the database replicas are.

This can be worked around by batching queries, or doing things in parallel.

  • This bug has been marked as a duplicate of bug 53987 ***

This is not a duplicate, please don't mess things up.

How do you figure this is not a duplicate?

Can someone point me to docs for this feature? The only mention I find, with full text search on all namespaces, is a single "s3.labsdb" in a code comment of an unrelated section: https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help#Metadata_database

(In reply to comment #6)

Can someone point me to docs for this feature? The only mention I find, with
full text search on all namespaces, is a single "s3.labsdb" in a code comment
of an unrelated section:
https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/
Help#Metadata_database

Just added https://wikitech.wikimedia.org/w/?diff=93025. Please edit if unclear.

(In reply to comment #7)

Just added https://wikitech.wikimedia.org/w/?diff=93025. Please edit if
unclear.

Thanks. Features don't really exist until documented :). Now I call this fixed.