Page MenuHomePhabricator

DNS problem with instance on Wikimedia Labs (apparently two instances with same name)
Closed, ResolvedPublic

Description

The symptoms are as follows:

https://wikitech.wikimedia.org/wiki/Nova_Resource:I-0000010d.eqiad.wmflabs (our instance) shows:

Private IP

10.68.16.61

But on bastion1.eqiad.wmflabs:

ssh mwui gives:

mattflaschen@bastion1:~$ ssh mwui
The authenticity of host 'mwui (10.68.16.63)' can't be established.
RSA key fingerprint is 85:5f:e0:19:43:24:5d:69:75:fc:df:ea:56:39:ee:f6.
Are you sure you want to continue connecting (yes/no)?

Same if I add the suffix:

mattflaschen@bastion1:~$ ssh mwui.eqiad.wmflabs
The authenticity of host 'mwui.eqiad.wmflabs (10.68.16.63)' can't be established.

Note that is a different IP.
[10/03/14 00:17] <superm401> The authenticity of host 'mwui (10.68.16.63)' can't be established.


Version: unspecified
Severity: major

Details

Reference
bz71595

Event Timeline

bzimport raised the priority of this task from to Needs Triage.Nov 22 2014, 3:59 AM
bzimport set Reference to bz71595.
bzimport added a subscriber: Unknown Object (MLST).

There is only one instance named mwui. It's ip is 10.68.16.63 and its ec2 id is i-0000064f. That id, 10d is quite a low number which suggests that the instance is an old one that was migrated from pmtpa to eqiad at which point it would've gotten a new id and IP.

As for why the info page is wrong... I blame SMW for being flaky. Do you have any actual issues other than that SMW page being wrong?

(In reply to Andrew Bogott from comment #1)

There is only one instance named mwui.

I don't think that's the case.

https://wikitech.wikimedia.org/wiki/Nova_Resource:Editor-engagement shows (apologies for formatting, I'm copying out of the table):


I-0000010d.eqiad.wmflabs mwui m1.small editor-engagement ubuntu-12.04-precise i-0000010d.eqiad.wmflabs 6 March 2014 03:22:07 base
role::labs::instance
exim::simple-mail-sender
sudo::labs_project

role::mediawiki-install::labs 7 October 2014 23:29:57 1 2,048 20

https://wikitech.wikimedia.org/wiki/Nova_Resource:Design shows:


I-0000064f.eqiad.wmflabs mwui m1.small design ubuntu-14.04-trusty i-0000064f.eqiad.wmflabs 1 October 2014 21:24:35 base
role::labs::instance
sudo::labs_project

role::mediawiki-install::labs 1 October 2014 21:29:40 1 2,048 20

The original (and the one I created) was created well earlier (March 6, 2014) in the editor-engagement project. You can see there is now a separate instance in the design project created about a week ago.

That appears to be the instance it's hitting at http://mwui.wmflabs.org/wiki/Main_Page and the reason for the "authenticity of host 'mwui (10.68.16.63)' can't be established" error (it's an entirely different machine so the ssh key doesn't match).

Both of those errors (wrong wiki and ssh security problem) are the symptoms that led me to file this.

(In reply to Matthew Flaschen from comment #2)

Both of those errors (wrong wiki and ssh security problem) are the symptoms
that led me to file this.

I forget to mention. That wiki is not set up properly, whereas the one launched 6 March 2014 (but currently inaccessible) is.

The web proxy (mwui.wmflabs.org) apparently flips between the two instances (or at least it just changed), so it's intermittent which one you get.

My mistake, you're right about the problem.

I've emailed the creator of the new instance, suggesting that they recreate with a different name. In the meantime, I've allocated a public IP for your project so that you can bypass the proxy system entirely if you'd like to.

I've removed my instance with the same name. Sorry for the trouble.

Andrew set Security to None.