Page MenuHomePhabricator

DNS service at Wikimedia is not working properly
Closed, ResolvedPublic

Description

The IP addresses resolution (DNS service) at Wikimedia does not work properly. The UNIX host commands gives no IP address.

Proper examples:

...:~$ host www.nytimes.com
www.nytimes.com is an alias for www.gtm.nytimes.com.
www.gtm.nytimes.com has address 170.149.168.130
...:~$ host www.spiegel.de
www.spiegel.de has address 62.138.116.3

But

...:~$ host wikivoyage.org
wikivoyage.org has address 208.80.154.224
wikivoyage.org has IPv6 address 2620:0:861:ed1a::1
wikivoyage.org mail is handled by 10 polonium.wikimedia.org.
wikivoyage.org mail is handled by 50 lead.wikimedia.org.
...:~$ host de.wikipedia.org
Host de.wikipedia.org not found: 3(NXDOMAIN)
...:~$ host de.wikivoyage.org
Host de.wikivoyage.org not found: 3(NXDOMAIN)

Our host provider confirms that this is a problem of Wikimedia.


Version: wmf-deployment
Severity: critical

Details

Reference
bz68162

Event Timeline

bzimport raised the priority of this task from to Needs Triage.Nov 22 2014, 3:40 AM
bzimport added a project: DNS.
bzimport set Reference to bz68162.

What ISP is it?

And you're using their DNS servers?

Can you also provide the output of dig for the various wikimedia hosts?

Thanks

It is Hetzner.de, and I am using their servers, see http://wiki.hetzner.de/index.php/Hetzner_Standard_Name_Server/en

dig any wikimedia.org

; <<>> DiG 9.7.3 <<>> any wikimedia.org
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 17073
;; flags: qr rd ra; QUERY: 1, ANSWER: 9, AUTHORITY: 0, ADDITIONAL: 7

;; QUESTION SECTION:
;wikimedia.org. IN ANY

;; ANSWER SECTION:
wikimedia.org. 1757 IN A 208.80.154.224
wikimedia.org. 3445 IN AAAA 2620:0:861:ed1a::
wikimedia.org. 86245 IN SOA ns0.wikimedia.org. hostmaster.wikimedia.org. 2014071700 43200 7200 1209600 600
wikimedia.org. 69104 IN NS ns0.wikimedia.org.
wikimedia.org. 69104 IN NS ns1.wikimedia.org.
wikimedia.org. 69104 IN NS ns2.wikimedia.org.
wikimedia.org. 3445 IN MX 10 polonium.wikimedia.org.
wikimedia.org. 3445 IN MX 50 lead.wikimedia.org.
wikimedia.org. 445 IN TXT "v=spf1 ip4:91.198.174.0/24 ip4:208.80.152.0/22 ip6:2620:0:860::/46 include:_spf.google.com ip4:74.121.51.111 ?all"

;; ADDITIONAL SECTION:
ns0.wikimedia.org. 1782 IN A 208.80.154.238
ns1.wikimedia.org. 1748 IN A 208.80.152.214
ns2.wikimedia.org. 1782 IN A 91.198.174.239
polonium.wikimedia.org. 2213 IN A 208.80.154.90
polonium.wikimedia.org. 2940 IN AAAA 2620:0:861:3:208:80:154:90
lead.wikimedia.org. 2213 IN A 208.80.154.89
lead.wikimedia.org. 2940 IN AAAA 2620:0:861:3:208:80:154:89

;; Query time: 1 msec
;; SERVER: 213.133.99.99#53(213.133.99.99)
;; WHEN: Thu Jul 17 14:26:34 2014
;; MSG SIZE rcvd: 484


dig any wikipedia.org

; <<>> DiG 9.7.3 <<>> any wikipedia.org
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 62419
;; flags: qr rd ra; QUERY: 1, ANSWER: 9, AUTHORITY: 0, ADDITIONAL: 0

;; QUESTION SECTION:
;wikipedia.org. IN ANY

;; ANSWER SECTION:
wikipedia.org. 93 IN A 208.80.154.224
wikipedia.org. 93 IN AAAA 2620:0:861:ed1a::1
wikipedia.org. 86400 IN SOA ns0.wikimedia.org. hostmaster.wikimedia.org. 2014071622 43200 7200 1209600 3600
wikipedia.org. 86400 IN NS ns0.wikimedia.org.
wikipedia.org. 86400 IN NS ns1.wikimedia.org.
wikipedia.org. 86400 IN NS ns2.wikimedia.org.
wikipedia.org. 3392 IN MX 10 polonium.wikimedia.org.
wikipedia.org. 3392 IN MX 50 lead.wikimedia.org.
wikipedia.org. 600 IN TXT "google-site-verification=AMHkgs-4ViEvIJf5znZle-BSE2EPNFqM1nDJGRyn2qk"

;; Query time: 30 msec
;; SERVER: 213.133.99.99#53(213.133.99.99)
;; WHEN: Thu Jul 17 14:27:32 2014
;; MSG SIZE rcvd: 313


dig any de.wikipedia.org

; <<>> DiG 9.7.3 <<>> any de.wikipedia.org
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 61962
;; flags: qr rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 0

;; QUESTION SECTION:
;de.wikipedia.org. IN ANY

;; ANSWER SECTION:
de.wikipedia.org. 1279 IN CNAME text-lb.wikimedia.org.

;; Query time: 0 msec
;; SERVER: 213.133.99.99#53(213.133.99.99)
;; WHEN: Thu Jul 17 14:28:07 2014
;; MSG SIZE rcvd: 66


host de.wikipedia.org
Host de.wikipedia.org not found: 3(NXDOMAIN)


Maybe this is helpful

This incident is resolved now (in part thanks to the debugging help from systems admins at Hetzner.de which the reporter put me in contact with!).