It looks like around 8:20 this morning vodafone customers started hitting my US rather than my NZ Web servers. I use GSLB to balance things so since that time vodafone's DNS queries have appeared to be from "outside NZ". This is probably due to Telstra problems this morning. I've done a little remote testing but it's all a little hard to confirm, so if somebody at vodafone could either backout the change or pop me an email to discuss it would probably speed up their customer access (at least to my site, perhaps others). I've done some testing against 203.109.129.67 & 68 and they seem to have fixed themselves around 13:30 but I suspect thats not the whole story. -- Simon Lyall | Very Busy | Web: http://www.darkmere.gen.nz/ "To stay awake all night adds a day to your life" - Stilgar | eMT.
How did you test this? PING, Tracert or HTTP requests? Cheers Mauricio Freitas www.geekzone.co.nz www.freitasm.com www.twitter.com/freitasm -----Original Message----- From: nznog-bounces(a)list.waikato.ac.nz [mailto:nznog-bounces(a)list.waikato.ac.nz] On Behalf Of Simon Lyall Sent: Tuesday, 10 January 2012 2:06 p.m. To: nznog Subject: [nznog] Vodafone DNS It looks like around 8:20 this morning vodafone customers started hitting my US rather than my NZ Web servers. I use GSLB to balance things so since that time vodafone's DNS queries have appeared to be from "outside NZ". This is probably due to Telstra problems this morning. I've done a little remote testing but it's all a little hard to confirm, so if somebody at vodafone could either backout the change or pop me an email to discuss it would probably speed up their customer access (at least to my site, perhaps others). I've done some testing against 203.109.129.67 & 68 and they seem to have fixed themselves around 13:30 but I suspect thats not the whole story. -- Simon Lyall | Very Busy | Web: http://www.darkmere.gen.nz/ "To stay awake all night adds a day to your life" - Stilgar | eMT. _______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
203.109.129.67 & 68 allow remote DNS requests so I checked them. I was seeing some of my US IPs for a bit but not so much now. This is all http traffic so it could be something fancy like having a http proxy forward requests to a non-NZ server. I am guessing it's vodafone from a trawl of the logs, it's a bit hard to pick out details from a couple of hundred hits/second jump vs the normal traffic. On Mon, 9 Jan 2012, Mauricio Freitas wrote:
How did you test this? PING, Tracert or HTTP requests?
Cheers
Mauricio Freitas www.geekzone.co.nz www.freitasm.com www.twitter.com/freitasm
-----Original Message----- From: nznog-bounces(a)list.waikato.ac.nz [mailto:nznog-bounces(a)list.waikato.ac.nz] On Behalf Of Simon Lyall Sent: Tuesday, 10 January 2012 2:06 p.m. To: nznog Subject: [nznog] Vodafone DNS
It looks like around 8:20 this morning vodafone customers started hitting my US rather than my NZ Web servers. I use GSLB to balance things so since that time vodafone's DNS queries have appeared to be from "outside NZ".
This is probably due to Telstra problems this morning.
I've done a little remote testing but it's all a little hard to confirm, so if somebody at vodafone could either backout the change or pop me an email to discuss it would probably speed up their customer access (at least to my site, perhaps others).
I've done some testing against 203.109.129.67 & 68 and they seem to have fixed themselves around 13:30 but I suspect thats not the whole story.
-- Simon Lyall | Very Busy | Web: http://www.darkmere.gen.nz/ "To stay awake all night adds a day to your life" - Stilgar | eMT.
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
-- Simon Lyall | Very Busy | Web: http://www.darkmere.gen.nz/ "To stay awake all night adds a day to your life" - Stilgar | eMT.
If you're using GSLB then how is this not an issue with your GeoIP database
rather than a Vodafone issue?
They may have changed to a new DNS server, but it's your database that has
the wrong country for the new DNS Servers IP.
Scott.
On Mon, Jan 9, 2012 at 5:05 PM, Simon Lyall
It looks like around 8:20 this morning vodafone customers started hitting my US rather than my NZ Web servers. I use GSLB to balance things so since that time vodafone's DNS queries have appeared to be from "outside NZ".
This is probably due to Telstra problems this morning.
I've done a little remote testing but it's all a little hard to confirm, so if somebody at vodafone could either backout the change or pop me an email to discuss it would probably speed up their customer access (at least to my site, perhaps others).
I've done some testing against 203.109.129.67 & 68 and they seem to have fixed themselves around 13:30 but I suspect thats not the whole story.
-- Simon Lyall | Very Busy | Web: http://www.darkmere.gen.nz/ "To stay awake all night adds a day to your life" - Stilgar | eMT.
______________________________**_________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/**mailman/listinfo/nznoghttp://list.waikato.ac.nz/mailman/listinfo/nznog
Thanks to the person from vodafone for contacting me and having a look. They seem to be okay but I have definitely seen a jump in the number of hits from NZ-timezone people on my US servers in the last couple of days. The following are the top few IPs I'm seeing hitting me at yesterday. Cutoff was 1000/hosts per hour so shouldn't be too many home users. IP Site ISP 203.163.71.88 kipt.co.nz AT & T 203.163.71.197 ? AT & T 119.224.137.241 ? Callplus 119.224.137.105 ? Callplus 203.89.166.230 wakelabs.co.nz Maxnet 121.98.139.1 prendos.co.nz Orcon 202.68.84.130 DTS Orcon 116.199.218.6 jbwere.co.nz Orcon 60.234.55.186 ? Orcon 202.3.88.138 digitalisland.co.nz Orcon 202.68.87.220 DTS Orcon 111.69.25.100 ? Snap 210.54.55.117 ? Telecom 122.56.122.4 ? Global-Gateway 210.55.254.58 ? Global-Gateway 122.56.2.243 jbwere again? Global-Gateway 219.89.22.179 ? Xtra 203.97.149.147 ? Telstraclear 202.27.124.5 beca.co.nz Telstraclear 202.126.196.83 ? Vector Communications 202.126.197.208 ? Vector Communications 115.126.133.2 Turnstone Technologies Vector Communications 118.93.228.248 ? Vodafone A easy way to check is to get the end-user to go to: http://myresolver.info/ Which will give the IP address their DNS requests are originating from. If that doesn't appear to be from NZ then they may be seeing problems. Here is a free lookup tool for IP->Location http://www.maxmind.com/app/locate_demo_ip The most likely causes are: (a) Site is using GoogleDNS or OpenDNS (b) Their resolver is on a [new] IP range that isn't associated with NZ If (a) then tell them to stop and if (b) then you owner needs to get the usual IP->Location databases updated. I'm happy to do a manual entry for my site though while you wait for this to go though. On Tue, 10 Jan 2012, Simon Lyall wrote:
It looks like around 8:20 this morning vodafone customers started hitting my US rather than my NZ Web servers. I use GSLB to balance things so since that time vodafone's DNS queries have appeared to be from "outside NZ".
This is probably due to Telstra problems this morning.
I've done a little remote testing but it's all a little hard to confirm, so if somebody at vodafone could either backout the change or pop me an email to discuss it would probably speed up their customer access (at least to my site, perhaps others).
I've done some testing against 203.109.129.67 & 68 and they seem to have fixed themselves around 13:30 but I suspect thats not the whole story.
-- Simon Lyall | Very Busy | Web: http://www.darkmere.gen.nz/ "To stay awake all night adds a day to your life" - Stilgar | eMT.
-- Simon Lyall | Very Busy | Web: http://www.darkmere.gen.nz/ "To stay awake all night adds a day to your life" - Stilgar | eMT.
On Wed, 11 Jan 2012, Dean Pemberton wrote:
On Wed, Jan 11, 2012 at 5:29 PM, Simon Lyall
wrote: (a) Site is using GoogleDNS or OpenDNS If (a) then tell them to stop Why?
The simple answer is because neither of these providers have servers in New Zealand (or Australia) so all queries to them go to Singapore or Taiwan (or somewhere else quite a distance away). Google and OpenDNS do do some filtering but there are plenty of other options for that that don't require sending queries to DNS servers half the world away. -- Simon Lyall | Very Busy | Web: http://www.darkmere.gen.nz/ "To stay awake all night adds a day to your life" - Stilgar | eMT.
-----Original Message----- From: nznog-bounces(a)list.waikato.ac.nz [mailto:nznog- bounces(a)list.waikato.ac.nz] On Behalf Of Simon Lyall Sent: Wednesday, 11 January 2012 5:37 PM To: dean(a)deanpemberton.com Cc: nznog Subject: Re: [nznog] Customer DNS was: Re: Vodafone DNS
The simple answer is because neither of these providers have servers in New Zealand (or Australia) so all queries to them go to Singapore or Taiwan (or somewhere else quite a distance away).
Google have servers connected to PIPE IX in Sydney. $ ping 8.8.8.8 PING 8.8.8.8 (8.8.8.8) 56(84) bytes of data. 64 bytes from 8.8.8.8: icmp_req=1 ttl=61 time=0.862 ms 64 bytes from 8.8.8.8: icmp_req=2 ttl=61 time=0.854 ms 64 bytes from 8.8.8.8: icmp_req=3 ttl=61 time=0.945 ms ^C --- 8.8.8.8 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 1999ms rtt min/avg/max/mdev = 0.854/0.887/0.945/0.041 ms Not that I'm advocating their use, but they're within throwing distance for people with network on this side of the water.
On 12/01/2012, at 7:17 PM, Cameron wrote:
Google have servers connected to PIPE IX in Sydney.
--- 8.8.8.8 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 1999ms rtt min/avg/max/mdev = 0.854/0.887/0.945/0.041 ms
That must be new (ie: within the past few weeks). It was definitely returning US-like latency when I last checked. -Shaun -- Shaun Ewing
They started responding early december. Regards, Cody Miller On 1/13/2012 12:47 PM, Shaun Ewing wrote:
On 12/01/2012, at 7:17 PM, Cameron wrote:
Google have servers connected to PIPE IX in Sydney.
--- 8.8.8.8 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 1999ms rtt min/avg/max/mdev = 0.854/0.887/0.945/0.041 ms
That must be new (ie: within the past few weeks). It was definitely returning US-like latency when I last checked.
-Shaun
-- Shaun Ewing
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
participants (7)
-
Cameron
-
Cody Miller
-
Dean Pemberton
-
Mauricio Freitas
-
Scott Howard
-
Shaun Ewing
-
Simon Lyall