Re: [nznog] Large increase of Data on AKL-IX
On 14/10/2015, at 10:47 AM, Craig Whitmore
Does anyone know what got added/what changed at AKL-IX which suddenly doubled the amount of traffic from AKL-IX this morning?
http://monitor.akl-ix.nz/cacti/graph_image.php?action=view&local_graph_id=14&rra_id=2
If you look at the graphs for individual peers you can see pretty easily the ASes (AS'?) most of it is coming from. Not sure where it's all going though! http://monitor.akl-ix.nz/cacti/graph.php?action=view&local_graph_id=93&rra_id=all Pete
Probably also helped that the backhaul between Vocus Albany DC and 220 Queen got upgraded to 10G recently too, suspect that might have contained the IX a bit, with Akamai and Microsoft being on the Albany side, and a lot of the content consumers being on the 220 Side.
On 14/10/2015, at 11:00 AM, Pete Mundy
wrote: On 14/10/2015, at 10:47 AM, Craig Whitmore
mailto:lennon(a)orcon.net.nz> wrote: Does anyone know what got added/what changed at AKL-IX which suddenly doubled the amount of traffic from AKL-IX this morning?
http://monitor.akl-ix.nz/cacti/graph_image.php?action=view&local_graph_id=14&rra_id=2 http://monitor.akl-ix.nz/cacti/graph_image.php?action=view&local_graph_id=14&rra_id=2
If you look at the graphs for individual peers you can see pretty easily the ASes (AS'?) most of it is coming from. Not sure where it's all going though!
http://monitor.akl-ix.nz/cacti/graph.php?action=view&local_graph_id=93&rra_id=all http://monitor.akl-ix.nz/cacti/graph.php?action=view&local_graph_id=93&rra_id=all
Pete
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
Something did change this morning causing a sudden spike of
Akamai/Microsoft traffic.
Akamai traffic flowing across our network is 5 x what it usually is for a
weekday morning.
You might be right Dave, maybe Microsoft is pushing out an urgent patch or
something.
*Jesse Archer*
*General Manager*Full Flavour
*p. *07 577 0099 *ddi*. 07 281 1391
*s*. Skype "myfullflavour"
*e*. jesse(a)fullflavour.nz
Probably also helped that the backhaul between Vocus Albany DC and 220 Queen got upgraded to 10G recently too, suspect that might have contained the IX a bit, with Akamai and Microsoft being on the Albany side, and a lot of the content consumers being on the 220 Side.
On 14/10/2015, at 11:00 AM, Pete Mundy
wrote: On 14/10/2015, at 10:47 AM, Craig Whitmore
wrote: Does anyone know what got added/what changed at AKL-IX which suddenly doubled the amount of traffic from AKL-IX this morning?
http://monitor.akl-ix.nz/cacti/graph_image.php?action=view&local_graph_id=14&rra_id=2
If you look at the graphs for individual peers you can see pretty easily the ASes (AS'?) most of it is coming from. Not sure where it's all going though!
http://monitor.akl-ix.nz/cacti/graph.php?action=view&local_graph_id=93&rra_id=all
Pete
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
Patch Tuesday?
On 14 October 2015 at 11:06, Jesse Archer
Something did change this morning causing a sudden spike of Akamai/Microsoft traffic.
Akamai traffic flowing across our network is 5 x what it usually is for a weekday morning.
You might be right Dave, maybe Microsoft is pushing out an urgent patch or something.
*Jesse Archer* *General Manager*Full Flavour
*p. *07 577 0099 *ddi*. 07 281 1391 *s*. Skype "myfullflavour" *e*. jesse(a)fullflavour.nz
*w*. fullflavour.nz http://www.fullflavourmedia.co.nz/ *a. *Basestation, 148 Durham Street, Tauranga *a*. PO Box 16306, Bethlehem 3176, New Zealand On Wed, Oct 14, 2015 at 11:03 AM, Liam Farr
wrote: Probably also helped that the backhaul between Vocus Albany DC and 220 Queen got upgraded to 10G recently too, suspect that might have contained the IX a bit, with Akamai and Microsoft being on the Albany side, and a lot of the content consumers being on the 220 Side.
On 14/10/2015, at 11:00 AM, Pete Mundy
wrote: On 14/10/2015, at 10:47 AM, Craig Whitmore
wrote: Does anyone know what got added/what changed at AKL-IX which suddenly doubled the amount of traffic from AKL-IX this morning?
http://monitor.akl-ix.nz/cacti/graph_image.php?action=view&local_graph_id=14&rra_id=2
If you look at the graphs for individual peers you can see pretty easily the ASes (AS'?) most of it is coming from. Not sure where it's all going though!
http://monitor.akl-ix.nz/cacti/graph.php?action=view&local_graph_id=93&rra_id=all
Pete
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
It may well be but its far bigger than any "normal" patch Tuesday. Another
wave of Windows 10 rollouts maybe?
On Wed, Oct 14, 2015 at 11:08 AM, Tristram Cheer
Patch Tuesday?
On 14 October 2015 at 11:06, Jesse Archer
wrote: Something did change this morning causing a sudden spike of Akamai/Microsoft traffic.
Akamai traffic flowing across our network is 5 x what it usually is for a weekday morning.
You might be right Dave, maybe Microsoft is pushing out an urgent patch or something.
*Jesse Archer* *General Manager*Full Flavour
*p. *07 577 0099 *ddi*. 07 281 1391 *s*. Skype "myfullflavour" *e*. jesse(a)fullflavour.nz
*w*. fullflavour.nz http://www.fullflavourmedia.co.nz/ *a. *Basestation, 148 Durham Street, Tauranga *a*. PO Box 16306, Bethlehem 3176, New Zealand On Wed, Oct 14, 2015 at 11:03 AM, Liam Farr
wrote: Probably also helped that the backhaul between Vocus Albany DC and 220 Queen got upgraded to 10G recently too, suspect that might have contained the IX a bit, with Akamai and Microsoft being on the Albany side, and a lot of the content consumers being on the 220 Side.
On 14/10/2015, at 11:00 AM, Pete Mundy
wrote: On 14/10/2015, at 10:47 AM, Craig Whitmore
wrote: Does anyone know what got added/what changed at AKL-IX which suddenly doubled the amount of traffic from AKL-IX this morning?
http://monitor.akl-ix.nz/cacti/graph_image.php?action=view&local_graph_id=14&rra_id=2
If you look at the graphs for individual peers you can see pretty easily the ASes (AS'?) most of it is coming from. Not sure where it's all going though!
http://monitor.akl-ix.nz/cacti/graph.php?action=view&local_graph_id=93&rra_id=all
Pete
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
Interestingly aggregate traffic on APE is down from this time yesterday
morning...
*Jesse Archer*
*General Manager*Full Flavour
*p. *07 577 0099 *ddi*. 07 281 1391
*s*. Skype "myfullflavour"
*e*. jesse(a)fullflavour.nz
It may well be but its far bigger than any "normal" patch Tuesday. Another wave of Windows 10 rollouts maybe?
On Wed, Oct 14, 2015 at 11:08 AM, Tristram Cheer
wrote: Patch Tuesday?
On 14 October 2015 at 11:06, Jesse Archer
wrote: Something did change this morning causing a sudden spike of Akamai/Microsoft traffic.
Akamai traffic flowing across our network is 5 x what it usually is for a weekday morning.
You might be right Dave, maybe Microsoft is pushing out an urgent patch or something.
*Jesse Archer* *General Manager*Full Flavour
*p. *07 577 0099 *ddi*. 07 281 1391 *s*. Skype "myfullflavour" *e*. jesse(a)fullflavour.nz
*w*. fullflavour.nz http://www.fullflavourmedia.co.nz/ *a. *Basestation, 148 Durham Street, Tauranga *a*. PO Box 16306, Bethlehem 3176, New Zealand On Wed, Oct 14, 2015 at 11:03 AM, Liam Farr
wrote: Probably also helped that the backhaul between Vocus Albany DC and 220 Queen got upgraded to 10G recently too, suspect that might have contained the IX a bit, with Akamai and Microsoft being on the Albany side, and a lot of the content consumers being on the 220 Side.
On 14/10/2015, at 11:00 AM, Pete Mundy
wrote: On 14/10/2015, at 10:47 AM, Craig Whitmore
wrote: Does anyone know what got added/what changed at AKL-IX which suddenly doubled the amount of traffic from AKL-IX this morning?
http://monitor.akl-ix.nz/cacti/graph_image.php?action=view&local_graph_id=14&rra_id=2
If you look at the graphs for individual peers you can see pretty easily the ASes (AS'?) most of it is coming from. Not sure where it's all going though!
http://monitor.akl-ix.nz/cacti/graph.php?action=view&local_graph_id=93&rra_id=all
Pete
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
Not a massive change though.
I know both Microsoft and Akamai peer at AKL-IX. Do both peer on APE?
On Wed, Oct 14, 2015 at 11:11 AM, Jesse Archer
Interestingly aggregate traffic on APE is down from this time yesterday morning...
*Jesse Archer* *General Manager*Full Flavour
*p. *07 577 0099 *ddi*. 07 281 1391 *s*. Skype "myfullflavour" *e*. jesse(a)fullflavour.nz
*w*. fullflavour.nz http://www.fullflavourmedia.co.nz/ *a. *Basestation, 148 Durham Street, Tauranga *a*. PO Box 16306, Bethlehem 3176, New Zealand On Wed, Oct 14, 2015 at 11:09 AM, Dave Mill
wrote: It may well be but its far bigger than any "normal" patch Tuesday. Another wave of Windows 10 rollouts maybe?
On Wed, Oct 14, 2015 at 11:08 AM, Tristram Cheer
wrote:
Patch Tuesday?
On 14 October 2015 at 11:06, Jesse Archer
wrote: Something did change this morning causing a sudden spike of Akamai/Microsoft traffic.
Akamai traffic flowing across our network is 5 x what it usually is for a weekday morning.
You might be right Dave, maybe Microsoft is pushing out an urgent patch or something.
*Jesse Archer* *General Manager*Full Flavour
*p. *07 577 0099 *ddi*. 07 281 1391 *s*. Skype "myfullflavour" *e*. jesse(a)fullflavour.nz
*w*. fullflavour.nz http://www.fullflavourmedia.co.nz/ *a. *Basestation, 148 Durham Street, Tauranga *a*. PO Box 16306, Bethlehem 3176, New Zealand On Wed, Oct 14, 2015 at 11:03 AM, Liam Farr
wrote: Probably also helped that the backhaul between Vocus Albany DC and 220 Queen got upgraded to 10G recently too, suspect that might have contained the IX a bit, with Akamai and Microsoft being on the Albany side, and a lot of the content consumers being on the 220 Side.
On 14/10/2015, at 11:00 AM, Pete Mundy
wrote: On 14/10/2015, at 10:47 AM, Craig Whitmore
wrote: Does anyone know what got added/what changed at AKL-IX which suddenly doubled the amount of traffic from AKL-IX this morning?
http://monitor.akl-ix.nz/cacti/graph_image.php?action=view&local_graph_id=14&rra_id=2
If you look at the graphs for individual peers you can see pretty easily the ASes (AS'?) most of it is coming from. Not sure where it's all going though!
http://monitor.akl-ix.nz/cacti/graph.php?action=view&local_graph_id=93&rra_id=all
Pete
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
Hi all, Microsoft’s BGP session on APE bounced 3 hours ago, they’ll be preferring the oldest route to your networks, assuming they prefer them otherwise equally. http://www.nzix.net/cgi-bin/lg.cgi?query=bgp&protocol=IPv4&addr=neighbors+192.203.154.162&router=rs2.ape.nzix.net http://www.nzix.net/cgi-bin/lg.cgi?query=bgp&protocol=IPv4&addr=neighbors+192.203.154.162&router=rs2.ape.nzix.net -- Nathan Ward
On 14/10/2015, at 11:11, Jesse Archer
mailto:jesse(a)fullflavour.co.nz> wrote: Interestingly aggregate traffic on APE is down from this time yesterday morning...
Jesse Archer General Manager Full Flavour
p. 07 577 0099 ddi. 07 281 1391 s. Skype "myfullflavour" e. jesse(a)fullflavour.nz mailto:jesse(a)fullflavourmedia.co.nz w. fullflavour.nz http://www.fullflavourmedia.co.nz/ a. Basestation, 148 Durham Street, Tauranga a. PO Box 16306, Bethlehem 3176, New Zealand
On Wed, Oct 14, 2015 at 11:09 AM, Dave Mill
mailto:davemill(a)gmail.com> wrote: It may well be but its far bigger than any "normal" patch Tuesday. Another wave of Windows 10 rollouts maybe? On Wed, Oct 14, 2015 at 11:08 AM, Tristram Cheer
mailto:tristramcheer(a)gmail.com> wrote: Patch Tuesday? On 14 October 2015 at 11:06, Jesse Archer
mailto:jesse(a)fullflavour.co.nz> wrote: Something did change this morning causing a sudden spike of Akamai/Microsoft traffic. Akamai traffic flowing across our network is 5 x what it usually is for a weekday morning.
You might be right Dave, maybe Microsoft is pushing out an urgent patch or something.
Jesse Archer General Manager Full Flavour
p. 07 577 0099 tel:07%20577%200099 ddi. 07 281 1391 tel:07%20281%201391 s. Skype "myfullflavour" e. jesse(a)fullflavour.nz mailto:jesse(a)fullflavourmedia.co.nz w. fullflavour.nz http://www.fullflavourmedia.co.nz/ a. Basestation, 148 Durham Street, Tauranga a. PO Box 16306, Bethlehem 3176, New Zealand
On Wed, Oct 14, 2015 at 11:03 AM, Liam Farr
mailto:liam(a)maxumdata.com> wrote: Probably also helped that the backhaul between Vocus Albany DC and 220 Queen got upgraded to 10G recently too, suspect that might have contained the IX a bit, with Akamai and Microsoft being on the Albany side, and a lot of the content consumers being on the 220 Side. On 14/10/2015, at 11:00 AM, Pete Mundy
mailto:pete(a)mac.geek.nz> wrote: On 14/10/2015, at 10:47 AM, Craig Whitmore
mailto:lennon(a)orcon.net.nz> wrote: Does anyone know what got added/what changed at AKL-IX which suddenly doubled the amount of traffic from AKL-IX this morning?
http://monitor.akl-ix.nz/cacti/graph_image.php?action=view&local_graph_id=14&rra_id=2 http://monitor.akl-ix.nz/cacti/graph_image.php?action=view&local_graph_id=14&rra_id=2
If you look at the graphs for individual peers you can see pretty easily the ASes (AS'?) most of it is coming from. Not sure where it's all going though!
http://monitor.akl-ix.nz/cacti/graph.php?action=view&local_graph_id=93&rra_id=all http://monitor.akl-ix.nz/cacti/graph.php?action=view&local_graph_id=93&rra_id=all
Pete
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz mailto:NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog http://list.waikato.ac.nz/mailman/listinfo/nznog
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz mailto:NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog http://list.waikato.ac.nz/mailman/listinfo/nznog
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz mailto:NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog http://list.waikato.ac.nz/mailman/listinfo/nznog
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz mailto:NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog http://list.waikato.ac.nz/mailman/listinfo/nznog
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz mailto:NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog http://list.waikato.ac.nz/mailman/listinfo/nznog
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz mailto:NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
-- Nathan Ward
On Wed, Oct 14, 2015 at 11:17 AM, Nathan Ward
Microsoft’s BGP session on APE bounced 3 hours ago, they’ll be preferring the oldest route to your networks, assuming they prefer them otherwise equally.
Looks like Nathan's worked out part of the puzzle. What do international providers do on our peering exchanges from an AS path point of view? If all exchanges were treated equally then AKL-IX learnt routes would generally be preferred as the route servers don't insert their AS in to the path. Do providers add 1 ASN to the path on routes they learn over AKL-IX to compensate? Of course I'm only talking about route server routes here - BiLats wouldn't be affected. Cheers Dave
Generally we prefer to use bi-lats with any major peers, then just let BGP
do it's thing for RSs...
I've only struck one IX in the world that bounces their route servers every
time they add or remove a peer though. APE is rather unique :)
On Tue, Oct 13, 2015 at 3:22 PM, Dave Mill
On Wed, Oct 14, 2015 at 11:17 AM, Nathan Ward
wrote: Microsoft’s BGP session on APE bounced 3 hours ago, they’ll be preferring the oldest route to your networks, assuming they prefer them otherwise equally.
Looks like Nathan's worked out part of the puzzle.
What do international providers do on our peering exchanges from an AS path point of view? If all exchanges were treated equally then AKL-IX learnt routes would generally be preferred as the route servers don't insert their AS in to the path. Do providers add 1 ASN to the path on routes they learn over AKL-IX to compensate? Of course I'm only talking about route server routes here - BiLats wouldn't be affected.
Cheers Dave
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
so interesting looking at Microsoft and Akamai both went nuts this AM
http://monitor.akl-ix.nz/cacti/graph_view.php?action=tree&tree_id=1&leaf_id=9
But.... http://www.nzix.net/ape.html seems to be just chugging along with
no increase. the conspiracy theorist in me says they cant be real as both
MS and akamai are on ape and there surely would have been a spike.
so to test theory someone do an IPerf over the IX for a few hours please..
On Wed, Oct 14, 2015 at 9:25 AM, Tim Hoffman
Generally we prefer to use bi-lats with any major peers, then just let BGP do it's thing for RSs...
I've only struck one IX in the world that bounces their route servers every time they add or remove a peer though. APE is rather unique :)
On Tue, Oct 13, 2015 at 3:22 PM, Dave Mill
wrote: On Wed, Oct 14, 2015 at 11:17 AM, Nathan Ward
wrote: Microsoft’s BGP session on APE bounced 3 hours ago, they’ll be preferring the oldest route to your networks, assuming they prefer them otherwise equally.
Looks like Nathan's worked out part of the puzzle.
What do international providers do on our peering exchanges from an AS path point of view? If all exchanges were treated equally then AKL-IX learnt routes would generally be preferred as the route servers don't insert their AS in to the path. Do providers add 1 ASN to the path on routes they learn over AKL-IX to compensate? Of course I'm only talking about route server routes here - BiLats wouldn't be affected.
Cheers Dave
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
Don’t forget the APE RS’s add their AS number, so the path on AKL-IX is probably lower for ISP’s which peer with both.
From: nznog-bounces(a)list.waikato.ac.nz [mailto:nznog-bounces(a)list.waikato.ac.nz] On Behalf Of Davey Goode
Sent: Wednesday, 14 October 2015 11:49 a.m.
To: Tim Hoffman
Maybe everyone is updating Office 2016 http://www.macrumors.com/2015/10/13/microsoft-updates-office-2016-apps/
Patch Tuesday?
Yes, seems like that.. Cumulative update for Windows 10: October 13, 2015 https://support.microsoft.com/en-us/kb/3097617 same 2x increase on IX-Aus as well. -- Best Wishes, Aftab A. Siddiqui
On 14/10/2015, at 11:06 AM, Jesse Archer
5 x what it usually is for a weekday morning.
Or 'the middle of the night' depending on what part of the world your perspective is ;-) (ie it seems logical for a large US content provider to push traffic like that during their night time) Pete
participants (12)
-
Aftab Siddiqui
-
Craig Whitmore
-
Dave Mill
-
Dave Mill
-
Davey Goode
-
Jesse Archer
-
Liam Farr
-
Nathan Ward
-
Pete Mundy
-
Simon Allard
-
Tim Hoffman
-
Tristram Cheer