Indeed shutting down all (flapping) circuits from the affected provider at that location allowed traffic to traverse alternate paths and carriers and normal operation to resume.

Unfortunately not all downstream customers choose to buy 100% diverse services due to cost constraints, and as such are vulnerable to network interruptions affecting a particular POP or hand over point, this is an accepted risk they take, but it doesn't make it any less impacting when it breaks. (I believe you actually built some of the affected non-diverse circuits back in the day bro).

Sometimes when your shit is on fire, and you don't have enough information about whats happening, in a communications vacuum it can help to reach out to the community as someone else may know more than you, and sometimes when you do that you don't always write the most comprehensive or eloquent emails as your a little pre-occupied with the issues at hand.

Thankfully the issues are mostly resolved or routed around, although a RCA is going to take some time. ��

On 5 July 2016 at 13:39, Tim Hoffman <tim@hoffman.net.nz> wrote:
Sounds like your network is lacking in carrier diversity if they can cause you that much bother bro��

Sent from my iPhone

On Jul 4, 2016, at 6:32 PM, Liam Farr <liam@maxumdata.com> wrote:

Your right Tim, its not the NOC.

At the time the NOC was being uncommunicative, and as a customer I was left in the dark about a major P1 fault affecting me.

Due to communication difficulties with the NOC and in exasperation as a customer I decided to post here to see if anyone else was affected, or had any further information they could provide on the issue, (i.e. is anyone else affected, I'm trying to find out what the fuck is actually going on), had the NOC been more communicative at the time I would not have resorted to posting here.

Subsequently I escalated this to my account manager and then the CTO, and the flow of communication from NOC to customer has resumed in a satisfactory manner.

Thanks for your concern.

On 5 July 2016 at 13:22, Tim Hoffman <tim@hoffman.net.nz> wrote:
I wasn't aware that this mailing list was the 2degrees NOC email.

On Mon, Jul 4, 2016 at 5:52 PM, Jesse Archer <jesse@fullflavour.co.nz> wrote:
We also noticed some issues.��

2Degrees NOC are aware.




Jesse Archer
General Manager
Full Flavour


p. 07 577 0099 ��ddi. 07 281 1391
s. Skype "myfullflavour"
e. jesse@fullflavour.nz
w.��fullflavour.nz
a. Basestation, 148 Durham Street, Tauranga
a. PO Box 13403, Tauranga Central, Tauranga 3141, New Zealand


On Tue, Jul 5, 2016 at 11:02 AM, Liam Farr <liam@maxumdata.com> wrote:
Hi,

Just wondering if anyone else had issues with services delivered by��2Degrees (SNAP) at 220 Queen Street this morning from 9AM onwards?



--
Kind Regards


Liam Farr

Maxum Data

_______________________________________________
NZNOG mailing list
NZNOG@list.waikato.ac.nz
https://list.waikato.ac.nz/mailman/listinfo/nznog



_______________________________________________
NZNOG mailing list
NZNOG@list.waikato.ac.nz
https://list.waikato.ac.nz/mailman/listinfo/nznog





--
Kind Regards


Liam Farr

Maxum Data



--
Kind Regards


Liam Farr

Maxum Data
+64-9-950-5302