I wasn't aware that this mailing list was the 2degrees NOC email. On Mon, Jul 4, 2016 at 5:52 PM, Jesse Archer wrote:

We also noticed some issues.

2Degrees NOC are aware.

*Jesse Archer* *General Manager*Full Flavour

*p. *07 577 0099 *ddi*. 07 281 1391 *s*. Skype "myfullflavour" *e*. jesse(a)fullflavour.nz *w*. fullflavour.nz http://www.fullflavourmedia.co.nz/ *a. *Basestation, 148 Durham Street, Tauranga *a*. PO Box 13403, Tauranga Central, Tauranga 3141, New Zealand

On Tue, Jul 5, 2016 at 11:02 AM, Liam Farr wrote:

...

Hi,

Just wondering if anyone else had issues with services delivered by 2Degrees (SNAP) at 220 Queen Street this morning from 9AM onwards?

-- Kind Regards

Liam Farr

Maxum Data +64-9-950-5302

_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz https://list.waikato.ac.nz/mailman/listinfo/nznog

_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz https://list.waikato.ac.nz/mailman/listinfo/nznog

Sounds like your network is lacking in carrier diversity if they can cause you that much bother bro Sent from my iPhone

On Jul 4, 2016, at 6:32 PM, Liam Farr wrote:

Your right Tim, its not the NOC.

At the time the NOC was being uncommunicative, and as a customer I was left in the dark about a major P1 fault affecting me.

Due to communication difficulties with the NOC and in exasperation as a customer I decided to post here to see if anyone else was affected, or had any further information they could provide on the issue, (i.e. is anyone else affected, I'm trying to find out what the fuck is actually going on), had the NOC been more communicative at the time I would not have resorted to posting here.

Subsequently I escalated this to my account manager and then the CTO, and the flow of communication from NOC to customer has resumed in a satisfactory manner.

Thanks for your concern.

...

On 5 July 2016 at 13:22, Tim Hoffman wrote: I wasn't aware that this mailing list was the 2degrees NOC email.

...

On Mon, Jul 4, 2016 at 5:52 PM, Jesse Archer wrote: We also noticed some issues.

2Degrees NOC are aware.

Jesse Archer General Manager Full Flavour

p. 07 577 0099 ddi. 07 281 1391 s. Skype "myfullflavour" e. jesse(a)fullflavour.nz w. fullflavour.nz a. Basestation, 148 Durham Street, Tauranga a. PO Box 13403, Tauranga Central, Tauranga 3141, New Zealand

...

On Tue, Jul 5, 2016 at 11:02 AM, Liam Farr wrote: Hi,

Just wondering if anyone else had issues with services delivered by 2Degrees (SNAP) at 220 Queen Street this morning from 9AM onwards?

-- Kind Regards

Liam Farr

Maxum Data +64-9-950-5302

_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz https://list.waikato.ac.nz/mailman/listinfo/nznog

_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz https://list.waikato.ac.nz/mailman/listinfo/nznog

-- Kind Regards

Liam Farr

Maxum Data +64-9-950-5302

Or N+1 is more comfortable than N. Having an upstream with issues means you're more vulnerable to service interruption to customers. No one enjoys that. Sent from my Unicorn

On 5/07/2016, at 1:39 PM, Tim Hoffman wrote:

Sounds like your network is lacking in carrier diversity if they can cause you that much bother bro

Sent from my iPhone

...

On Jul 4, 2016, at 6:32 PM, Liam Farr wrote:

Your right Tim, its not the NOC.

At the time the NOC was being uncommunicative, and as a customer I was left in the dark about a major P1 fault affecting me.

Due to communication difficulties with the NOC and in exasperation as a customer I decided to post here to see if anyone else was affected, or had any further information they could provide on the issue, (i.e. is anyone else affected, I'm trying to find out what the fuck is actually going on), had the NOC been more communicative at the time I would not have resorted to posting here.

Subsequently I escalated this to my account manager and then the CTO, and the flow of communication from NOC to customer has resumed in a satisfactory manner.

Thanks for your concern.

...

On 5 July 2016 at 13:22, Tim Hoffman wrote: I wasn't aware that this mailing list was the 2degrees NOC email.

...

On Mon, Jul 4, 2016 at 5:52 PM, Jesse Archer wrote: We also noticed some issues.

2Degrees NOC are aware.

Jesse Archer General Manager Full Flavour

p. 07 577 0099 ddi. 07 281 1391 s. Skype "myfullflavour" e. jesse(a)fullflavour.nz w. fullflavour.nz a. Basestation, 148 Durham Street, Tauranga a. PO Box 13403, Tauranga Central, Tauranga 3141, New Zealand

...

On Tue, Jul 5, 2016 at 11:02 AM, Liam Farr wrote: Hi,

Just wondering if anyone else had issues with services delivered by 2Degrees (SNAP) at 220 Queen Street this morning from 9AM onwards?

-- Kind Regards

Liam Farr

Maxum Data +64-9-950-5302

_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz https://list.waikato.ac.nz/mailman/listinfo/nznog

_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz https://list.waikato.ac.nz/mailman/listinfo/nznog

-- Kind Regards

Liam Farr

Maxum Data +64-9-950-5302

---

NZNOG mailing list NZNOG(a)list.waikato.ac.nz https://list.waikato.ac.nz/mailman/listinfo/nznog

Just a thought… What do you folks think about adding “Network Status” page links to the existing NOC list? http://www.nznog.org/noc-list Could provide a quick and easy zero-touch way of getting the word out about network faults without tying up hard-working NOC people with serial phone calls / emails? Disclaimer: my company doesn’t actually *have* a Network Status page yet (working on it), but many on the NOC list do… Thoughts? PS Thanks for the idea Jesse Archer. ☺ Ian Lewis T +64 7 850 3841 | M +64 27 405 7765 | E ian.lewis(a)ultrafast.co.nzmailto:ian.lewis(a)ultrafast.co.nz From: nznog-bounces(a)list.waikato.ac.nz [mailto:nznog-bounces(a)list.waikato.ac.nz] On Behalf Of Liam Farr Sent: Tuesday, 5 July 2016 2:01 p.m. To: Tim Hoffman Cc: NZNOG Mailing-List Subject: Re: [nznog] 2Degrees (SNAP) issues at 220 Queen Street this morning Indeed shutting down all (flapping) circuits from the affected provider at that location allowed traffic to traverse alternate paths and carriers and normal operation to resume. Unfortunately not all downstream customers choose to buy 100% diverse services due to cost constraints, and as such are vulnerable to network interruptions affecting a particular POP or hand over point, this is an accepted risk they take, but it doesn't make it any less impacting when it breaks. (I believe you actually built some of the affected non-diverse circuits back in the day bro). Sometimes when your shit is on fire, and you don't have enough information about whats happening, in a communications vacuum it can help to reach out to the community as someone else may know more than you, and sometimes when you do that you don't always write the most comprehensive or eloquent emails as your a little pre-occupied with the issues at hand. Thankfully the issues are mostly resolved or routed around, although a RCA is going to take some time. On 5 July 2016 at 13:39, Tim Hoffman mailto:tim(a)hoffman.net.nz> wrote: Sounds like your network is lacking in carrier diversity if they can cause you that much bother bro Sent from my iPhone On Jul 4, 2016, at 6:32 PM, Liam Farr mailto:liam(a)maxumdata.com> wrote: Your right Tim, its not the NOC. At the time the NOC was being uncommunicative, and as a customer I was left in the dark about a major P1 fault affecting me. Due to communication difficulties with the NOC and in exasperation as a customer I decided to post here to see if anyone else was affected, or had any further information they could provide on the issue, (i.e. is anyone else affected, I'm trying to find out what the fuck is actually going on), had the NOC been more communicative at the time I would not have resorted to posting here. Subsequently I escalated this to my account manager and then the CTO, and the flow of communication from NOC to customer has resumed in a satisfactory manner. Thanks for your concern. On 5 July 2016 at 13:22, Tim Hoffman mailto:tim(a)hoffman.net.nz> wrote: I wasn't aware that this mailing list was the 2degrees NOC email. On Mon, Jul 4, 2016 at 5:52 PM, Jesse Archer mailto:jesse(a)fullflavour.co.nz> wrote: We also noticed some issues. 2Degrees NOC are aware. Jesse Archer General Manager Full Flavour [http://fullflavour.co.nz/files/7814/0357/5893/full-flavour.png] p. 07 577 0099 ddi. 07 281 1391 s. Skype "myfullflavour" e. jesse(a)fullflavour.nzmailto:jesse(a)fullflavourmedia.co.nz w. fullflavour.nzhttp://www.fullflavourmedia.co.nz/ a. Basestation, 148 Durham Street, Tauranga a. PO Box 13403, Tauranga Central, Tauranga 3141, New Zealand On Tue, Jul 5, 2016 at 11:02 AM, Liam Farr mailto:liam(a)maxumdata.com> wrote: Hi, Just wondering if anyone else had issues with services delivered by 2Degrees (SNAP) at 220 Queen Street this morning from 9AM onwards? -- Kind Regards Liam Farr Maxum Data +64-9-950-5302tel:%2B64-9-950-5302 _______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nzmailto:NZNOG(a)list.waikato.ac.nz https://list.waikato.ac.nz/mailman/listinfo/nznog _______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nzmailto:NZNOG(a)list.waikato.ac.nz https://list.waikato.ac.nz/mailman/listinfo/nznog -- Kind Regards Liam Farr Maxum Data +64-9-950-5302tel:%2B64-9-950-5302 -- Kind Regards Liam Farr Maxum Data +64-9-950-5302 ------------------------------------------------------------------------------ Attention: This e-mail message is intended for the intended recipient only and it may contain Ultrafast Fibre Limited confidential or legally privileged information or both. No confidentiality or privilege is waived or lost if this email has been delivered to the wrong recipient. If you have received this email in error, please immediately delete it from your system and notify Ultrafast Fibre Limited. You must not disclose , copy or relay any part of this correspondence if you are not the intended recipient. Any views expressed in this message are those of the individual sender and not Ultrafast Fibre Limited. This email has been checked for viruses. However, Ultrafast Fibre Limited makes no warranty that this email or any attachments are free from viruses or other conditions which may damage or interfere with recipient data, hardware or software. The recipient relies on its own procedures and assumes all risk of use and of opening any attachments. ------------------------------------------------------------------------------

I'm clearly doomed, should give up and head to the pub immediately! On 5 July 2016 at 14:08, Peter Mott wrote:

On 5/07/2016, at 2:01 pm, Liam Farr wrote: sometimes when you do that you don't always write the most comprehensive or eloquent emails as your a little pre-occupied with the issues at hand.

To add to your woes ...

http://www.yourvsyoure.com

regards

Peter Mott LocalCloud Limited Secure Cloud Hosting - Designed for IT Professionals

+64 21 279 4995 -/-

-- Kind Regards Liam Farr Maxum Data +64-9-950-5302

Agreed.   Also, sometimes correlation of multiple faults that people are sitting quietly stewing about can help isolate a larger problem more quickly.  I think that this type of use of the mailing list is entirely within the spirit of it’s existence.  People need to remember that we should all be working together in this community and the sharing of information freely amongst ourselves shouldn’t just be limited to one week in late January. From: on behalf of Liam Farr Date: Tuesday, 5 July 2016 at 2:01 PM To: Tim Hoffman Cc: NZNOG Mailing-List Subject: Re: [nznog] 2Degrees (SNAP) issues at 220 Queen Street this morning Indeed shutting down all (flapping) circuits from the affected provider at that location allowed traffic to traverse alternate paths and carriers and normal operation to resume. Unfortunately not all downstream customers choose to buy 100% diverse services due to cost constraints, and as such are vulnerable to network interruptions affecting a particular POP or hand over point, this is an accepted risk they take, but it doesn't make it any less impacting when it breaks. (I believe you actually built some of the affected non-diverse circuits back in the day bro). Sometimes when your shit is on fire, and you don't have enough information about whats happening, in a communications vacuum it can help to reach out to the community as someone else may know more than you, and sometimes when you do that you don't always write the most comprehensive or eloquent emails as your a little pre-occupied with the issues at hand. Thankfully the issues are mostly resolved or routed around, although a RCA is going to take some time. On 5 July 2016 at 13:39, Tim Hoffman wrote: Sounds like your network is lacking in carrier diversity if they can cause you that much bother bro Sent from my iPhone On Jul 4, 2016, at 6:32 PM, Liam Farr wrote: Your right Tim, its not the NOC. At the time the NOC was being uncommunicative, and as a customer I was left in the dark about a major P1 fault affecting me. Due to communication difficulties with the NOC and in exasperation as a customer I decided to post here to see if anyone else was affected, or had any further information they could provide on the issue, (i.e. is anyone else affected, I'm trying to find out what the fuck is actually going on), had the NOC been more communicative at the time I would not have resorted to posting here. Subsequently I escalated this to my account manager and then the CTO, and the flow of communication from NOC to customer has resumed in a satisfactory manner. Thanks for your concern. On 5 July 2016 at 13:22, Tim Hoffman wrote: I wasn't aware that this mailing list was the 2degrees NOC email. On Mon, Jul 4, 2016 at 5:52 PM, Jesse Archer wrote: We also noticed some issues. 2Degrees NOC are aware. Jesse Archer General Manager Full Flavour p. 07 577 0099 ddi. 07 281 1391 s. Skype "myfullflavour" e. jesse(a)fullflavour.nz w. fullflavour.nz a. Basestation, 148 Durham Street, Tauranga a. PO Box 13403, Tauranga Central, Tauranga 3141, New Zealand On Tue, Jul 5, 2016 at 11:02 AM, Liam Farr wrote: Hi, Just wondering if anyone else had issues with services delivered by 2Degrees (SNAP) at 220 Queen Street this morning from 9AM onwards? -- Kind Regards Liam Farr Maxum Data +64-9-950-5302 _______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz https://list.waikato.ac.nz/mailman/listinfo/nznog _______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz https://list.waikato.ac.nz/mailman/listinfo/nznog -- Kind Regards Liam Farr Maxum Data +64-9-950-5302 -- Kind Regards Liam Farr Maxum Data +64-9-950-5302 _______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz https://list.waikato.ac.nz/mailman/listinfo/nznog

I'm not a moderator of this list at all. What I'd like to see would be things like: "I've tried contacting blah, had no success. Is anyone else having issues" Rather than the list being used for "Who has issues with blah". Really, contacting your service provider should always be the first point of call. Otherwise it seems like this list becomes just a places to bag Vocus/2Degrees/whoevers-had-a-recent-outage. Obviously if your service provider is not responsive NZNOG is a good way to reach out to other potential customers who might be having issues. Cheers Dave On Tue, Jul 5, 2016 at 1:22 PM, Tim Hoffman wrote:

I wasn't aware that this mailing list was the 2degrees NOC email.

On Mon, Jul 4, 2016 at 5:52 PM, Jesse Archer wrote:

...

We also noticed some issues.

2Degrees NOC are aware.

*Jesse Archer* *General Manager*Full Flavour

*p. *07 577 0099 *ddi*. 07 281 1391 *s*. Skype "myfullflavour" *e*. jesse(a)fullflavour.nz *w*. fullflavour.nz http://www.fullflavourmedia.co.nz/ *a. *Basestation, 148 Durham Street, Tauranga *a*. PO Box 13403, Tauranga Central, Tauranga 3141, New Zealand

On Tue, Jul 5, 2016 at 11:02 AM, Liam Farr wrote:

...

Hi,

Just wondering if anyone else had issues with services delivered by 2Degrees (SNAP) at 220 Queen Street this morning from 9AM onwards?

-- Kind Regards

Liam Farr

Maxum Data +64-9-950-5302

_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz https://list.waikato.ac.nz/mailman/listinfo/nznog

_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz https://list.waikato.ac.nz/mailman/listinfo/nznog

_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz https://list.waikato.ac.nz/mailman/listinfo/nznog