https://www.debian.org/mirror/size 1.5TB, less if you only do more popular architectures. Add another ~100GB for security and backports. On Sat, Apr 2, 2016 at 3:14 PM, Tony Wicks wrote:

How much space does it need ? I've got Centos, Fedora and OpenVZ on ftp.wicks.co.nz, but there is only about 300gig free on the current disks. There is room to slot in one more single 2.5 disk (sas or sata) though, so I could run another mirror on a single disk.

-----Original Message----- From: nznog-bounces(a)list.waikato.ac.nz [mailto:nznog-bounces(a)list.waikato.ac.nz] On Behalf Of Michael Fincham Sent: Saturday, 2 April 2016 3:06 PM To: nznog(a)list.waikato.ac.nz Subject: [nznog] Anyone interested in donating space / connectivity / kit for a proper NZ Debian mirror?

Hi everyone,

Citylink's official Debian mirror (ftp.nz.debian.org) is apparently again broken (not even listening on port 80 from where I'm sitting).

Would anyone be seriously interested in donating rack space, national transit, or hardware to the cause of another official Debian mirror for NZ?

Having reliable and cheap access to free software projects like Debian is critically important, and having a second official mirror seems like a no-brainer to me.

I am very happy to donate my time to admin and monitor any equipment provided for this, and to liase with the Debian project as required.

Perhaps Citylink could give us some insight in to the traffic levels their existing mirrors see?

-- Michael Fincham

_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog

I've got a few spare servers I can donate, and vibe can host it Sent from my iPhone

On 2/04/2016, at 3:14 PM, Tony Wicks wrote:

How much space does it need ? I've got Centos, Fedora and OpenVZ on ftp.wicks.co.nz, but there is only about 300gig free on the current disks. There is room to slot in one more single 2.5 disk (sas or sata) though, so I could run another mirror on a single disk.

-----Original Message----- From: nznog-bounces(a)list.waikato.ac.nz [mailto:nznog-bounces(a)list.waikato.ac.nz] On Behalf Of Michael Fincham Sent: Saturday, 2 April 2016 3:06 PM To: nznog(a)list.waikato.ac.nz Subject: [nznog] Anyone interested in donating space / connectivity / kit for a proper NZ Debian mirror?

Hi everyone,

Citylink's official Debian mirror (ftp.nz.debian.org) is apparently again broken (not even listening on port 80 from where I'm sitting).

Would anyone be seriously interested in donating rack space, national transit, or hardware to the cause of another official Debian mirror for NZ?

Having reliable and cheap access to free software projects like Debian is critically important, and having a second official mirror seems like a no-brainer to me.

I am very happy to donate my time to admin and monitor any equipment provided for this, and to liase with the Debian project as required.

Perhaps Citylink could give us some insight in to the traffic levels their existing mirrors see?

-- Michael Fincham

_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog

Happy to offer rack space, bw and even a VM or two - heck - I can just open up our internal mirror

From memory the Citylink server is an apt-cache proxy type server so the disk space requirement is small

Cheers, Pieter Sent from my iPhone

On 2/04/2016, at 15:36, Michael Fincham wrote:

Thanks for the quick and generous offers from folks on and offlist!

I'm putting together a list of what's been offered and will be in touch some time during the week to see what we can kick off.

Still keen to hear from anyone who would like to contribute!

It's also been suggested we run a Patreon, which is an interesting idea :)

-- Michael Fincham _______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog

Ah ok - Yes, they are easy to get up an running - I have ran quite a few of my IT Life time :) On 02/04/2016 15:52, Chris Browning wrote:

City link allow rsync to the mirror so I believe it is really a proper mirror the uses the Debian multi stage rysync scripts to stay up to date. I run an internal Debian mirror using the official scripts, it's really quite easy to establish and maintain the mirror data files.

Chris

On 2 April 2016 15:42:32 GMT+13:00, Pieter De Wit wrote:

Happy to offer rack space, bw and even a VM or two - heck - I can just open up our internal mirror

From memory the Citylink server is an apt-cache proxy type server so the disk space requirement is small

Cheers,

Pieter

Sent from my iPhone

On 2/04/2016, at 15:36, Michael Fincham wrote:

Thanks for the quick and generous offers from folks on and offlist!

I'm putting together a list of what's been offered and will be in touch some time during the week to see what we can kick off.

Still keen to hear from anyone who would like to contribute!

It's also been suggested we run a Patreon, which is an interesting idea :)

-- Michael Fincham

-------------------------

NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog

-------------------------

NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog

-- Sent from my Android device with K-9 Mail. Please excuse my brevity.

On Sat, 2 Apr 2016 22:24:10 +1300, Simon Blake wrote:

then you have to be using their official multi stage scripts. They weren't the easiest things in the world to get going, but that was back when the world was flat, they may actually have docs now.

They do still want mirrors using the multi-stage pull. It's fairly well documented now, I don't think we should have too much trouble :) I had a quick chat with one of the Fastly folks in the #debian-mirrors IRC this evening. He pointed out that http://deb.debian.org/ is a Fastly CDN version of the repository. We discovered that the NZ routing for it is not currently very sensible, but I've got some debug data to send them to get that fixed. That's another option for folks having trouble while Citylink sorts the official mirror. -- Michael Fincham

A big thanks to the team member who repaired this on their weekend. And a big thanks for providing the resources to keep this mirror going. On Sunday 03 April 2016 22:55:01 Todd Dickason wrote:

Hi Guys

In relation to the fault we believe the service should now be operational, one of our team made the repair on the weekend. Please let us know if you are not seeing it operating correctly. Make sure any fault reporting goes to faults(a)citylink.co.nz.

We do monitor the mirrors, but generally consider official fault resolution on the solution to be business hours only.

We welcome other parties setting up alternative mirrors. We have had many discussions in the past with other companies and individuals about this very question but as yet no-one else has been willing to allocate resources to this not for profit service. We can provide a free access port if that helps with getting the alternative mirror up and running.

As much as we have enjoyed supporting you guys as the sole NZ mirror provider over the last 15 years or so, we are happy to support alternative mirrors to provide redundancy to the community.

We can provide further stats around traffic levels later this week if that’s useful.

Cheers Todd

On 2/04/16, 11:18 PM, "nznog-bounces(a)list.waikato.ac.nz on behalf of Michael Fincham" wrote:

...

On Sat, 2 Apr 2016 22:24:10 +1300, Simon Blake wrote:

...

then you have to be using their official multi stage scripts. They weren't the easiest things in the world to get going, but that was back when the world was flat, they may actually have docs now.

They do still want mirrors using the multi-stage pull. It's fairly well documented now, I don't think we should have too much trouble :)

I had a quick chat with one of the Fastly folks in the #debian-mirrors IRC this evening. He pointed out that http://deb.debian.org/ is a Fastly CDN version of the repository.

We discovered that the NZ routing for it is not currently very sensible, but I've got some debug data to send them to get that fixed. That's another option for folks having trouble while Citylink sorts the official mirror.

-- Michael Fincham

_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog

-- Regards Scott Newton Senior Developer Vadacom P: 09 969 0600 x 280 M: 021 817 662

Heck - I have just done that :) http://repo.ytechops.co.nz/ubuntu This is apt-cacher-ng backing to archive.ubuntu.com - Let me know if anyone is having connection issues. APE connections preferred :) Cheers, Pieter On 02/04/2016 15:42, Pieter De Wit wrote:

heck - I can just open up our internal mirror

This! For example the mirror I've been using lately due to citylink one being unreliable for a while now is ftp.slingshot.co.nz however my understanding is the person that used to look after that has left callplus, so I'm not confident it will be any better than citylink. Having a reliable admin is key. Hardware is easy. Perhaps this could be something for the local akl-ix non-profit to take up? I'm not sure there's much advantage to having it on wix as well these days.... -- Regards, Joel van Velden On 2 April 2016 3:45:05 pm NZDT, Pieter De Wit wrote:

Thinking about it though - perhaps there should be more admins of said mirror ?

Sent from my iPhone

...

On 2/04/2016, at 15:06, Michael Fincham wrote:

Hi everyone,

Citylink's official Debian mirror (ftp.nz.debian.org) is apparently again broken (not even listening on port 80 from where I'm sitting).

Would anyone be seriously interested in donating rack space, national transit, or hardware to the cause of another official Debian mirror for NZ?

Having reliable and cheap access to free software projects like Debian is critically important, and having a second official mirror seems like a no-brainer to me.

I am very happy to donate my time to admin and monitor any equipment provided for this, and to liase with the Debian project as required.

Perhaps Citylink could give us some insight in to the traffic levels their existing mirrors see?

-- Michael Fincham _______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog

_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog

Catalyst IT have mirror, at one point that was mostly complete: http://debian.catalyst.net.nz/pub/debian/ On 2 April 2016 at 16:16, Michael Fincham wrote:

On Sat, 02 Apr 2016 15:56:22 +1300, Joel van Velden wrote:

...

Having a reliable admin is key. Hardware is easy.

Myself and Brad from WAND have both volunteered to admin. I am confident I can find enough trustworthy folks :)

...

Perhaps this could be something for the local akl-ix non-profit to take up? I'm not sure there's much advantage to having it on wix as well these days....

It makes me sad to see smaller IXes with lower barriers to entry losing out at the moment, though I do understand the commercial pressures involved...

I am talking to REANNZ at the moment about hosting there. REANNZ are well peered and neutral, so would be ideal from my point of view.

-- Michael Fincham

_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog

On Tue, 5 Apr 2016 15:42:58 +1200, Alex Smith wrote:

We only include amd64 and i386. Both sites also serve rsync if you want to sync a local mirror.

Excellent! I suspect you'll need to mirror all arches to be an official mirror (and certainly I have a bunch of non-x86 Debian devices, so it would be important to be personally...). The Debian folks will have the definitive answer though :) -- Michael Fincham

On Sat, 2 Apr 2016 15:45:05 +1300, Pieter De Wit wrote:

Thinking about it though - perhaps there should be more admins of said mirror ?

Ideally we would have a few trusted folks from the NZ Internet community who could admin it collectively. I've already had a couple of folks volunteer, I don't think we should be too short there. -- Michael Fincham

Oh and can I add openwrt/lede to the wish list On 29 June 2018 at 13:07, Joel Wirāmu Pauling wrote:

Hi Michael - great to see.

Can I suggest a few mirror targets to investigate which would be appreciated.

* Armbian (non Raspberi Pi SBC builds) - https://www.armbian.com/#contact , main download site https://dl.armbian.com/ ) * openhabian/openhab - Openhab for SBC's ; particular lacking in mirrors currently there is only one beta repo FWIK - couldn't find a particular link regarding becoming a mirror) * Gentoo (currently no NZ mirror https://www.gentoo.org/downloads/mirrors/ ) * KDE (Again no NZ mirror currently https://download.kde.org/ extra/download-mirrors.html ) * Cygwin (There is the university of Canterbury that is well known - but I find this is spottily updated)

On 29 June 2018 at 10:44, Michael Fincham wrote:

...

Morning all,

Back in 2016 you may remember me griping at the list about wanting better mirrors in NZ for various free and open source software projects.

Since then I and a few others (particular thanks to James and Brad) have been slowly working away at improving this situation.

We're now running a dual stacked, two node mirror deployment in NZ using anycast, with bandwidth and rackspace sponsored by REANNZ and hardware sponsored by Insomnia Security and Catalyst.

As of today we've picked up our first offical mirroring gig (we're now providing the official New Zealand mirror for OpenBSD), but we already have a number of unofficial mirrors available.

Curently we're providing local mirrors of:

Alpine Arch Linux CentOS Debian Debian CDs epel Kali OpenBSD Raspbian The GNU source archive Ubuntu Ubuntu CDs

For more information you can have a look at our website, < https://fsmg.org.nz> or just browse the mirror repository directly at < https://mirror.fsmg.org.nz>.

We also have a few unofficial statistics available at < https://mirror.fsmg.org.nz/.fsmg/nodes/wlglam/> and < https://mirror.fsmg.org.nz/.fsmg/nodes/hlzmel/> for those who're curious.

We're on Freenode at #fsmg if you've got any questions or want to discuss the project.

Heaps of thanks to those who've supported us so far, and we will be working to become official mirrors for more of the projects listed above, to make sure NZ has fast and reliable local copies of important open source and free software.

-- Michael _______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz https://list.waikato.ac.nz/mailman/listinfo/nznog