+1 to that. Archiving everything seems like a good thing. Google and the NSA are quite good at it too. Anything you might miss, just check with the above. On 23/09/2014 2:48 p.m., Dean Pemberton wrote:
The crawls haven't been 'done by stealth' for a number of hears now. As for engagement, these guys have been turning up to NZNOGs, posting to the mailing list and talking with operators about this since before NatLib was part of DIA.
Anyone who is taken by surprise hasn't been awake =)
Dean
Since the crawl isn't being done by stealth (unlike the early ones) there is an opportunity to _work_with_ the NZ operators and come up with a cooperative solution. Rather than just trying to guess from what is there now. Eg, allow operators to "opt out", but require they do so _specifically_. (Cf, blocking the crawler IPs at their border routers, which is also a form of opt out, but much less granular.)
--- This email is free from viruses and malware because avast! Antivirus protection is active. http://www.avast.com