The linked document states that : Robots.txt files with a rule that refers specifically to the * NLNZ_IAHarvester2013* user agent will be strictly obeyed. Which would seem to be a much better way to handle this than an IP block... Scott On Fri, Jan 18, 2013 at 10:28 PM, Don Gould <don(a)bowenvale.co.nz> wrote:
Hi All,
Can anyone tell me where this harvest is being done from this year and what IP range to block so it doesn't troll though my machines?
D
On 13/12/2012 1:22 p.m., Jay Gattuso wrote:
Hi All,
This email is to inform you of the NLNZ intent to undertake its 3rd Whole of Domain Web Harvest.
The planned dates for this exercise are the 4th to the 22nd of February 2013.
The harvest will be undertaken by the Internet Archive <http://archive.org/index.php> on our behalf,
**
More details can be found on the web harvest website:**http://natlib.govt.**nz/publishers-and-authors/web-** harvesting/2013-nz-web-harvest<http://natlib.govt.nz/publishers-and-authors/web-harvesting/2013-nz-web-harvest>
If anyone has any specific concerns, requests or questions, please do not hesitate to contact me directly: jay.gattuso(a)dia.govt.nz <mailto:jay.gattuso(a)dia.govt.**nz <jay.gattuso(a)dia.govt.nz>> or via the project email address: Web.Archive(a)dia.govt.nz <mailto:Web.Archive(a)dia.govt.**nz <Web.Archive(a)dia.govt.nz> ?Subject=About%20the%202013%**20Web%20Harvest>
If anyone wants to discuss this further on the mailing list I am happy to do so.
King regards,
Jay
*Jay Gattuso*| Digital Preservation Analyst | Preservation, Research and Consultancy
National Library of New Zealand | Te Puna Mātauranga o Aotearoa
PO Box 1467 Wellington 6140 New Zealand | +64 (0)4 474 3064
jay.gattuso(a)dia.govt.nz <mailto:jay.gattuso(a)natlib.**govt.nz<jay.gattuso(a)natlib.govt.nz>
______________________________**_________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/**mailman/listinfo/nznog<http://list.waikato.ac.nz/mailman/listinfo/nznog>
-- Don Gould 31 Acheson Ave Mairehau Christchurch, New Zealand Ph: + 64 3 348 7235 Mobile: + 64 21 114 0699
______________________________**_________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/**mailman/listinfo/nznog<http://list.waikato.ac.nz/mailman/listinfo/nznog>