19 Oct
2008
19 Oct
'08
10:23 a.m.
On Mon, 2008-10-20 at 16:31 +1300, Murray Fox wrote:
NZ Internet ..... from an international host ..... blatantly ignoring robots.txt
I don't suppose you or anyone else could share any info re: the subnet the requests are coming from or point to this info if it's published somewhere? I presume it'll be something inside one of The Internet Archive's allocations but am curious for specifics if they're available. -- -Michael Fincham System Administrator, Unleash www.unleash.co.nz Phone: 0800 750 250 DDI: 03 978 1223 Mobile: 027 666 4482