Re: [nznog] NLNZHarvester2008

Nathan Ward wrote:

But, Google etc. walk my content fairly regularly, so I'm not that concerned.

Google obeys robots.txt -- Criggie