Yip - that appears a bit broken. Most of the online robots.txt validators also fail the disallow: /*/_/ line - some "auto corrects" it to "*" which might explain the missing site ?

Also, I can't figure out what "we" are trying to achieve with that disallow...Do not index "/anything/_/" - does the site even have URL's like that ?

Cheers,

Pieter

On 5/02/2013 05:13, Christian Nielsen wrote:

I would review the robots.txt file.

 

http://www.nznog.org/robots.txt

 

User-agent: *
Disallow: /feeds
Disallow: /*/_/
Sitemap: http://www.nznog.org:80/system/feeds/sitemap

 

Does /* stop GOOG, BING, etc from indexing the site? I can find multiple instances of nznog.org come up on BING but not the main site.

 

Christian

 

 

 

From: nznog-bounces@list.waikato.ac.nz [mailto:nznog-bounces@list.waikato.ac.nz] On Behalf Of Jonathan Brewer
Sent: Sunday, February 03, 2013 11:14 PM
To: Andrew Jones
Cc: NZNOG List
Subject: Re: [nznog] Has nznog.org done something to offend google?

 

I was told that nznog.org wasn't being indexed because it was a "Google site".

But honestly it's a CF.

In addition to fixing the current site, all the old sites need to be brought back too.

No offense to an overworked Gerard (whom I hope is enjoying a pile of beer).

Trustees should pay someone a nominal amount to just take care of the maintenance and hosting problem.

That first word is key. Trustees. Make a decision. The volunteer work on the website hasn't cut it. Pay someone for it.

-JB


On Mon, Feb 4, 2013 at 5:25 PM, Andrew Jones <aj@jonesy.com.au> wrote:

I was searching for the site to look at some conference presentations, but it looks like the site has fallen off the google index.

https://www.google.com.au/search?q=site:nznog.org

Cheers,
Andrew
_______________________________________________
NZNOG mailing list
NZNOG@list.waikato.ac.nz
http://list.waikato.ac.nz/mailman/listinfo/nznog

 



_______________________________________________
NZNOG mailing list
NZNOG@list.waikato.ac.nz
http://list.waikato.ac.nz/mailman/listinfo/nznog