Yip - that appears a bit broken. Most of the online robots.txt validators also fail the disallow: /*/_/ line - some "auto corrects" it to "*" which might explain the missing site ? Also, I can't figure out what "we" are trying to achieve with that disallow...Do not index "/anything/_/" - does the site even have URL's like that ? Cheers, Pieter On 5/02/2013 05:13, Christian Nielsen wrote:
I would review the robots.txt file.
http://www.nznog.org/robots.txt
User-agent: * Disallow: /feeds Disallow: /*/_/ Sitemap: http://www.nznog.org:80/system/feeds/sitemap
Does /* stop GOOG, BING, etc from indexing the site? I can find multiple instances of nznog.org come up on BING but not the main site.
Christian
*From:*nznog-bounces(a)list.waikato.ac.nz [mailto:nznog-bounces(a)list.waikato.ac.nz] *On Behalf Of *Jonathan Brewer *Sent:* Sunday, February 03, 2013 11:14 PM *To:* Andrew Jones *Cc:* NZNOG List *Subject:* Re: [nznog] Has nznog.org done something to offend google?
I was told that nznog.org http://nznog.org wasn't being indexed because it was a "Google site".
But honestly it's a CF.
In addition to fixing the current site, all the old sites need to be brought back too.
No offense to an overworked Gerard (whom I hope is enjoying a pile of beer).
Trustees should pay someone a nominal amount to just take care of the maintenance and hosting problem.
That first word is key. Trustees. Make a decision. The volunteer work on the website hasn't cut it. Pay someone for it.
-JB
On Mon, Feb 4, 2013 at 5:25 PM, Andrew Jones
mailto:aj(a)jonesy.com.au> wrote: I was searching for the site to look at some conference presentations, but it looks like the site has fallen off the google index.
https://www.google.com.au/search?q=site:nznog.org
Cheers, Andrew _______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz mailto:NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog
_______________________________________________ NZNOG mailing list NZNOG(a)list.waikato.ac.nz http://list.waikato.ac.nz/mailman/listinfo/nznog