savannah-hackers-public
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Savannah-hackers-public] robots.txt disallows all spiders for mailing l


From: Noah Slater
Subject: [Savannah-hackers-public] robots.txt disallows all spiders for mailing lists
Date: Sun, 5 Jul 2009 19:38:38 +0100
User-agent: Mutt/1.5.18 (2008-05-17)

Hey,

The contents of http://lists.gnu.org/robots.txt are:

  User-agent: *
  Disallow: /

The effect is that no mailing lists are spidered by Google, and any search for
bugs or problems in GNU or non-GNU software ends up taking you to one of two
advertising supported, and vastly inferior, mail archive sites:

  
http://www.google.co.uk/search?q="Automake's+invokation+of+libtool+doesnt+handle+%24prefix"

Can we remove this file and let Google spider the GNU and non-GNU lists?

Thanks,

-- 
Noah Slater, http://tumbolia.org/nslater




reply via email to

[Prev in Thread] Current Thread [Next in Thread]