[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Savannah-hackers-public] robots.txt disallows all spiders for mailing l
From: |
Noah Slater |
Subject: |
[Savannah-hackers-public] robots.txt disallows all spiders for mailing lists |
Date: |
Sun, 5 Jul 2009 19:38:38 +0100 |
User-agent: |
Mutt/1.5.18 (2008-05-17) |
Hey,
The contents of http://lists.gnu.org/robots.txt are:
User-agent: *
Disallow: /
The effect is that no mailing lists are spidered by Google, and any search for
bugs or problems in GNU or non-GNU software ends up taking you to one of two
advertising supported, and vastly inferior, mail archive sites:
http://www.google.co.uk/search?q="Automake's+invokation+of+libtool+doesnt+handle+%24prefix"
Can we remove this file and let Google spider the GNU and non-GNU lists?
Thanks,
--
Noah Slater, http://tumbolia.org/nslater
- [Savannah-hackers-public] robots.txt disallows all spiders for mailing lists,
Noah Slater <=
- Re: [Savannah-hackers-public] robots.txt disallows all spiders for mailing lists, Yavor Doganov, 2009/07/05
- Re: [Savannah-hackers-public] robots.txt disallows all spiders for mailing lists, Noah Slater, 2009/07/05
- Message not available
- Re: [Savannah-hackers-public] robots.txt disallows all spiders for mailing lists, Yavor Doganov, 2009/07/05
- Re: [Savannah-hackers-public] robots.txt disallows all spiders for mailing lists, Noah Slater, 2009/07/05
- Re: [Savannah-hackers-public] robots.txt disallows all spiders for mailing lists, Yavor Doganov, 2009/07/05
- Re: [Savannah-hackers-public] robots.txt disallows all spiders for mailing lists, Noah Slater, 2009/07/05
- Re: [Savannah-hackers-public] robots.txt disallows all spiders for mailing lists, Yavor Doganov, 2009/07/05
- Re: [Savannah-hackers-public] robots.txt disallows all spiders for mailing lists, Noah Slater, 2009/07/05
- Re: [Savannah-hackers-public] robots.txt disallows all spiders for mailing lists, Sylvain Beucler, 2009/07/05
- Re: [Savannah-hackers-public] robots.txt disallows all spiders for mailing lists, Noah Slater, 2009/07/05