[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Savannah-cvs] [MailSystem] (edit) explain why ML archives are not index

From: Beuc
Subject: [Savannah-cvs] [MailSystem] (edit) explain why ML archives are not indexed.
Date: Tue, 30 Jan 2007 21:00:14 +0000

Note: archives are currently not indexed by search engines, see robots.txt::

 User-agent: *
 Disallow: /

This is an effort from address@hidden to reduce the disk I/O on this already 
loaded machine. Spiders tend to put to its knees :/

It is suggested to use mail archives mirroring services meanwhile. Once there 
is a more powerful machine, maybe web crawlers will be allowed again.

forwarded from

reply via email to

[Prev in Thread] Current Thread [Next in Thread]