www robots.txt

[Ineiev]

CVSROOT:        /web/www
Module name:    www
Changes by:     Ineiev <ineiev> 18/10/07 06:11:13

Modified files:
        .              : robots.txt 

Log message:
        Disallow /server/select-language.html, RT #1298215.

CVSWeb URLs:
http://web.cvs.savannah.gnu.org/viewcvs/www/robots.txt?cvsroot=www&r1=1.5&r2=1.6

Patches:
Index: robots.txt
===================================================================
RCS file: /web/www/www/robots.txt,v
retrieving revision 1.5
retrieving revision 1.6
diff -u -b -r1.5 -r1.6
--- robots.txt  31 May 2018 08:57:22 -0000      1.5
+++ robots.txt  7 Oct 2018 10:11:12 -0000       1.6
@@ -13,4 +13,9 @@
 Crawl-delay: 4
 Disallow: /server/trans-map.html
 
+# RT #1298215.
+User-agent: *
+Crawl-delay: 4
+Disallow: /server/select-language.html
+
 Sitemap: http://www.gnu.org/sitemap.xml