www robots.txt

[Ineiev]

CVSROOT:        /web/www
Module name:    www
Changes by:     Ineiev <ineiev> 18/05/31 04:57:23

Modified files:
        .              : robots.txt 

Log message:
        Add /server/trans-map.html, RT #1298215.

CVSWeb URLs:
http://web.cvs.savannah.gnu.org/viewcvs/www/robots.txt?cvsroot=www&r1=1.4&r2=1.5

Patches:
Index: robots.txt
===================================================================
RCS file: /web/www/www/robots.txt,v
retrieving revision 1.4
retrieving revision 1.5
diff -u -b -r1.4 -r1.5
--- robots.txt  8 May 2015 03:21:26 -0000       1.4
+++ robots.txt  31 May 2018 08:57:22 -0000      1.5
@@ -8,4 +8,9 @@
 Crawl-delay: 4
 Disallow: /savannah-checkouts/
 
+# RT #1298215.
+User-agent: *
+Crawl-delay: 4
+Disallow: /server/trans-map.html
+
 Sitemap: http://www.gnu.org/sitemap.xml