[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
www robots.txt
From: |
Ineiev |
Subject: |
www robots.txt |
Date: |
Sun, 7 Oct 2018 06:11:13 -0400 (EDT) |
CVSROOT: /web/www
Module name: www
Changes by: Ineiev <ineiev> 18/10/07 06:11:13
Modified files:
. : robots.txt
Log message:
Disallow /server/select-language.html, RT #1298215.
CVSWeb URLs:
http://web.cvs.savannah.gnu.org/viewcvs/www/robots.txt?cvsroot=www&r1=1.5&r2=1.6
Patches:
Index: robots.txt
===================================================================
RCS file: /web/www/www/robots.txt,v
retrieving revision 1.5
retrieving revision 1.6
diff -u -b -r1.5 -r1.6
--- robots.txt 31 May 2018 08:57:22 -0000 1.5
+++ robots.txt 7 Oct 2018 10:11:12 -0000 1.6
@@ -13,4 +13,9 @@
Crawl-delay: 4
Disallow: /server/trans-map.html
+# RT #1298215.
+User-agent: *
+Crawl-delay: 4
+Disallow: /server/select-language.html
+
Sitemap: http://www.gnu.org/sitemap.xml
[Prev in Thread] |
Current Thread |
[Next in Thread] |
- www robots.txt,
Ineiev <=