|
From: | Thérèse Godefroy |
Subject: | [Savannah-hackers-public] Please disallow www-commits in robots.txt |
Date: | Wed, 10 May 2023 18:18:36 +0200 |
User-agent: | Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.10.0 |
Hello, I was searching for an article with DuckDuckGo, and guess what appeared on top of the results... https://lists.gnu.org/archive/html/www-commits/2023-05/msg00082.html and https://lists.gnu.org/archive/html/www-commits/2023-05/msg00062.html !! I understand it wouldn't be practical to make this list private, but it could at least be off-limits for crawlers. Thanks! Thérèse
[Prev in Thread] | Current Thread | [Next in Thread] |