|
From: | Thérèse Godefroy |
Subject: | Re: [Savannah-hackers-public] Please disallow www-commits in robots.txt |
Date: | Sat, 13 May 2023 11:24:28 +0200 |
User-agent: | Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.10.0 |
Le 12/05/2023 à 22:24, Ian Kelling a écrit : [...]
robots.txt isn't about just not making things public, it is perfectly valid to use for SEO and helping google turn up the best results for your site and avoiding non-canonical duplicate pages. I've seen www-commits list archive pages come up in searches before and they were not what I wanted. In that light, this request sounds like a good idea to me. I will implement it. We can change it back if webmasters agree otherwise.
Thank you, Ian!
[Prev in Thread] | Current Thread | [Next in Thread] |