savannah-hackers-public
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Savannah-hackers-public] Please disallow www-commits in robots.txt


From: Thérèse Godefroy
Subject: Re: [Savannah-hackers-public] Please disallow www-commits in robots.txt
Date: Sat, 13 May 2023 11:24:28 +0200
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.10.0

Le 12/05/2023 à 22:24, Ian Kelling a écrit :
[...]
robots.txt isn't about just not making things public, it is perfectly
valid to use for SEO and helping google turn up the best results for
your site and avoiding non-canonical duplicate pages. I've seen
www-commits list archive pages come up in searches before and they were
not what I wanted. In that light, this request sounds like a good idea
to me. I will implement it. We can change it back if webmasters agree
otherwise.


Thank you, Ian!



reply via email to

[Prev in Thread] Current Thread [Next in Thread]