|
| From: | Thérèse Godefroy |
| Subject: | Re: [Savannah-hackers-public] Please disallow www-commits in robots.txt |
| Date: | Sat, 13 May 2023 11:54:12 +0200 |
| User-agent: | Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.10.0 |
Le 12/05/2023 à 22:24, Ian Kelling a écrit : [...]
robots.txt isn't about just not making things public, it is perfectly valid to use for SEO and helping google turn up the best results for your site and avoiding non-canonical duplicate pages.
_Non-canonical_ is the most important word here. The staging area may contain outdated articles.
| [Prev in Thread] | Current Thread | [Next in Thread] |