[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
bug#52338: [maintenance] hydra: berlin: Create robots.txt.
From: |
Leo Famulari |
Subject: |
bug#52338: [maintenance] hydra: berlin: Create robots.txt. |
Date: |
Mon, 6 Dec 2021 17:18:10 -0500 |
I tested that `guix system build` does succeed with this change, but I
would like a review on whether the resulting Nginx configuration is
correct, and if this is the correct path to disallow. It generates an
Nginx location block like this:
------
location /robots.txt {
add_header Content-Type text/plain;
return 200 "User-agent: *
Disallow: /nar
";
}
------
* hydra/nginx/berlin.scm (berlin-locations): Add a robots.txt Nginx location.
---
hydra/nginx/berlin.scm | 9 ++++++++-
1 file changed, 8 insertions(+), 1 deletion(-)
diff --git a/hydra/nginx/berlin.scm b/hydra/nginx/berlin.scm
index 1f4b0be..3bb2129 100644
--- a/hydra/nginx/berlin.scm
+++ b/hydra/nginx/berlin.scm
@@ -174,7 +174,14 @@ PUBLISH-URL."
(nginx-location-configuration
(uri "/berlin.guixsd.org-export.pub")
(body
- (list "root /var/www/guix;"))))))
+ (list "root /var/www/guix;")))
+
+ (nginx-location-configuration
+ (uri "/robots.txt")
+ (body
+ (list
+ "add_header Content-Type text/plain;"
+ "return 200 \"User-agent: *\nDisallow: /nar/\n\";"))))))
(define guix.gnu.org-redirect-locations
(list
--
2.34.0
- bug#52338: Crawler bots are downloading substitutes, Leo Famulari, 2021/12/06
- bug#52338: [maintenance] hydra: berlin: Create robots.txt.,
Leo Famulari <=
- bug#52338: Crawler bots are downloading substitutes, Mathieu Othacehe, 2021/12/09
- bug#52338: Crawler bots are downloading substitutes, Tobias Geerinckx-Rice, 2021/12/09
- bug#52338: Crawler bots are downloading substitutes, Leo Famulari, 2021/12/10
- bug#52338: Crawler bots are downloading substitutes, Tobias Geerinckx-Rice, 2021/12/10
- bug#52338: Crawler bots are downloading substitutes, Mathieu Othacehe, 2021/12/11
- bug#52338: Crawler bots are downloading substitutes, Mathieu Othacehe, 2021/12/19
bug#52338: Crawler bots are downloading substitutes, Mark H Weaver, 2021/12/10