[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Wget-dev] wget2 | Using --robots=off / --no-robots downloads the ro
From: |
Archit Pandey |
Subject: |
Re: [Wget-dev] wget2 | Using --robots=off / --no-robots downloads the robots.txt file and scans it for sitemaps (!454) |
Date: |
Tue, 22 Oct 2019 10:02:51 +0000 |
Archit Pandey commented on a discussion:
https://gitlab.com/gnuwget/wget2/merge_requests/454#note_233790786
> Please amend the documentation for --robots in docs/wget2.md. Otherwise LGTM
> :-).
Updated in
https://gitlab.com/gnuwget/wget2/merge_requests/454/diffs?commit_id=d8e838ab3561636a21a9026e7dab847b4102d610
> You don't have to. That's what we have the CI runners for. A `make clean &&
> make check` is fine as long > as you don't see compiler warnings or failing
> tests. For development it is good to turn our manywarnings > feature on with
> `touch .manywarnings && ./configure`.
> `./bootstrap` and `./configure` is only needed when you touch configure.ac,
> Makefile.am, bootstrap.conf > (and possibly some other files).
Will keep these in mind from now on, could potentially save me some time ;-)
--
Reply to this email directly or view it on GitLab:
https://gitlab.com/gnuwget/wget2/merge_requests/454#note_233790786
You're receiving this email because of your account on gitlab.com.
- [Wget-dev] wget2 | Robot fix (!454), Archit Pandey, 2019/10/22
- Re: [Wget-dev] wget2 | Using --robots=off / --no-robots downloads the robots.txt file and scans it for sitemaps (!454), Tim Rühsen, 2019/10/22
- Re: [Wget-dev] wget2 | Using --robots=off / --no-robots downloads the robots.txt file and scans it for sitemaps (!454),
Archit Pandey <=
- Re: [Wget-dev] wget2 | Using --robots=off / --no-robots downloads the robots.txt file and scans it for sitemaps (!454), Tim Rühsen, 2019/10/22
- Re: [Wget-dev] wget2 | Using --robots=off / --no-robots downloads the robots.txt file and scans it for sitemaps (!454), Tim Rühsen, 2019/10/22
- Re: [Wget-dev] wget2 | Using --robots=off / --no-robots downloads the robots.txt file and scans it for sitemaps (!454), Archit Pandey, 2019/10/22
- Re: [Wget-dev] wget2 | Using --robots=off / --no-robots downloads the robots.txt file and scans it for sitemaps (!454), Tim Rühsen, 2019/10/22
- Re: [Wget-dev] wget2 | Using --robots=off / --no-robots downloads the robots.txt file and scans it for sitemaps (!454), Tim Rühsen, 2019/10/22
- Re: [Wget-dev] wget2 | Using --robots=off / --no-robots downloads the robots.txt file and scans it for sitemaps (!454), Tim Rühsen, 2019/10/22
- Re: [Wget-dev] wget2 | Using --robots=off / --no-robots downloads the robots.txt file and scans it for sitemaps (!454), Tim Rühsen, 2019/10/22
- Re: [Wget-dev] wget2 | Using --robots=off / --no-robots downloads the robots.txt file and scans it for sitemaps (!454), Archit Pandey, 2019/10/22