[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: wget timeout does not work
|
From: |
Tim Rühsen |
|
Subject: |
Re: wget timeout does not work |
|
Date: |
Fri, 25 Feb 2022 15:33:03 +0100 |
|
User-agent: |
Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.5.1 |
On 16.02.22 00:32, Dave Henderson wrote:
Good afternoon. I am trying to use wget to crawl some sites and one
of the sites that it gets to makes it get stuck. I've tried using all
the timeout parameters, even each individually. None of them work.
It just stays stuck. Here's the link it is getting stuck on:
https://www.adidas.com/us/women-sports_bras?cm_mmc=AdiDisplay_-_-training-_--_-Billboard-_-Default_ad-_-dv%3ABrand-_-cn%3ABRAREVOLUTIONAPPSS22_Reach-_-pc%3Atraining&cm_mmc1=GLOBAL&cm_mmc2=adidas-GLOBAL-Brand-Display-training-Multiple-GLOBAL-BRAREVOLUTIONAPPSS22-2202
Looking forward to hearing back!
By default, wget retries up to 20x, with a growing time span between
retries.
Just try --timeout=3 --tries=1.
Regards, Tim
OpenPGP_signature
Description: OpenPGP digital signature