[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Wget-dev] wget2 | -p -nc doesn't behave properly (#451)

From: Tim Rühsen
Subject: Re: [Wget-dev] wget2 | -p -nc doesn't behave properly (#451)
Date: Tue, 11 Jun 2019 13:07:38 +0000

One approach (as simple as possible) is... whenever a URL is being added as 
job, we generate the 'local_filename' check if it exists as a regular file. If 
it exists (and has filetype HTML, CSS, RSS, ...), we skip downloading and 
instead load/parse it. This is a simple straight forward strategy.

The current approach first tries to fetch the header (in fact it sends a GET 
instead HEAD), determines the *real* local filename (e.g. original may be 
changed due Content-Disposition and others) and then loads/parses the local 
file if it exists. This is too complicated and error-prone, IMO.

Reply to this email directly or view it on GitLab: 
You're receiving this email because of your account on gitlab.com.

reply via email to

[Prev in Thread] Current Thread [Next in Thread]