bug-wget
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Bug-wget] [bug #32054] Concurrent processes of wget on ftp directories


From: Ross Burton
Subject: [Bug-wget] [bug #32054] Concurrent processes of wget on ftp directories produces comingled files
Date: Tue, 25 Jul 2017 06:27:28 -0400 (EDT)
User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_5) AppleWebKit/603.2.4 (KHTML, like Gecko) Version/10.1.1 Safari/603.2.4

Follow-up Comment #4, bug #32054 (project wget):

This is a genuine bug and I just spent a day chasing it, starting from random
failures in our tarball monitoring system.

If you have two wget processes started at the same time:

$ wget ftp://example.com/foo -O foo.html
$ wget ftp://example.com/bar -O bar.html

These will both write the FTP listing to .listing before processing it to
generate HTML, with the expected races.

Sometimes wget will fail because .listing was deleted before they need it.
Sometimes foo.html will contain the listing for /bar.

As this is a temporary file, can't wget just use mktemp?

    _______________________________________________________

Reply to this item at:

  <http://savannah.gnu.org/bugs/?32054>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.gnu.org/




reply via email to

[Prev in Thread] Current Thread [Next in Thread]