bug-tar
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Bug-tar] Multi-threaded tar


From: Joerg Schilling
Subject: Re: [Bug-tar] Multi-threaded tar
Date: Tue, 31 Jul 2018 12:23:12 +0200
User-agent: Heirloom mailx 12.5 7/5/10

"J.R. Heisey" <address@hidden> wrote:

> Greetings,
>
> I was trying to make some processes faster which use tar a bit on large 
> archives.
>
> I was able to use the command line options --use-compress-program pbzip2 and 
> that helped a lot.
>
> I was wondering if anyone has experimented using pthreads in the tar 
> implementation. I don't see any references in version 1.30 of the source or 
> readme I downloaded. Anyone discussed a strategy for using pthreads in 
> previous postings?

Star forks and runs two processes since approx. 30 years.

The first process is for the filesystem I/O and the second process is for the 
archive I/O. between both, there is a ring buffer with configurable size that 
decouples both tasks. This helps to make star very fast.

Implementing something like this in a TAR implementation that does not yet have 
support for it is highly complex.

Jörg

-- 
 EMail:address@hidden                    (home) Jörg Schilling D-13353 Berlin
    address@hidden (work) Blog: http://schily.blogspot.com/
 URL: http://cdrecord.org/private/ http://sf.net/projects/schilytools/files/'



reply via email to

[Prev in Thread] Current Thread [Next in Thread]