[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: datamash performance question

From: Dima Kogan
Subject: Re: datamash performance question
Date: Fri, 25 Jun 2021 13:43:51 -0700
User-agent: mu4e 1.4.15; emacs 28.0.50

Jake VanEck <jake.vaneck@gmail.com> writes:

> I've tried similar commands but doesn't awk need to put the entire dataset
> into memory for this?

No. Absolutely not. It will read the input one line at a time, keeping
the running sums in memory, and it will write out the sums when the
input is exhausted.

If you care about performance, try out mawk specifically. It's a bit
snappier than other implementations.

reply via email to

[Prev in Thread] Current Thread [Next in Thread]