[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Octave-bug-tracker] [bug #55909] Performance of hist

From: Michael Leitner
Subject: [Octave-bug-tracker] [bug #55909] Performance of hist
Date: Thu, 14 Mar 2019 05:42:20 -0400 (EDT)
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Firefox/52.0

Follow-up Comment #3, bug #55909 (project octave):

The test passes now. The solution was trivial, just converting to double where
it is necessary. Of course this is undesirable, because it increases memory
requirements, but the most efficient algorithm of scaling, shifting and
rounding y for direct use as indices just does not work in integer

It would be possible to use the old code path for integer input, but I think
this would be worse: after all, there is an obvious work-around for keeping
the memory down with the present proposal (just computing histograms of parts
of the data and adding up), while there would be no possibility to choose the
efficient algorithm in the converse case. I admit that one could have it both
by doing the piece-meal histogramming in an inner loop inside hist.m itself in
the case of very large inputs, but I do not feel this to be warranted (yet).

(file #46532)

Additional Item Attachment:

File name: hist_diff2                     Size:2 KB


Reply to this item at:


  Message sent via Savannah

reply via email to

[Prev in Thread] Current Thread [Next in Thread]