[Octave-bug-tracker] [bug #58618] [octave forge] (io) csv2cell does not read all rows

[Andreas Bertsatos]

Follow-up Comment #4, bug #58618 (project octave):

updated the source file with

#define MAXSTRINGLENGTH 16384

and it works like a charm, thanks. I am currently working with HOG
descriptors, which tend to result to rather large vectors. Although, my case
file was just little bit above the previous limit, I consider a 4-fold
increase to be the minimum by today's standards. I run a simple tic toc test
by repeatedly (100 times) reading a reasonably sized csv (file size = 337.1KB;
cell size = 151x290) that works well under both versions of csv2cell and the
performance difference was negligible

   2.74406 seconds @MSL 16384 vs 2.61971 sec @MSL 4096

Additional testing with MAXSTRINGLENGTH 32768 returned 2.97757 seconds.
So, either 16384 or 32768 will do I think, although the latter seems like an
overkill to me. I hope somebody else, who regularly uses large csv files,
might share an opinion on this matter.

Recompiling csv2cell.cc as Philip suggested, didn't work because it produced
fatal error due to missing "config.h" dependency. So the workaround was to
make the change inside the package source file and re-install it locally.

Many thanks :)

    _______________________________________________________

Reply to this item at:

  <https://savannah.gnu.org/bugs/?58618>

_______________________________________________
  Message sent via Savannah
  https://savannah.gnu.org/