[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
File size limits in textread()?
From: |
koufalas |
Subject: |
File size limits in textread()? |
Date: |
Fri, 10 Jun 2005 12:53:57 +1000 |
G'day all,
I'm using textread() to read in mixed string and integer data from a space
delimited text file. I found it worked okay with one data file, but then hangs
when reading another, larger data file. Hitting ctrl-c brings back the octave
prompt.
Any ideas as to why textread() doesn't like the larger data file? This file has
about 6000 rows and 10 columns, 4 of which are strings, the others are integers.
I'm now using a loop with fgetl() and split(), but it's very slow.
The data file is generated from a database query. I might use 2 queries, one
for integer data and one for string data. That way at least I can use load or
dlmread() to quickly pull in the integer data, and then deal with the string
data using textread().
-------
BTW, the data file is generated from a database query. I had earlier asked
about interfacing octave to databases (postgreSQL) as I had problems with some
interface code from Dirk Eddelbeuttel. I believe that was because the
postgresql version I'm using, 7.2.1, was built using g++ 2.95, i.e. shared
libraries for c++ interfacing had unresolved symbols for this reason--lack of
agreed ABI. I'll try again at some stage with 7.4, but I have a 5GB database
that will have to be converted before I can do that...takes ages.
Cheers,
Paul Koufalas
Adelaide, S. Australia
This message was sent through MyMail http://www.mymail.com.au
-------------------------------------------------------------
Octave is freely available under the terms of the GNU GPL.
Octave's home on the web: http://www.octave.org
How to fund new projects: http://www.octave.org/funding.html
Subscription information: http://www.octave.org/archive.html
-------------------------------------------------------------
- File size limits in textread()?,
koufalas <=