Re: [Chicken-users] Anyone tried using datadraw with Chicken?

[Matthew Welland]

On Friday 23 May 2008 05:04:40 am Joshua Griffith wrote:
> Matt,
>
> Have you tried using an in-memory SQLite3 database rather than working
> from disk?  Also, are you pre-compiling and caching your statements?
> Both of these will dramatically speed things up.

I have pre-compiled/cached the statements (by which I assume you mean 
sqlite:prepare) and I have turned synchronous access off. This made a huge 
difference (over a day to hours). I didn't think to try in-memory but since 
I need to write the data back out I suspect the overall speed up may not be 
great. It is worth a try though. Thanks.

Matt
-=-

> -Josh
>
> On May 22, 2008, at 11:41 PM, Matthew Welland wrote:
> > Has anyone tried using datadraw (http://datadraw.sourceforge.net/)
> > with
> > Chicken? If so did any of the claimed performance benefits transfer to
> > Chicken code? It almost seems like a scheme compiler or interpreter
> > could
> > be built on top of datadraw or coupled extremely close to it rather
> > than
> > moving data in and out of it but in any case an interface to chicken
> > seems
> > like it'd be really cool.
> >
> > I have some large chunks of data to munge and Chicken + sqlite3 is
> > proving a
> > bit slow (8-20 hour run times) and I'm considering rethinking my
> > approach.
> >
> > Thanks in advance for any comments and insight.
> >
> > Matt
> > -=-
> >
> >
> > _______________________________________________
> > Chicken-users mailing list
> > address@hidden
> > http://lists.nongnu.org/mailman/listinfo/chicken-users



-- 
http://www.kiatoa.com, fight for a better world.