Re: join bug

[Bob Proulx]

Martin Schmeing wrote:
> Is there a size limit for the input files for join?

Long lines will consume as much memory as needed to work with the full
size of the line.  In the extreme if lines are extremely long then it
will use an extreme amount of memory.  Size of memory is an effective
limit.  But I think it is unlikely you are running into that problem
if you are using join on normal-ish text files.

> I want to do it with large files, but even files of 1000 lines fail

First off please ensure that your input files are sorted.  That is the
first level of confusion that people typically have with join.

In what way does join fail?  What error messages does it produce?
What is the exit code of the program?  What normal output is produced
by it?

If you have found a bug in join then try to reduce it to a small test
case that we can recreate.  Once a test case can be made reproducable
in a small data set then the solution is usually quick to follow.

Bob