Hello,
I am using parallel to process a large amount of files. This morning I
found that it has crashed during the night.
Here is the message I get:
parallel: This should not happen. You have found a bug.
Please contact <parallel@gnu.org> and include:
* The version number: 20161222
* The bugid: swap_activity_file-r
* The command line being run
* The files being read (put the files on a webserver if they are big)
The command was:
parallel --bar --memfree 100G \
--noswap -j 100% \
./worker.sh :::: paths.csv
worker.sh does some pre-processing on the data and eventually launches
a
python script. It also redirects the error output with `2> foo.txt`
when
launching the python script if that is relevant.
paths.csv contains a list of file paths, one per line.
Unfortunately I am not a liberty to share the python script or the
files
being processed. I hope there is enough information here!
Happy to give more details if needed.
Thanks, and thanks for your work on this awesome tool!
-- Julien