Trying to use parallel to proceed 280k user id against 31 day web log (avg 50m each) to find a match. Got the following output...
[root@tapp03 tmp]# cat SRD_exp_sid_20110208(the 280k user id list) | time parallel --eta -j+0 -I @@ " grep -m 1 '\&subscriber_id=@@\&' log.2011Jan.clean(processed apache web log file)" >SRD_output_2011Jan
.... Use of uninitialized value in hash element at /usr/local/bin/parallel line 3287, <STDIN> line 273595. Use of uninitialized value in hash element at /usr/local/bin/parallel line 3284, <STDIN> line 274514.
Use of uninitialized value in hash element at /usr/local/bin/parallel line 3287, <STDIN> line 274514. Use of uninitialized value in hash element at /usr/local/bin/parallel line 3284, <STDIN> line 274977.
Use of uninitialized value in hash element at /usr/local/bin/parallel line 3287, <STDIN> line 274977.
Computer:jobs running/jobs completed/%of started jobs/Average seconds to complete ETA: 24664s 247244left 0.10avg local:16/28534/100%/0.1s This should not happen. Contact <parallel@gnu.org>. at /usr/local/bin/parallel line 3384.
Command exited with non-zero status 25 13699.20user 26437.79system 47:32.72elapsed 1406%CPU (0avgtext+0avgdata 0maxresident)k 0inputs+0outputs (0major+32485174minor)pagefaults 0swaps [root@tapp03 tmp]# [root@tapp03 tmp]# parallel -V
GNU parallel 20110205 Copyright (C) 2007,2008,2009,2010 Ole Tange and Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it. GNU parallel comes with no warranty.