RE: Multiple Inputs xml files and multiple xsl files to

[Cook, Malcolm]

Alex,

You have a lot of detail you are specifying that is cluttering up your 
understanding of parallel.

Perhaps the following mini-tutorial will build up the concepts it sounds like 
you want to use.

# create 2 empty xml files and 3 empty xlst files
$ touch f{1..2}.xml
$ touch f{1..3}.xlst

# look at them
$ ls f*.{xml,xlst}
f1.xlst  f1.xml  f2.xlst  f2.xml  f3.xlst

# show off how to process them pairwise
$ parallel echo  do something to {1} and to {2} ::: f*.xml ::: f*.xlst
do something to f1.xml and to f1.xlst
do something to f1.xml and to f2.xlst
do something to f1.xml and to f3.xlst
do something to f2.xml and to f1.xlst
do something to f2.xml and to f2.xlst
do something to f2.xml and to f3.xlst

# show off how to construct named output file also
$ parallel echo  do something to {1} and to {2} putting output into 
{1.}_{2.}.res ::: f*.xml ::: f*.xlst
do something to f1.xml and to f1.xlst putting output into f1_f1.res
do something to f1.xml and to f2.xlst putting output into f1_f2.res
do something to f1.xml and to f3.xlst putting output into f1_f3.res
do something to f2.xml and to f1.xlst putting output into f2_f1.res
do something to f2.xml and to f2.xlst putting output into f2_f2.res
do something to f2.xml and to f3.xlst putting output into f2_f3.res


# now replace my echo sentence with your command - your use of advanced remote 
features will make your job harder

???

~ malcolm_cook@stowers.org

________________________________________
From: parallel-bounces+mec=stowers.org@gnu.org 
[parallel-bounces+mec=stowers.org@gnu.org] on behalf of Alex Muir 
[alex.g.muir@gmail.com]
Sent: Friday, February 13, 2015 1:19 PM
To: Ole Tange
Cc: parallel@gnu.org
Subject: Re: Multiple Inputs xml files and multiple xsl files to

On Fri, Feb 13, 2015 at 7:02 PM, Ole Tange 
<tange@gnu.org<mailto:tange@gnu.org>> wrote:
You simply add a :

    parallel echo :::: file1 file2

I do not know Calabash, but your are probably looking for something
along the lines of:

    PARALLEL="-j+$NumberExtraJobsPerServer --bar --sshlogin $servers
--timeout $timeout --joblog $jobLog" \
      parallel "sh /mnt/schematron/scripts/runCalabash.sh {2}
$documentSpecficLogs{1/.}Log.txt {1}" ::: $sourceDir*.xml :::
/mnt/schematron/xpl/*.xpl

If the tutorial does not help you, please show 4 the commands that you
want run given 2 xml-files and 2 xsl-files.



 ::: $sourceDir*.xml ::: -- Okay I didn't know you could do this with multiple 
files. I don't think that is clear on the tutorial.

I've read the tutorial however the use of multiples files only has examples 
such as " ls $sourceXMLDir*.xml |  parallel " i that I'm using.

What I'm doing is creating an initial parallel process loading that use ls  
$sourceXMLDir*.xml as input on one cpu which executes a script that loads ls  
$sourceXSLDir*.xsl as input which works. That second script is essentially the 
second line below and the first line below starts the process.


ls  $sourceXMLDir*.xml |  parallel -j1 --eta --progress --sshlogin $local 
--timeout $timeout --joblog $jobLog "sh 
/home/ec2-user/lech/bitbucket/schematronification/execute/Run-Parallel-Process-XSL.sh
 {}" $1

ls  $sourceXSLDir*.xsl |  parallel -j+$NumberExtraJobsPerServer --eta 
--progress --sshlogin $servers --timeout $timeout --joblog $jobLog "sh 
/home/ec2-user/lech/bitbucket/schematronification/execute/runCalabash.sh 
/home/ec2-user/lech/bitbucket/schematronification/xpl/RunSingleAssertionXSLTAgainstXML.xpl
 $documentSpecficLogs{/.}Log.txt {}" $1 $outputDir $logging $debug


Can that be reduced into 1 statement essentially running every.combination of 
*.xml with a *.xslt  using their file names as input into 
RunSingleAssertionXSLTAgainstXML.xproc?

Thanks
Alex

-

Regards
Alex
www.tilogeo.com<http://www.tilogeo.com>