parallel
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Spreading parallel across nodes on HPC system


From: Ken Mankoff
Subject: Re: Spreading parallel across nodes on HPC system
Date: Fri, 11 Nov 2022 08:05:32 +0100
User-agent: mu4e 1.8.10; emacs 27.1

Hi Rob,

On 2022-11-10 at 21:21 +01, Rob Sargent <robjsargent@gmail.com> wrote:
> I do this, in slurm bash script, to get the number of jobs I want to
> run (turns out it's better for me to not load the full hyper-threaded
> count)
>
>    cores=`grep -c processor /proc/cpuinfo`
>    cores=$(( $cores / 2 ))
>
>    parallel --jobs $cores etc :::: <file with list of jobs>
>
> or sometimes the same jobs many times with
>
>    parallel --jobs $cores etc ::: {1..300}

I apologize if I am missing something, but I don't see how this solves 
distributing to different hosts (nodes), where each host may have a different 
number of CPUs or cores.

  -k.




reply via email to

[Prev in Thread] Current Thread [Next in Thread]