[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Combining gnu parallel and mpirun: how to take care of the max number of
Combining gnu parallel and mpirun: how to take care of the max number of cores?
Mon, 18 Nov 2019 11:14:25 -0500
I have a machine with 32 cores where a I want to run some mpi jobs with a variable number of cores (this is because the problem requires that). Is there a way to make gnu parallel aware of the number of mpi jobs to manage when to launch each job?
Let's say that I have to launch many (200) jobs with following number of mpi jobs:
NMPI=(2 2 2 4 4 4 4 6 7 10 12 24 32)
Therefore, initially I want to run the first 8 elements of the array (sum less that the total number of cores, 32), and then run sequentially each other job gradually as soon as each of the firsts are finishing, without surpassing the limit 32 <= NMPITOTAL, where NMPITOTAL is the total number of mpi jobs running at the moment. For example, if the first 5 jobs are running, according to the array above one has
NMPITOTAL = (2+2+2+4+4) = 14 total processes running, can run some more.
Thanks in advance for your help
Best regards / Cordialmente, William-Fernando Oquendo
Este correo puede carecer de tildes o eñes debido al teclado.
|[Prev in Thread]
||[Next in Thread]|
- Combining gnu parallel and mpirun: how to take care of the max number of cores?,
William Oquendo <=