[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Query regarding stackoverflow question (Run million of list in PBS w
|
From: |
Ole Tange |
|
Subject: |
Re: Query regarding stackoverflow question (Run million of list in PBS with parallel tool) |
|
Date: |
Sun, 13 Oct 2019 15:09:56 +0200 |
On Fri, Oct 4, 2019 at 6:33 AM Rajiv Gandhi Govindaraj
<rajiv@hotspotthera.com> wrote:
> Thanks for this great tool and for helping me out on this.
You can pay back by spreading the word and help others use the tool.
> As per you suggestion I've introduced a simple function and tested in my
> local machine which has a 4 cpu for a list contains 10,000:
>
> top shows 4 running while using --pipepart --block -10k (option 2) but shows
> only 1-2 running in others ( option 1 & 3):
Oh. --block -10k is not supported currently. It would run 10000 jobs
per cpu thread.
> Here are the completed time in using/not-using function in script:
Your example does not work on my machine. To debug I need an example
that will also run on my machine. That means you need to include
everything you reference. In practice you will need to make a new
script that shows the same behaviour but which can run without your
own data.
/Ole