parallel
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Dynamically changing remote servers list


From: Douglas A. Augusto
Subject: Re: Dynamically changing remote servers list
Date: Thu, 11 Sep 2014 17:14:57 -0300
User-agent: Mutt/1.5.23 (2014-03-12)

On 11/09/2014 at 09:42,
Ole Tange <ole@tange.dk> wrote:

> It it starting to be as ugly as the sed command, but it might just be
> more portable: We avoid having to deal with different odd dialects of
> sed.

Thanks again. I think I finally managed to make the server update script works:

   cp original.slf updated.slf
   while [ 1 ] ; do
      nice parallel --timeout 1000% --nonall -j0 -k --slf original.slf --tag 
echo | \
         sed -e 's#\t$##' -e '#\t#d' | \
         nice parallel -k perl -ne 
\"\\\$host=\'{}\'";\\\$host=~s#\\\\\##g;/^(\d+\/)?\\\\Q\\\$host\\\\E\\\$/ and 
print and exit"\" original.slf > tmp.slf

      if ! cmp -s tmp.slf updated.slf; then
         mv tmp.slf updated.slf
      fi

      sleep 10
   done &
   parallel --slf updated.slf ...

Indeed, it is kind of ugly, but seems to get the job done (maybe it could be
simplified, though). Will you consider updating the manpage with this newer
version of the script?

I'll think about how to wrap those commands within a daemon, but first I need
to investigate why GNU Parallel is not respecting the number of slots on a host
when servers are dynamically included/excluded.

-- 
Douglas A. Augusto



reply via email to

[Prev in Thread] Current Thread [Next in Thread]