[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
bug#13089: Wish: split every n'th into n pipes
From: |
Ole Tange |
Subject: |
bug#13089: Wish: split every n'th into n pipes |
Date: |
Wed, 5 Dec 2012 15:11:32 +0100 |
I often have data that can be processed in parallel.
It would be great if split --filter could look at every n'th line
instead of chunking into n chunks:
cat bigfile | split --every-nth -n 8 --filter "grep foo"
The above should start 8 greps and give each a line in round robin manner.
Ideally it should be possible to do so non-blocking so if some lines
take longer for one instance of grep, then the rest of the greps are
not blocked.
/Ole
- bug#13089: Wish: split every n'th into n pipes,
Ole Tange <=