parallel
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Parallel Merge


From: Nathan Watson-Haigh
Subject: Parallel Merge
Date: Wed, 17 Aug 2011 20:43:27 +0930

I just found this tool today and I'm very impressed with it!

I've seen the example for parallelising sort....is there a way to spread the merge part amoung more cores? I'm trying to do a sort over 200million lines - the merge part takes several minutes to complete.

How do I write a script for this so I can use it as a drop-in replacement for a sort command used in the pipeline of another software tool?

Cheers,
Nathan



AWRI logo 

Nathan Watson-Haigh
Senior Bioinformatician | The Australian Wine Research Institute
Waite Precinct, Hartley Grove cnr Paratoo Road, Urrbrae (Adelaide) SA 5064 | Map
PO Box 197, Glen Osmond SA 5064,
Australia
( +61 8 83136836 (direct) | ( +61 8 83136600 | Ê +61 8 83136601
8 www.awri.com.auAWRI Events


This communication, including attachments, is intended only for the addressee(s) and contains information which might be confidential and/or the copyright of The Australian Wine Research Institute (AWRI) or a third party. If you are not the intended recipient of this communication please immediately delete and destroy all copies and contact the sender. If you are the intended recipient of this communication you should not copy, disclose or distribute any of the information contained herein without the consent of the AWRI and the sender. Any views expressed in this communication are those of the individual sender except where the sender specifically states them to be the views of the AWRI. No representation is made that this communication, including attachments, is free of viruses. Virus scanning is recommended and is the responsibility of the recipient.


reply via email to

[Prev in Thread] Current Thread [Next in Thread]