Hello,
In order to process things in parallel I developed a simple
tool to run (for the moment) parameter sweep applications.
I.e. you want to run many times the same program with only
different input parameters.
It can be used to parallelize execution on a multi processor
machine or even to distribute jobs if you have access to a cluster
or at least a few workstations (need to have Python Pyro installed
on them then).
You can download the project from here:
http://savannah.nongnu.org/projects/par/
Here is the help message:
---
user@pc:~# parallel.py
-i or -c is mandatory
Usage: parallel.py [options] -i | -c ...
Execute commands in parallel.
[-h | --help] you are currently reading it
-c | --client servername read commands from a server
instead of a file
use -c or -i, not both
-i | --input commands_file /dev/stdin for example
[-o | --output output_file] log to a file instead of stdout
[-p | --post python_module] specify a post processing module
(omit the '.py' extension)
[-s | --server] accept remote workers
[-v | --verbose] enables progress bar
[-w | --workers n] number of local worker threads
must have n >= 0
n == 0 can be useful to only run
the server
---
I hope it can be useful to other people.
Regards,
Francois Berenger.
|