[drmaa-wg] Added flow processor to DRMAA for Ruby samples
Andreas Haas
Andreas.Haas at Sun.COM
Tue Jun 20 06:13:47 CDT 2006
Hi,
I added yesterday a little flow processor to the DRMAA for Ruby
samples. A short description can be found in README below.
Regards,
Andreas
== Workflow interpreter and processor
flow.rb is a utility for running job workflows in
DRMAA-compliant DRM systems. Workflows are specified in
flowfiles that allow expression of
* concurrent and sequencial execution of sub-flows
* multiple runs of sub-flows with varying parameter sets
* acutal jobs are defined in terms of DRMAA attributes
in addition any subflow or sets of subflows can be run
as used with make(1) by specifying it as target.
=== Job defaults
To minimize the extend attributes necessarily to be
specified in flowfiles, flow.rb provides defaults for
jobs command path, stdout/stdin path, current working
directory and job name.
=== Workflow verification
The -verify option can be used to print dependencies and
job attributes for diagnosis purposes and to ensure each
workflow job can be run, a number of verifications is
performed before the first job gets submitted.
=== Job streaming
Large workflows are automatically run in job streaming
mode upon DRM saturation and a job maximum can be used
to set in .flowrc.rb an upper limit of job concurrently
be kept in the DRM for each workflow.
=== Pre-submission plug-in
Enforcement of site-specific policies can easily be
achieved through pre-submission procedures that allow
any job attribute freely be modified.
More information about the drmaa-wg
mailing list