jobarchitect.sketchjob

Tool to create jobs to carry out analyses on datasets.

class jobarchitect.sketchjob.JobSketcher(tool_path, dataset_path, output_root, image_name=None)

Class to build up jobs to analyse a dataset.

sketch(backend, nchunks, identifiers)

Return generator yielding instances of jobarchitect.JobSec.

Parameters:

• backend – backend function for generating job scripts
• nchunks – number of chunks the job should be split into
• identifiers – identifiers to create jobs for

Returns:

generator yielding jobs as strings

jobarchitect.sketchjob.generate_jobspecs(tool_path, dataset_path, output_root, nchunks, image_name=None, identifiers=None)

Return generator yielding instances of jobarchitect.JobSec.

Parameters:

• tool_path – path to tool
• dataset_path – path to input dataset
• output_root – path to output root
• nchunks – number of chunks the job should be split into
• image_name – container image name

Returns:

generator yielding instances of jobarchitect.JobSec

jobarchitect.sketchjob.sketchjob(tool_path, dataset_path, output_root, backend, nchunks, image_name=None, overlay_filter=None)

Return list of jobs as strings.

Parameters:

• tool_path – path to tool
• dataset_path – path to input dataset
• output_root – path to output root
• backend – backend function for generating job scripts
• nchunks – number of chunks the job should be split into

Returns:

generator yielding jobs as strings