Warning

This document is for an old release of Galaxy. You can alternatively view this page in the latest release if it exists or view the top of the latest release's documentation.

galaxy.tool_util.cwl package

galaxy.tool_util.cwl.tool_proxy(tool_path=None, tool_object=None, strict_cwl_validation=True, tool_directory=None, uuid=None)

Provide a proxy object to cwltool data structures to just grab relevant data.

galaxy.tool_util.cwl.tool_proxy_from_persistent_representation(persisted_tool, strict_cwl_validation=True, tool_directory=None)

Load a ToolProxy from a previously persisted representation.

galaxy.tool_util.cwl.workflow_proxy(workflow_path, strict_cwl_validation=True)

galaxy.tool_util.cwl.handle_outputs(job_directory=None)

galaxy.tool_util.cwl.to_cwl_job(tool, param_dict, local_working_directory)

tool is Galaxy’s representation of the tool and param_dict is the parameter dictionary with wrapped values.

galaxy.tool_util.cwl.to_galaxy_parameters(tool, as_dict)

Tool is Galaxy’s representation of the tool and as_dict is a Galaxified representation of the input json (no paths, HDA references for instance).

galaxy.tool_util.cwl.needs_shell_quoting(string, pos=0, endpos=9223372036854775807)

Scan through string looking for a match, and return a corresponding match object instance.

Return None if no position in the string matches.

Submodules

galaxy.tool_util.cwl.cwltool_deps module

Logic for dealing with cwltool as an optional dependency.

Use this as the import interface for cwltool and just call ensure_cwltool_available() before using any of the imported functionality at runtime.

galaxy.tool_util.cwl.cwltool_deps.default_loader(fetcher_constructor: Optional[Callable[[Dict[str, Union[str, rdflib.graph.Graph, bool]], requests.sessions.Session], Fetcher]] = None, enable_dev: bool = False, doc_cache: bool = True) → schema_salad.ref_resolver.Loader

galaxy.tool_util.cwl.cwltool_deps.ensure_cwltool_available()

Assert optional dependencies proxied via this module are available at runtime.

Throw an ImportError with a description of the problem if they do not exist.

galaxy.tool_util.cwl.cwltool_deps.getdefault(val: Any, default: Any) → Any

class galaxy.tool_util.cwl.cwltool_deps.LoadingContext(kwargs: Optional[Dict[str, Any]] = None)

Bases: cwltool.context.ContextBase

__init__(kwargs: Optional[Dict[str, Any]] = None) → None

Initialize the LoadingContext from the kwargs.

copy() → cwltool.context.LoadingContext

galaxy.tool_util.cwl.cwltool_deps.needs_shell_quoting(string, pos=0, endpos=9223372036854775807)

Scan through string looking for a match, and return a corresponding match object instance.

Return None if no position in the string matches.

galaxy.tool_util.cwl.cwltool_deps.relink_initialworkdir(pathmapper: cwltool.pathmapper.PathMapper, host_outdir: str, container_outdir: str, inplace_update: bool = False) → None

galaxy.tool_util.cwl.cwltool_deps.resolve_and_validate_document(loadingContext: cwltool.context.LoadingContext, workflowobj: Union[ruamel.yaml.comments.CommentedMap, ruamel.yaml.comments.CommentedSeq], uri: str, preprocess_only: bool = False, skip_schemas: Optional[bool] = None) → Tuple[cwltool.context.LoadingContext, str]

Validate a CWL document.

class galaxy.tool_util.cwl.cwltool_deps.RuntimeContext(kwargs: Optional[Dict[str, Any]] = None)

Bases: cwltool.context.ContextBase

__init__(kwargs: Optional[Dict[str, Any]] = None) → None

Initialize the RuntimeContext from the kwargs.

get_outdir() → str

Return self.outdir or create one with self.tmp_outdir_prefix.

get_tmpdir() → str

Return self.tmpdir or create one with self.tmpdir_prefix.

get_stagedir() → str

Return self.stagedir or create one with self.tmpdir_prefix.

create_tmpdir() → str

Create a temporary directory that respects self.tmpdir_prefix.

create_outdir() → str

Create a temporary directory that respects self.tmp_outdir_prefix.

copy() → cwltool.context.RuntimeContext

class galaxy.tool_util.cwl.cwltool_deps.StdFsAccess(basedir: str)

Bases: object

Local filesystem implementation.

__init__(basedir: str) → None

Perform operations with respect to a base directory.

glob(pattern: str) → List[str]

open(fn: str, mode: str) → IO[Any]

exists(fn: str) → bool

size(fn: str) → int

isfile(fn: str) → bool

isdir(fn: str) → bool

listdir(fn: str) → List[str]

join(path: str, *paths: str) → str

realpath(path: str) → str

galaxy.tool_util.cwl.parser module

This module provides proxy objects around objects from the common workflow language reference implementation library cwltool. These proxies adapt cwltool to Galaxy features and abstract the library away from the rest of the framework.

galaxy.tool_util.cwl.parser.tool_proxy(tool_path=None, tool_object=None, strict_cwl_validation=True, tool_directory=None, uuid=None)

Provide a proxy object to cwltool data structures to just grab relevant data.

galaxy.tool_util.cwl.parser.load_job_proxy(job_directory, strict_cwl_validation=True)

galaxy.tool_util.cwl.representation module

This module is responsible for converting between Galaxy’s tool input description and the CWL description for a job json.

class galaxy.tool_util.cwl.representation.INPUT_TYPE(value)

Bases: str, enum.Enum

An enumeration.

DATA = 'data'

INTEGER = 'integer'

FLOAT = 'float'

TEXT = 'text'

BOOLEAN = 'boolean'

SELECT = 'select'

FIELD = 'field'

CONDITIONAL = 'conditional'

DATA_COLLECTON = 'data_collection'

class galaxy.tool_util.cwl.representation.TypeRepresentation(name, galaxy_param_type, label, collection_type)

Bases: tuple

property name

Alias for field number 0

property galaxy_param_type

Alias for field number 1

property label

Alias for field number 2

property collection_type

Alias for field number 3

property uses_param

galaxy.tool_util.cwl.representation.type_representation_from_name(type_representation_name)

galaxy.tool_util.cwl.representation.type_descriptions_for_field_types(field_types)

galaxy.tool_util.cwl.representation.dataset_wrapper_to_file_json(inputs_dir, dataset_wrapper)

galaxy.tool_util.cwl.representation.dataset_wrapper_to_directory_json(inputs_dir, dataset_wrapper)

galaxy.tool_util.cwl.representation.collection_wrapper_to_array(inputs_dir, wrapped_value)

galaxy.tool_util.cwl.representation.collection_wrapper_to_record(inputs_dir, wrapped_value)

galaxy.tool_util.cwl.representation.to_cwl_job(tool, param_dict, local_working_directory)

tool is Galaxy’s representation of the tool and param_dict is the parameter dictionary with wrapped values.

galaxy.tool_util.cwl.representation.to_galaxy_parameters(tool, as_dict)

Tool is Galaxy’s representation of the tool and as_dict is a Galaxified representation of the input json (no paths, HDA references for instance).

galaxy.tool_util.cwl.representation.field_to_field_type(field)

galaxy.tool_util.cwl.runnable module

Lighter-weight variant of Planemo runnable outputs.

galaxy.tool_util.cwl.runnable.get_outputs(path)

class galaxy.tool_util.cwl.runnable.CwlWorkflowOutput(label)

Bases: object

__init__(label)

get_id()

class galaxy.tool_util.cwl.runnable.ToolOutput(tool_output)

Bases: object

__init__(tool_output)

get_id()

galaxy.tool_util.cwl.runtime_actions module

galaxy.tool_util.cwl.runtime_actions.handle_outputs(job_directory=None)

galaxy.tool_util.cwl.schema module

Abstraction around cwltool and related libraries for loading a CWL artifact.

class galaxy.tool_util.cwl.schema.RawProcessReference(loading_context, process_object, uri)

Bases: tuple

property loading_context

Alias for field number 0

property process_object

Alias for field number 1

property uri

Alias for field number 2

class galaxy.tool_util.cwl.schema.ResolvedProcessDefinition(loading_context, uri, raw_process_reference)

Bases: tuple

property loading_context

Alias for field number 0

property raw_process_reference

Alias for field number 2

property uri

Alias for field number 1

class galaxy.tool_util.cwl.schema.SchemaLoader(strict=True, validate=True)

Bases: object

__init__(strict=True, validate=True)

property raw_document_loader

loading_context()

raw_process_reference(path, loading_context=None)

raw_process_reference_for_object(process_object, uri=None, loading_context=None)

process_definition(raw_process_reference)

tool(**kwds)

galaxy.tool_util.cwl.util module

Client-centric CWL-related utilities.

Used to share code between the Galaxy test framework and other Galaxy CWL clients (e.g. Planemo).

galaxy.tool_util.cwl.util.set_basename_and_derived_properties(properties, basename)

class galaxy.tool_util.cwl.util.OutputPropertiesType(**kwargs)

Bases: dict

class: str

location: Optional[str]

path: Optional[str]

listing: Optional[List[Any]]

basename: Optional[str]

nameroot: Optional[str]

nameext: Optional[str]

secondaryFiles: List[Any]

checksum: str

size: int

galaxy.tool_util.cwl.util.output_properties(path: Optional[str] = None, content: Optional[bytes] = None, basename=None, pseduo_location=False) → galaxy.tool_util.cwl.util.OutputPropertiesType

galaxy.tool_util.cwl.util.abs_path_or_uri(path_or_uri, relative_to)

Return an absolute path if this isn’t a URI, otherwise keep the URI the same.

galaxy.tool_util.cwl.util.abs_path(path_or_uri, relative_to)

galaxy.tool_util.cwl.util.path_or_uri_to_uri(path_or_uri)

galaxy.tool_util.cwl.util.galactic_job_json(job, test_data_directory, upload_func, collection_create_func, tool_or_workflow='workflow')

Adapt a CWL job object to the Galaxy API.

CWL derived tools in Galaxy can consume a job description sort of like CWL job objects via the API but paths need to be replaced with datasets and records and arrays with collection references. This function will stage files and modify the job description to adapt to these changes for Galaxy.

class galaxy.tool_util.cwl.util.FileLiteralTarget(contents, path=None, **kwargs)

Bases: object

__init__(contents, path=None, **kwargs)

class galaxy.tool_util.cwl.util.FileUploadTarget(path, secondary_files=None, **kwargs)

Bases: object

__init__(path, secondary_files=None, **kwargs)

class galaxy.tool_util.cwl.util.ObjectUploadTarget(the_object)

Bases: object

__init__(the_object)

class galaxy.tool_util.cwl.util.DirectoryUploadTarget(tar_path)

Bases: object

__init__(tar_path)

class galaxy.tool_util.cwl.util.GalaxyOutput(history_id, history_content_type, history_content_id, metadata)

Bases: tuple

property history_content_id

Alias for field number 2

property history_content_type

Alias for field number 1

property history_id

Alias for field number 0

property metadata

Alias for field number 3

galaxy.tool_util.cwl.util.tool_response_to_output(tool_response, history_id, output_id)

galaxy.tool_util.cwl.util.invocation_to_output(invocation, history_id, output_id)

galaxy.tool_util.cwl.util.output_to_cwl_json(galaxy_output, get_metadata, get_dataset, get_extra_files, pseduo_location=False)

Convert objects in a Galaxy history into a CWL object.

Useful in running conformance tests and implementing the cwl-runner interface via Galaxy.

galaxy.tool_util.cwl.util.download_output(galaxy_output, get_metadata, get_dataset, get_extra_files, output_path)

galaxy.tool_util.cwl.util.guess_artifact_type(path)