Warning

This document is for an old release of Galaxy. You can alternatively view this page in the latest release if it exists or view the top of the latest release's documentation.

galaxy.tool_util.parser package

Package responsible for parsing tools from files/abstract tool sources.

galaxy.tool_util.parser.get_input_source(content)

Wrap dicts or XML elements as InputSource if needed.

If the supplied content is already an InputSource object, it is simply returned. This allow Galaxy to uniformly consume using the tool input source interface.

galaxy.tool_util.parser.get_tool_source(config_file: Optional[str] = None, xml_tree: Optional[ElementTree] = None, enable_beta_formats: bool = True, tool_location_fetcher: Optional[ToolLocationFetcher] = None, macro_paths: Optional[List[str]] = None, tool_source_class: Optional[str] = None, raw_tool_source: Optional[str] = None) → ToolSource

Return a ToolSource object corresponding to supplied source.

The supplied source may be specified as a file path (using the config_file parameter) or as an XML object loaded with load_tool_with_refereces.

galaxy.tool_util.parser.get_tool_source_from_representation(tool_format, tool_representation)

class galaxy.tool_util.parser.RequiredFiles(includes: List[Dict], excludes: List[Dict], extend_default_excludes: bool)

Bases: object

__init__(includes: List[Dict], excludes: List[Dict], extend_default_excludes: bool)

static from_dict(as_dict)

find_required_files(tool_directory: str) → List[str]

class galaxy.tool_util.parser.ToolOutputCollectionPart(output_collection_def, element_identifier, output_def, parent_ids=None)

Bases: object

__init__(output_collection_def, element_identifier, output_def, parent_ids=None)

property effective_output_name

static is_named_collection_part_name(name)

static split_output_name(name)

class galaxy.tool_util.parser.ToolSource

Bases: object

This interface represents an abstract source to parse tool information from.

language: str

abstract parse_id() → Optional[str]

Parse an ID describing the abstract tool. This is not the GUID tracked by the tool shed but the simple id (there may be multiple tools loaded in Galaxy with this same simple id).

abstract parse_version()

Parse a version describing the abstract tool.

parse_tool_module()

Load Tool class from a custom module. (Optional).

If not None, return pair containing module and class (as strings).

parse_action_module()

Load Tool class from a custom module. (Optional).

If not None, return pair containing module and class (as strings).

parse_tool_type()

Load simple tool type string (e.g. ‘data_source’, ‘default’).

abstract parse_name()

Parse a short name for tool (required).

abstract parse_description()

Parse a description for tool. Longer than name, shorted than help.

parse_edam_operations() → List[str]

Parse list of edam operation codes.

parse_edam_topics() → List[str]

Parse list of edam topic codes.

abstract parse_xrefs() → List[Dict[str, str]]

Parse list of external resource URIs and types.

parse_display_interface(default)

Parse display_interface - fallback to default for the tool type (supplied as default parameter) if not specified.

parse_require_login(default)

Parse whether the tool requires login (as a bool).

parse_request_param_translation_elem()

Return an XML element describing require parameter translation.

If we wish to support this feature for non-XML based tools this should be converted to return some sort of object interface instead of a RAW XML element.

abstract parse_command()

Return string contianing command to run.

parse_expression()

Return string contianing command to run.

abstract parse_environment_variables()

Return environment variable templates to expose.

parse_home_target()

Should be “job_home”, “shared_home”, “job_tmp”, “pwd”, or None.

parse_tmp_target()

Should be “pwd”, “shared_home”, “job_tmp”, “job_tmp_if_explicit”, or None.

parse_tmp_directory_vars()

Directories to override if a tmp_target is not None.

parse_docker_env_pass_through()

abstract parse_interpreter()

Return string containing the interpreter to prepend to the command (for instance this might be ‘python’ to run a Python wrapper located adjacent to the tool).

abstract parse_interactivetool()

Return InteractiveTool entry point templates to expose.

parse_redirect_url_params_elem()

Return an XML element describing redirect_url_params.

If we wish to support this feature for non-XML based tools this should be converted to return some sort of object interface instead of a RAW XML element.

parse_version_command()

Parse command used to determine version of primary application driving the tool. Return None to not generate or record such a command.

parse_version_command_interpreter()

Parse command used to determine version of primary application driving the tool. Return None to not generate or record such a command.

parse_parallelism()

Return a galaxy.jobs.ParallismInfo object describing task splitting or None.

parse_hidden()

Return boolean indicating whether tool should be hidden in the tool menu.

parse_sanitize()

Return boolean indicating whether tool should be sanitized or not.

parse_refresh()

Return boolean indicating … I have no clue…

parse_required_files() → Optional[RequiredFiles]

Parse explicit RequiredFiles object or return None to let Galaxy decide implicit logic.

abstract parse_requirements_and_containers() → Tuple[ToolRequirements, List[ContainerDescription], List[ResourceRequirement]]

Return triple of ToolRequirement, ContainerDescription and ResourceRequirement lists.

abstract parse_input_pages()

Return a PagesSource representing inputs by page for tool.

parse_provided_metadata_style()

Return style of tool provided metadata file (e.g. galaxy.json).

A value of of “default” indicates the newer galaxy.json style (the default for XML-based tools with profile >= 17.09) and a value of “legacy” indicates the older galaxy.json style.

A short description of these two styles can be found at https://github.com/galaxyproject/galaxy/pull/4437.

parse_provided_metadata_file()

Return location of provided metadata file (e.g. galaxy.json).

abstract parse_outputs(tool)

Return a pair of output and output collections ordered dictionaries for use by Tool.

abstract parse_strict_shell()

Return True if tool commands should be executed with set -e.

abstract parse_stdio()

Builds lists of ToolStdioExitCode and ToolStdioRegex objects to describe tool execution error conditions.

abstract parse_help() → Optional[str]

Return RST definition of help text for tool or None if the tool doesn’t define help text.

abstract parse_profile()

Return tool profile version as Galaxy major e.g. 16.01 or 16.04.

abstract parse_license()

Return license corresponding to tool wrapper.

abstract parse_python_template_version() → Optional[Version]

Return minimum python version that the tool template has been developed against.

parse_creator()

Return list of metadata relating to creator/author of tool.

Result should be list of schema.org data model Person or Organization objects.

property macro_paths

property source_path

paths_and_modtimes()

parse_tests_to_dict() → ToolSourceTests

abstract to_string() → str

Return the tool source as a string

Submodules

galaxy.tool_util.parser.cwl module

class galaxy.tool_util.parser.cwl.CwlToolSource(tool_file=None, strict_cwl_validation=True, tool_proxy: Optional[ToolProxy] = None)

Bases: ToolSource

language: str = 'yaml'

__init__(tool_file=None, strict_cwl_validation=True, tool_proxy: Optional[ToolProxy] = None)

property source_path

property tool_proxy: ToolProxy

parse_tool_type()

Load simple tool type string (e.g. ‘data_source’, ‘default’).

parse_id()

Parse an ID describing the abstract tool. This is not the GUID tracked by the tool shed but the simple id (there may be multiple tools loaded in Galaxy with this same simple id).

parse_name()

Parse a short name for tool (required).

parse_command()

Return string contianing command to run.

parse_environment_variables()

Return environment variable templates to expose.

parse_edam_operations()

Parse list of edam operation codes.

parse_edam_topics()

Parse list of edam topic codes.

parse_help()

Return RST definition of help text for tool or None if the tool doesn’t define help text.

parse_sanitize()

Return boolean indicating whether tool should be sanitized or not.

parse_strict_shell()

Return True if tool commands should be executed with set -e.

parse_stdio()

Builds lists of ToolStdioExitCode and ToolStdioRegex objects to describe tool execution error conditions.

parse_interpreter()

Return string containing the interpreter to prepend to the command (for instance this might be ‘python’ to run a Python wrapper located adjacent to the tool).

parse_version()

Parse a version describing the abstract tool.

parse_description()

Parse a description for tool. Longer than name, shorted than help.

parse_interactivetool()

Return InteractiveTool entry point templates to expose.

parse_input_pages()

Return a PagesSource representing inputs by page for tool.

parse_outputs(tool)

Return a pair of output and output collections ordered dictionaries for use by Tool.

parse_requirements_and_containers()

Return triple of ToolRequirement, ContainerDescription and ResourceRequirement lists.

parse_profile()

Return tool profile version as Galaxy major e.g. 16.01 or 16.04.

parse_xrefs()

Parse list of external resource URIs and types.

parse_license()

Return license corresponding to tool wrapper.

parse_python_template_version()

Return minimum python version that the tool template has been developed against.

to_string()

Return the tool source as a string

galaxy.tool_util.parser.cwl.tool_proxy(tool_path=None, tool_object=None, strict_cwl_validation=True, tool_directory=None, uuid=None) → ToolProxy

Provide a proxy object to cwltool data structures to just grab relevant data.

galaxy.tool_util.parser.factory module

Constructors for concrete tool and input source objects.

galaxy.tool_util.parser.factory.get_tool_source(config_file: Optional[str] = None, xml_tree: Optional[ElementTree] = None, enable_beta_formats: bool = True, tool_location_fetcher: Optional[ToolLocationFetcher] = None, macro_paths: Optional[List[str]] = None, tool_source_class: Optional[str] = None, raw_tool_source: Optional[str] = None) → ToolSource

Return a ToolSource object corresponding to supplied source.

The supplied source may be specified as a file path (using the config_file parameter) or as an XML object loaded with load_tool_with_refereces.

galaxy.tool_util.parser.factory.get_input_source(content)

Wrap dicts or XML elements as InputSource if needed.

If the supplied content is already an InputSource object, it is simply returned. This allow Galaxy to uniformly consume using the tool input source interface.

galaxy.tool_util.parser.interface module

class galaxy.tool_util.parser.interface.AssertionDict

Bases: TypedDict

tag: str

attributes: Dict[str, Any]

children: Optional[List[AssertionDict]]

class galaxy.tool_util.parser.interface.ToolSourceTest

Bases: TypedDict

inputs: Any

outputs: Any

output_collections: List[Any]

stdout: Optional[List[AssertionDict]]

stderr: Optional[List[AssertionDict]]

expect_exit_code: Optional[Union[str, int]]

expect_failure: bool

expect_test_failure: bool

maxseconds: Optional[Union[str, int]]

expect_num_outputs: Optional[Union[str, int]]

command: Optional[List[AssertionDict]]

command_version: Optional[List[AssertionDict]]

class galaxy.tool_util.parser.interface.ToolSourceTests

Bases: TypedDict

tests: List[ToolSourceTest]

class galaxy.tool_util.parser.interface.ToolSource

Bases: object

This interface represents an abstract source to parse tool information from.

language: str

abstract parse_id() → Optional[str]

Parse an ID describing the abstract tool. This is not the GUID tracked by the tool shed but the simple id (there may be multiple tools loaded in Galaxy with this same simple id).

abstract parse_version()

Parse a version describing the abstract tool.

parse_tool_module()

Load Tool class from a custom module. (Optional).

If not None, return pair containing module and class (as strings).

parse_action_module()

Load Tool class from a custom module. (Optional).

If not None, return pair containing module and class (as strings).

parse_tool_type()

Load simple tool type string (e.g. ‘data_source’, ‘default’).

abstract parse_name()

Parse a short name for tool (required).

abstract parse_description()

Parse a description for tool. Longer than name, shorted than help.

parse_edam_operations() → List[str]

Parse list of edam operation codes.

parse_edam_topics() → List[str]

Parse list of edam topic codes.

abstract parse_xrefs() → List[Dict[str, str]]

Parse list of external resource URIs and types.

parse_display_interface(default)

Parse display_interface - fallback to default for the tool type (supplied as default parameter) if not specified.

parse_require_login(default)

Parse whether the tool requires login (as a bool).

parse_request_param_translation_elem()

Return an XML element describing require parameter translation.

If we wish to support this feature for non-XML based tools this should be converted to return some sort of object interface instead of a RAW XML element.

abstract parse_command()

Return string contianing command to run.

parse_expression()

Return string contianing command to run.

abstract parse_environment_variables()

Return environment variable templates to expose.

parse_home_target()

Should be “job_home”, “shared_home”, “job_tmp”, “pwd”, or None.

parse_tmp_target()

Should be “pwd”, “shared_home”, “job_tmp”, “job_tmp_if_explicit”, or None.

parse_tmp_directory_vars()

Directories to override if a tmp_target is not None.

parse_docker_env_pass_through()

abstract parse_interpreter()

Return string containing the interpreter to prepend to the command (for instance this might be ‘python’ to run a Python wrapper located adjacent to the tool).

abstract parse_interactivetool()

Return InteractiveTool entry point templates to expose.

parse_redirect_url_params_elem()

Return an XML element describing redirect_url_params.

If we wish to support this feature for non-XML based tools this should be converted to return some sort of object interface instead of a RAW XML element.

parse_version_command()

Parse command used to determine version of primary application driving the tool. Return None to not generate or record such a command.

parse_version_command_interpreter()

Parse command used to determine version of primary application driving the tool. Return None to not generate or record such a command.

parse_parallelism()

Return a galaxy.jobs.ParallismInfo object describing task splitting or None.

parse_hidden()

Return boolean indicating whether tool should be hidden in the tool menu.

parse_sanitize()

Return boolean indicating whether tool should be sanitized or not.

parse_refresh()

Return boolean indicating … I have no clue…

parse_required_files() → Optional[RequiredFiles]

Parse explicit RequiredFiles object or return None to let Galaxy decide implicit logic.

abstract parse_requirements_and_containers() → Tuple[ToolRequirements, List[ContainerDescription], List[ResourceRequirement]]

Return triple of ToolRequirement, ContainerDescription and ResourceRequirement lists.

abstract parse_input_pages()

Return a PagesSource representing inputs by page for tool.

parse_provided_metadata_style()

Return style of tool provided metadata file (e.g. galaxy.json).

A value of of “default” indicates the newer galaxy.json style (the default for XML-based tools with profile >= 17.09) and a value of “legacy” indicates the older galaxy.json style.

A short description of these two styles can be found at https://github.com/galaxyproject/galaxy/pull/4437.

parse_provided_metadata_file()

Return location of provided metadata file (e.g. galaxy.json).

abstract parse_outputs(tool)

Return a pair of output and output collections ordered dictionaries for use by Tool.

abstract parse_strict_shell()

Return True if tool commands should be executed with set -e.

abstract parse_stdio()

Builds lists of ToolStdioExitCode and ToolStdioRegex objects to describe tool execution error conditions.

abstract parse_help() → Optional[str]

Return RST definition of help text for tool or None if the tool doesn’t define help text.

abstract parse_profile()

Return tool profile version as Galaxy major e.g. 16.01 or 16.04.

abstract parse_license()

Return license corresponding to tool wrapper.

abstract parse_python_template_version() → Optional[Version]

Return minimum python version that the tool template has been developed against.

parse_creator()

Return list of metadata relating to creator/author of tool.

Result should be list of schema.org data model Person or Organization objects.

property macro_paths

property source_path

paths_and_modtimes()

parse_tests_to_dict() → ToolSourceTests

abstract to_string() → str

Return the tool source as a string

class galaxy.tool_util.parser.interface.PagesSource(page_sources)

Bases: object

Contains a list of Pages - each a list of InputSources - each item in the outer list representing a page of inputs. Pages are deprecated so ideally this outer list will always be exactly a singleton.

__init__(page_sources)

property inputs_defined

class galaxy.tool_util.parser.interface.InputSource

Bases: object

default_optional = False

elem()

abstract get(key, value=None)

Return simple named properties as string for this input source. keys to be supported depend on the parameter type.

abstract get_bool(key, default)

Return simple named properties as boolean for this input source. keys to be supported depend on the parameter type.

parse_label()

parse_name()

Return name of an input source returns the name or if absent the argument property In the latter case, leading dashes are stripped and all remaining dashes are replaced by underscores.

abstract parse_input_type() → str

Return the type of this input.

parse_help()

parse_sanitizer_elem()

Return an XML description of sanitizers. This is a stop gap until we can rework galaxy.tools.parameters.sanitize to not explicitly depend on XML.

parse_validator_elems()

Return an XML description of sanitizers. This is a stop gap until we can rework galaxy.tools.parameters.validation to not explicitly depend on XML.

parse_optional(default=None)

Return boolean indicating whether parameter is optional.

parse_dynamic_options_elem()

Return an XML elemnt describing dynamic options.

parse_static_options()

Return list of static options if this is a select type without defining a dynamic options.

parse_conversion_tuples()

Return list of (name, extension) to describe explicit conversions.

parse_nested_inputs_source()

parse_test_input_source() → InputSource

parse_when_input_sources()

parse_default() → Optional[Dict[str, Any]]

class galaxy.tool_util.parser.interface.PageSource

Bases: object

parse_display()

abstract parse_input_sources() → List[InputSource]

Return a list of InputSource objects.

class galaxy.tool_util.parser.interface.TestCollectionDef(attrib, name, collection_type, elements)

Bases: object

__init__(attrib, name, collection_type, elements)

static from_xml(elem, parse_param_elem)

to_dict()

static from_dict(as_dict)

collect_inputs()

class galaxy.tool_util.parser.interface.RequiredFiles(includes: List[Dict], excludes: List[Dict], extend_default_excludes: bool)

Bases: object

__init__(includes: List[Dict], excludes: List[Dict], extend_default_excludes: bool)

static from_dict(as_dict)

find_required_files(tool_directory: str) → List[str]

class galaxy.tool_util.parser.interface.TestCollectionOutputDef(name, attrib, element_tests)

Bases: object

__init__(name, attrib, element_tests)

static from_dict(as_dict)

to_dict()

galaxy.tool_util.parser.output_actions module

Support for dynamically modifying output attributes.

class galaxy.tool_util.parser.output_actions.ToolOutputActionGroup(parent, config_elem)

Bases: object

Manages a set of tool output dataset actions directives

tag = 'group'

__init__(parent, config_elem)

apply_action(output_dataset, other_values) → None

property tool

class galaxy.tool_util.parser.output_actions.ToolOutputActionConditionalWhen(parent, config_elem, value)

Bases: ToolOutputActionGroup

tag = 'when'

classmethod from_elem(parent, when_elem)

Loads the proper when by attributes of elem

__init__(parent, config_elem, value)

is_case(other_values)

get_ref(other_values)

apply_action(output_dataset, other_values) → None

class galaxy.tool_util.parser.output_actions.ValueToolOutputActionConditionalWhen(parent, config_elem, value)

Bases: ToolOutputActionConditionalWhen

tag = 'when value'

is_case(other_values) → bool

class galaxy.tool_util.parser.output_actions.DatatypeIsInstanceToolOutputActionConditionalWhen(parent, config_elem, value)

Bases: ToolOutputActionConditionalWhen

tag = 'when datatype_isinstance'

__init__(parent, config_elem, value)

is_case(other_values) → bool

class galaxy.tool_util.parser.output_actions.ToolOutputActionConditional(parent, config_elem)

Bases: object

tag = 'conditional'

__init__(parent, config_elem)

apply_action(output_dataset, other_values) → None

property tool

class galaxy.tool_util.parser.output_actions.ToolOutputAction(parent, elem)

Bases: object

tag = 'action'

classmethod from_elem(parent, elem)

Loads the proper action by the type attribute of elem

__init__(parent, elem)

apply_action(output_dataset, other_values)

property tool

class galaxy.tool_util.parser.output_actions.ToolOutputActionOption(parent, elem)

Bases: object

tag = 'object'

classmethod from_elem(parent, elem)

Loads the proper action by the type attribute of elem

__init__(parent, elem)

get_value(other_values)

property tool

class galaxy.tool_util.parser.output_actions.NullToolOutputActionOption(parent, elem)

Bases: ToolOutputActionOption

tag = 'null_option'

get_value(other_values)

class galaxy.tool_util.parser.output_actions.FromFileToolOutputActionOption(parent, elem)

Bases: ToolOutputActionOption

tag = 'from_file'

__init__(parent, elem)

get_value(other_values)

class galaxy.tool_util.parser.output_actions.FromParamToolOutputActionOption(parent, elem)

Bases: ToolOutputActionOption

tag = 'from_param'

__init__(parent, elem)

get_value(other_values)

class galaxy.tool_util.parser.output_actions.FromDataTableOutputActionOption(parent, elem)

Bases: ToolOutputActionOption

tag = 'from_data_table'

__init__(parent, elem)

get_value(other_values)

class galaxy.tool_util.parser.output_actions.MetadataToolOutputAction(parent, elem)

Bases: ToolOutputAction

tag = 'metadata'

__init__(parent, elem)

apply_action(output_dataset, other_values) → None

class galaxy.tool_util.parser.output_actions.FormatToolOutputAction(parent, elem)

Bases: ToolOutputAction

tag = 'format'

__init__(parent, elem)

apply_action(output_dataset, other_values) → None

class galaxy.tool_util.parser.output_actions.ToolOutputActionOptionFilter(parent, elem)

Bases: object

tag = 'filter'

classmethod from_elem(parent, elem)

Loads the proper action by the type attribute of elem

__init__(parent, elem)

filter_options(options, other_values)

property tool

class galaxy.tool_util.parser.output_actions.ParamValueToolOutputActionOptionFilter(parent, elem)

Bases: ToolOutputActionOptionFilter

tag = 'param_value'

__init__(parent, elem)

filter_options(options, other_values)

class galaxy.tool_util.parser.output_actions.InsertColumnToolOutputActionOptionFilter(parent, elem)

Bases: ToolOutputActionOptionFilter

tag = 'insert_column'

__init__(parent, elem)

filter_options(options, other_values)

class galaxy.tool_util.parser.output_actions.MultipleSplitterFilter(parent, elem)

Bases: ToolOutputActionOptionFilter

tag = 'multiple_splitter'

__init__(parent, elem)

filter_options(options, other_values)

class galaxy.tool_util.parser.output_actions.ColumnStripFilter(parent, elem)

Bases: ToolOutputActionOptionFilter

tag = 'column_strip'

__init__(parent, elem)

filter_options(options, other_values)

class galaxy.tool_util.parser.output_actions.ColumnReplaceFilter(parent, elem)

Bases: ToolOutputActionOptionFilter

tag = 'column_replace'

__init__(parent, elem)

filter_options(options, other_values)

class galaxy.tool_util.parser.output_actions.MetadataValueFilter(parent, elem)

Bases: ToolOutputActionOptionFilter

tag = 'metadata_value'

__init__(parent, elem)

filter_options(options, other_values)

class galaxy.tool_util.parser.output_actions.BooleanFilter(parent, elem)

Bases: ToolOutputActionOptionFilter

tag = 'boolean'

__init__(parent, elem)

filter_options(options, other_values)

galaxy.tool_util.parser.output_actions.action_type

alias of FormatToolOutputAction

galaxy.tool_util.parser.output_actions.filter_type

alias of ColumnReplaceFilter

galaxy.tool_util.parser.output_actions.option_type

alias of FromDataTableOutputActionOption

class galaxy.tool_util.parser.output_actions.StringFunctionFilter(parent, elem)

Bases: ToolOutputActionOptionFilter

tag = 'string_function'

__init__(parent, elem)

filter_options(options, other_values)

galaxy.tool_util.parser.output_actions.parse_cast_attribute(cast)

galaxy.tool_util.parser.output_actions.parse_compare_type(compare)

galaxy.tool_util.parser.output_actions.compare_eq(value1, value2)

galaxy.tool_util.parser.output_actions.compare_neq(value1, value2)

galaxy.tool_util.parser.output_actions.compare_gt(value1, value2)

galaxy.tool_util.parser.output_actions.compare_gte(value1, value2)

galaxy.tool_util.parser.output_actions.compare_lt(value1, value2)

galaxy.tool_util.parser.output_actions.compare_lte(value1, value2)

galaxy.tool_util.parser.output_actions.compare_in(value1, value2)

galaxy.tool_util.parser.output_actions.compare_startswith(value1, value2)

galaxy.tool_util.parser.output_actions.compare_endswith(value1, value2)

galaxy.tool_util.parser.output_actions.compare_re_search(value1, value2)

galaxy.tool_util.parser.output_collection_def module

This module define an abstract class for reasoning about Galaxy’s dataset collection after jobs are finished.

galaxy.tool_util.parser.output_collection_def.dataset_collector_descriptions_from_elem(elem, legacy=True)

galaxy.tool_util.parser.output_collection_def.dataset_collector_descriptions_from_output_dict(as_dict)

galaxy.tool_util.parser.output_collection_def.dataset_collector_descriptions_from_list(discover_datasets_dicts)

galaxy.tool_util.parser.output_collection_def.dataset_collection_description(**kwargs)

class galaxy.tool_util.parser.output_collection_def.DatasetCollectionDescription(**kwargs)

Bases: object

__init__(**kwargs)

to_dict()

property discover_patterns: List[str]

class galaxy.tool_util.parser.output_collection_def.ToolProvidedMetadataDatasetCollection(**kwargs)

Bases: DatasetCollectionDescription

discover_via = 'tool_provided_metadata'

class galaxy.tool_util.parser.output_collection_def.FilePatternDatasetCollectionDescription(**kwargs)

Bases: DatasetCollectionDescription

discover_via = 'pattern'

__init__(**kwargs)

to_dict()

property discover_patterns: List[str]

galaxy.tool_util.parser.output_objects module

class galaxy.tool_util.parser.output_objects.ChangeFormatModel

Bases: TypedDict

value: Optional[str]

format: Optional[str]

input: Optional[str]

input_dataset: Optional[str]

check_attribute: Optional[str]

class galaxy.tool_util.parser.output_objects.ToolOutputBase(name: str, label: Optional[str] = None, filters: Optional[List[_Element]] = None, hidden: bool = False, from_expression: Optional[str] = None)

Bases: Dictifiable

__init__(name: str, label: Optional[str] = None, filters: Optional[List[_Element]] = None, hidden: bool = False, from_expression: Optional[str] = None) → None

to_dict(view='collection', value_mapper=None, app=None)

Return item dictionary.

property output_discover_patterns: List[str]

class galaxy.tool_util.parser.output_objects.ToolOutput(name: str, format: Optional[str] = None, format_source: Optional[str] = None, metadata_source: Optional[str] = None, parent: Optional[str] = None, label: Optional[str] = None, filters: Optional[List[_Element]] = None, actions: Optional[ToolOutputActionGroup] = None, hidden: bool = False, implicit: bool = False, from_expression: Optional[str] = None)

Bases: ToolOutputBase

Represents an output datasets produced by a tool. For backward compatibility this behaves as if it were the tuple:

(format, metadata_source, parent)

dict_collection_visible_keys = ['name', 'format', 'label', 'hidden', 'output_type', 'format_source', 'default_identifier_source', 'metadata_source', 'parent', 'count', 'from_work_dir']

__init__(name: str, format: Optional[str] = None, format_source: Optional[str] = None, metadata_source: Optional[str] = None, parent: Optional[str] = None, label: Optional[str] = None, filters: Optional[List[_Element]] = None, actions: Optional[ToolOutputActionGroup] = None, hidden: bool = False, implicit: bool = False, from_expression: Optional[str] = None) → None

to_dict(view='collection', value_mapper=None, app=None)

Return item dictionary.

static from_dict(name: str, output_dict: Dict[str, Any], tool: Optional[object] = None) → ToolOutput

property output_discover_patterns: List[str]

class galaxy.tool_util.parser.output_objects.ToolExpressionOutput(name, output_type, from_expression, label=None, filters=None, actions=None, hidden=False)

Bases: ToolOutputBase

dict_collection_visible_keys = ('name', 'format', 'label', 'hidden', 'output_type')

__init__(name, output_type, from_expression, label=None, filters=None, actions=None, hidden=False)

class galaxy.tool_util.parser.output_objects.ToolOutputCollection(name: str, structure: ToolOutputCollectionStructure, label: Optional[str] = None, filters: Optional[List[_Element]] = None, hidden: bool = False, default_format: str = 'data', default_format_source: Optional[str] = None, default_metadata_source: Optional[str] = None, inherit_format: bool = False, inherit_metadata: bool = False)

Bases: ToolOutputBase

Represents a HistoryDatasetCollectionAssociation of output datasets produced by a tool.

<outputs>
<collection type="list" label="${tool.name} on ${on_string} fasta">
    <discover_datasets pattern="__name__" ext="fasta" visible="True" directory="outputFiles" />
</collection>
<collection type="paired" label="${tool.name} on ${on_string} paired reads">
    <data name="forward" format="fastqsanger" />
    <data name="reverse" format="fastqsanger"/>
</collection>
<outputs>

dict_collection_visible_keys = ['name', 'format', 'label', 'hidden', 'output_type', 'default_format', 'default_format_source', 'default_metadata_source', 'inherit_format', 'inherit_metadata']

__init__(name: str, structure: ToolOutputCollectionStructure, label: Optional[str] = None, filters: Optional[List[_Element]] = None, hidden: bool = False, default_format: str = 'data', default_format_source: Optional[str] = None, default_metadata_source: Optional[str] = None, inherit_format: bool = False, inherit_metadata: bool = False) → None

known_outputs(inputs, type_registry)

property dynamic_structure

property dataset_collector_descriptions

to_dict(view='collection', value_mapper=None, app=None)

Return item dictionary.

static from_dict(name, output_dict, tool=None) → ToolOutputCollection

property output_discover_patterns: List[str]

class galaxy.tool_util.parser.output_objects.ToolOutputCollectionStructure(collection_type: Optional[str], collection_type_source: Optional[str] = None, collection_type_from_rules: Optional[str] = None, structured_like: Optional[str] = None, dataset_collector_descriptions: Optional[List[DatasetCollectionDescription]] = None)

Bases: object

__init__(collection_type: Optional[str], collection_type_source: Optional[str] = None, collection_type_from_rules: Optional[str] = None, structured_like: Optional[str] = None, dataset_collector_descriptions: Optional[List[DatasetCollectionDescription]] = None) → None

collection_prototype(inputs, type_registry)

to_dict()

static from_dict(as_dict) → ToolOutputCollectionStructure

property output_discover_patterns: List[str]

class galaxy.tool_util.parser.output_objects.ToolOutputCollectionPart(output_collection_def, element_identifier, output_def, parent_ids=None)

Bases: object

__init__(output_collection_def, element_identifier, output_def, parent_ids=None)

property effective_output_name

static is_named_collection_part_name(name)

static split_output_name(name)

galaxy.tool_util.parser.stdio module

class galaxy.tool_util.parser.stdio.StdioErrorLevel

Bases: object

These determine stdio-based error levels from matching on regular expressions and exit codes. They are meant to be used comparatively, such as showing that warning < fatal. This is really meant to just be an enum.

NO_ERROR = 0

LOG = 1

QC = 1.1

WARNING = 2

FATAL = 3

FATAL_OOM = 4

MAX = 4

descs = {0: 'No error', 1: 'Log', 1.1: 'QC', 2: 'Warning', 3: 'Fatal error', 4: 'Out of memory error'}

static desc(error_level)

class galaxy.tool_util.parser.stdio.ToolStdioExitCode(as_dict=None)

Bases: object

This is a container for the <stdio> element’s <exit_code> subelement. The exit_code element has a range of exit codes and the error level.

__init__(as_dict=None)

to_dict()

class galaxy.tool_util.parser.stdio.ToolStdioRegex(as_dict=None)

Bases: object

This is a container for the <stdio> element’s regex subelement. The regex subelement has a “match” attribute, a “sources” attribute that contains “output” and/or “error”, and a “level” attribute that contains “warning” or “fatal”.

__init__(as_dict=None)

to_dict()

galaxy.tool_util.parser.stdio.error_on_exit_code(out_of_memory_exit_code=None)

galaxy.tool_util.parser.stdio.aggressive_error_checks()

galaxy.tool_util.parser.util module

galaxy.tool_util.parser.util.is_dict(item)

galaxy.tool_util.parser.xml module

galaxy.tool_util.parser.xml.inject_validates(inject)

galaxy.tool_util.parser.xml.destroy_tree(tree)

galaxy.tool_util.parser.xml.parse_change_format(change_format: Iterable[_Element]) → List[ChangeFormatModel]

class galaxy.tool_util.parser.xml.XmlToolSource(xml_tree: ElementTree, source_path=None, macro_paths=None)

Bases: ToolSource

Responsible for parsing a tool from classic Galaxy representation.

language: str = 'xml'

__init__(xml_tree: ElementTree, source_path=None, macro_paths=None)

root: _Element

to_string()

Return the tool source as a string

mem_optimize()

parse_version()

Parse a version describing the abstract tool.

parse_id()

Parse an ID describing the abstract tool. This is not the GUID tracked by the tool shed but the simple id (there may be multiple tools loaded in Galaxy with this same simple id).

parse_tool_module()

Load Tool class from a custom module. (Optional).

If not None, return pair containing module and class (as strings).

parse_action_module()

Load Tool class from a custom module. (Optional).

If not None, return pair containing module and class (as strings).

parse_tool_type()

Load simple tool type string (e.g. ‘data_source’, ‘default’).

parse_name()

Parse a short name for tool (required).

parse_edam_operations()

Parse list of edam operation codes.

parse_edam_topics()

Parse list of edam topic codes.

parse_xrefs()

Parse list of external resource URIs and types.

parse_description()

Parse a description for tool. Longer than name, shorted than help.

parse_display_interface(default)

Parse display_interface - fallback to default for the tool type (supplied as default parameter) if not specified.

parse_require_login(default)

Parse whether the tool requires login (as a bool).

parse_request_param_translation_elem()

Return an XML element describing require parameter translation.

If we wish to support this feature for non-XML based tools this should be converted to return some sort of object interface instead of a RAW XML element.

parse_command()

Return string contianing command to run.

parse_expression()

Return string containing command to run.

parse_environment_variables()

Return environment variable templates to expose.

parse_home_target()

Should be “job_home”, “shared_home”, “job_tmp”, “pwd”, or None.

parse_tmp_target()

Should be “pwd”, “shared_home”, “job_tmp”, “job_tmp_if_explicit”, or None.

parse_interpreter()

Return string containing the interpreter to prepend to the command (for instance this might be ‘python’ to run a Python wrapper located adjacent to the tool).

parse_version_command()

Parse command used to determine version of primary application driving the tool. Return None to not generate or record such a command.

parse_version_command_interpreter()

Parse command used to determine version of primary application driving the tool. Return None to not generate or record such a command.

parse_parallelism()

Return a galaxy.jobs.ParallismInfo object describing task splitting or None.

parse_interactivetool()

Return InteractiveTool entry point templates to expose.

parse_hidden()

Return boolean indicating whether tool should be hidden in the tool menu.

parse_redirect_url_params_elem()

Return an XML element describing redirect_url_params.

If we wish to support this feature for non-XML based tools this should be converted to return some sort of object interface instead of a RAW XML element.

parse_sanitize()

Return boolean indicating whether tool should be sanitized or not.

parse_refresh()

Return boolean indicating … I have no clue…

parse_required_files() → Optional[RequiredFiles]

Parse explicit RequiredFiles object or return None to let Galaxy decide implicit logic.

parse_requirements_and_containers()

Return triple of ToolRequirement, ContainerDescription and ResourceRequirement lists.

parse_input_pages()

Return a PagesSource representing inputs by page for tool.

parse_provided_metadata_style()

Return style of tool provided metadata file (e.g. galaxy.json).

A value of of “default” indicates the newer galaxy.json style (the default for XML-based tools with profile >= 17.09) and a value of “legacy” indicates the older galaxy.json style.

A short description of these two styles can be found at https://github.com/galaxyproject/galaxy/pull/4437.

parse_provided_metadata_file()

Return location of provided metadata file (e.g. galaxy.json).

parse_outputs(tool)

Return a pair of output and output collections ordered dictionaries for use by Tool.

parse_stdio()

parse error handling from command and stdio tag

returns list of exit codes, list of regexes

• exit_codes contain all non-zero exit codes (:-1 and 1:) if detect_errors is default (if not legacy), exit_code, or aggressive

• the oom_exit_code if given and detect_errors is exit_code

• exit codes and regexes from the stdio tag these are prepended to the list, i.e. are evaluated prior to regexes and exit codes derived from the properties of the command tag. thus more specific regexes of the same or more severe error level are triggered first.

parse_strict_shell()

Return True if tool commands should be executed with set -e.

parse_help()

Return RST definition of help text for tool or None if the tool doesn’t define help text.

property macro_paths

property source_path

parse_tests_to_dict() → ToolSourceTests

parse_profile() → str

Return tool profile version as Galaxy major e.g. 16.01 or 16.04.

parse_license()

Return license corresponding to tool wrapper.

parse_python_template_version()

Return minimum python version that the tool template has been developed against.

parse_creator()

Return list of metadata relating to creator/author of tool.

Result should be list of schema.org data model Person or Organization objects.

class galaxy.tool_util.parser.xml.StdioParser(root)

Bases: object

__init__(root)

parse_stdio_exit_codes(stdio_elem)

Parse the tool’s <stdio> element’s <exit_code> subelements. This will add all of those elements, if any, to self.stdio_exit_codes.

parse_stdio_regexes(stdio_elem)

Look in the tool’s <stdio> elem for all <regex> subelements that define how to look for warnings and fatal errors in stdout and stderr. This will add all such regex elements to the Tols’s stdio_regexes list.

parse_error_level(err_level)

Parses error level and returns error level enumeration. If unparsable, returns ‘fatal’

class galaxy.tool_util.parser.xml.XmlPagesSource(root)

Bases: PagesSource

__init__(root)

property inputs_defined

class galaxy.tool_util.parser.xml.XmlPageSource(parent_elem)

Bases: PageSource

__init__(parent_elem)

parse_display()

parse_input_sources()

Return a list of InputSource objects.

class galaxy.tool_util.parser.xml.XmlInputSource(input_elem)

Bases: InputSource

__init__(input_elem)

parse_input_type()

Return the type of this input.

elem()

get(key, value=None)

Return simple named properties as string for this input source. keys to be supported depend on the parameter type.

get_bool(key, default)

Return simple named properties as boolean for this input source. keys to be supported depend on the parameter type.

parse_label()

parse_help()

parse_sanitizer_elem()

Return an XML description of sanitizers. This is a stop gap until we can rework galaxy.tools.parameters.sanitize to not explicitly depend on XML.

parse_validator_elems()

Return an XML description of sanitizers. This is a stop gap until we can rework galaxy.tools.parameters.validation to not explicitly depend on XML.

parse_dynamic_options_elem()

Return a galaxy.tools.parameters.dynamic_options.DynamicOptions if appropriate.

parse_static_options()

>>> from galaxy.util import parse_xml_string_to_etree
>>> xml = '<param><option value="a">A</option><option value="b">B</option></param>'
>>> xis = XmlInputSource(parse_xml_string_to_etree(xml).getroot())
>>> xis.parse_static_options()
[('A', 'a', False), ('B', 'b', False)]
>>> xml = '<param><option value="a"/><option value="b"/><option value="a" selected="true"/></param>'
>>> xis = XmlInputSource(parse_xml_string_to_etree(xml).getroot())
>>> xis.parse_static_options()
[('a', 'a', True), ('b', 'b', False)]

parse_optional(default=None)

Return boolean indicating whether parameter is optional.

parse_conversion_tuples()

Return list of (name, extension) to describe explicit conversions.

parse_nested_inputs_source()

parse_test_input_source()

parse_when_input_sources()

parse_default() → Optional[Dict[str, Any]]

class galaxy.tool_util.parser.xml.ParallelismInfo(tag)

Bases: object

Stores the information (if any) for running multiple instances of the tool in parallel on the same set of inputs.

__init__(tag)

galaxy.tool_util.parser.yaml module

class galaxy.tool_util.parser.yaml.YamlToolSource(root_dict: Dict, source_path=None)

Bases: ToolSource

language: str = 'yaml'

__init__(root_dict: Dict, source_path=None)

property source_path

parse_tool_type()

Load simple tool type string (e.g. ‘data_source’, ‘default’).

parse_id()

Parse an ID describing the abstract tool. This is not the GUID tracked by the tool shed but the simple id (there may be multiple tools loaded in Galaxy with this same simple id).

parse_version()

Parse a version describing the abstract tool.

parse_name()

Parse a short name for tool (required).

parse_description()

Parse a description for tool. Longer than name, shorted than help.

parse_edam_operations()

Parse list of edam operation codes.

parse_edam_topics()

Parse list of edam topic codes.

parse_xrefs()

Parse list of external resource URIs and types.

parse_sanitize()

Return boolean indicating whether tool should be sanitized or not.

parse_display_interface(default)

Parse display_interface - fallback to default for the tool type (supplied as default parameter) if not specified.

parse_require_login(default)

Parse whether the tool requires login (as a bool).

parse_command()

Return string contianing command to run.

parse_expression()

Return string contianing command to run.

parse_environment_variables()

Return environment variable templates to expose.

parse_interpreter()

Return string containing the interpreter to prepend to the command (for instance this might be ‘python’ to run a Python wrapper located adjacent to the tool).

parse_version_command()

Parse command used to determine version of primary application driving the tool. Return None to not generate or record such a command.

parse_version_command_interpreter()

Parse command used to determine version of primary application driving the tool. Return None to not generate or record such a command.

parse_requirements_and_containers()

Return triple of ToolRequirement, ContainerDescription and ResourceRequirement lists.

parse_input_pages()

Return a PagesSource representing inputs by page for tool.

parse_strict_shell()

Return True if tool commands should be executed with set -e.

parse_stdio()

Builds lists of ToolStdioExitCode and ToolStdioRegex objects to describe tool execution error conditions.

parse_help()

Return RST definition of help text for tool or None if the tool doesn’t define help text.

parse_outputs(tool)

Return a pair of output and output collections ordered dictionaries for use by Tool.

parse_tests_to_dict() → ToolSourceTests

parse_profile()

Return tool profile version as Galaxy major e.g. 16.01 or 16.04.

parse_license()

Return license corresponding to tool wrapper.

parse_interactivetool()

Return InteractiveTool entry point templates to expose.

parse_python_template_version()

Return minimum python version that the tool template has been developed against.

to_string()

Return the tool source as a string

galaxy.tool_util.parser.yaml.to_test_assert_list(assertions) → Optional[List[AssertionDict]]

class galaxy.tool_util.parser.yaml.YamlPageSource(inputs_list)

Bases: PageSource

__init__(inputs_list)

parse_input_sources()

Return a list of InputSource objects.

class galaxy.tool_util.parser.yaml.YamlInputSource(input_dict)

Bases: InputSource

__init__(input_dict)

get(key, default=None)

Return simple named properties as string for this input source. keys to be supported depend on the parameter type.

get_bool(key, default)

Return simple named properties as boolean for this input source. keys to be supported depend on the parameter type.

parse_input_type()

Return the type of this input.

parse_nested_inputs_source()

parse_test_input_source()

parse_when_input_sources()

parse_static_options()

Return list of static options if this is a select type without defining a dynamic options.

parse_default() → Optional[Dict[str, Any]]