Warning

This document is for an old release of Galaxy. You can alternatively view this page in the latest release if it exists or view the top of the latest release's documentation.

galaxy.tool_util.deps.mulled package

Submodules

galaxy.tool_util.deps.mulled.get_tests module

searches for tests for packages in the bioconda-recipes repo and on Anaconda, looking in different file locations. If no test can be found for the specified version, it will look for tests for other versions of the same package.

A shallow search (default for singularity and conda generation scripts) just checks once on Anaconda for the specified version.

galaxy.tool_util.deps.mulled.get_tests.get_commands_from_yaml(yaml_content)

Parse tests from Conda’s meta.yaml file contents

galaxy.tool_util.deps.mulled.get_tests.get_run_test(file)

Get tests from a run_test.sh file

galaxy.tool_util.deps.mulled.get_tests.get_anaconda_url(container, anaconda_channel='bioconda')

Download tarball from anaconda for test

galaxy.tool_util.deps.mulled.get_tests.prepend_anaconda_url(url)

Take a partial url and prepend ‘https://anaconda.org’

galaxy.tool_util.deps.mulled.get_tests.get_test_from_anaconda(url)

Given the URL of an anaconda tarball, return tests

galaxy.tool_util.deps.mulled.get_tests.find_anaconda_versions(name, anaconda_channel='bioconda')

Find a list of available anaconda versions for a given container name

galaxy.tool_util.deps.mulled.get_tests.open_recipe_file(file, recipes_path=None, github_repo='bioconda/bioconda-recipes')

Open a file at a particular location and return contents as string

galaxy.tool_util.deps.mulled.get_tests.get_alternative_versions(filepath, filename, recipes_path=None, github_repo='bioconda/bioconda-recipes')

Return files that match filepath/*/filename in the bioconda-recipes repository

galaxy.tool_util.deps.mulled.get_tests.try_a_func(func1, func2, param, container)

Try to perform a function (or actually a combination of two functions: first getting the file and then processing it)

galaxy.tool_util.deps.mulled.get_tests.deep_test_search(container, recipes_path=None, anaconda_channel='bioconda', github_repo='bioconda/bioconda-recipes')

Look in bioconda-recipes repo as well as anaconda for the tests, checking in multiple possible locations. If no test is found for the specified version, search if other package versions have a test available.

galaxy.tool_util.deps.mulled.get_tests.main_test_search(container, recipes_path=None, deep=False, anaconda_channel='bioconda', github_repo='bioconda/bioconda-recipes')

Download tarball from anaconda for test

galaxy.tool_util.deps.mulled.get_tests.hashed_test_search(container, recipes_path=None, deep=False, anaconda_channel='bioconda', github_repo='bioconda/bioconda-recipes')

Get test for hashed containers

galaxy.tool_util.deps.mulled.mulled_build module

Build a mulled image for specified conda targets.

Examples

Build a mulled image with:

mulled-build build ‘samtools=1.3.1–4,bedtools=2.22’

galaxy.tool_util.deps.mulled.mulled_build.main(argv=None)

Main entry-point for the CLI tool.

galaxy.tool_util.deps.mulled.mulled_build_channel module

Build a mulled images for all recent conda recipe updates that don’t have existing images.

Examples:

Build mulled images for recent bioconda changes with:

mulled-build-channel build

Build, test, and publish images with the follow command:

mulled-build-channel all

See recent changes that would be built with:

mulled-build-channel list

galaxy.tool_util.deps.mulled.mulled_build_channel.main(argv=None)

Main entry-point for the CLI tool.

galaxy.tool_util.deps.mulled.mulled_build_files module

Build all composite mulled recipes discovered in TSV files.

Use mulled-build-channel to build images for single recipes for a whole conda channel. This script instead builds images for combinations of recipes. This script can be given a single TSV file or a directory of TSV files to process.

Examples:

Build all recipes discovered in tsv files in a single directory.

mulled-build-files build

galaxy.tool_util.deps.mulled.mulled_build_files.main(argv=None)

Main entry-point for the CLI tool.

galaxy.tool_util.deps.mulled.mulled_build_tool module

Build a mulled images for a tool source (Galaxy or CWL tool).

Examples:

Build mulled images for requirements defined in a tool:

mulled-build-tool build path/to/tool_file.xml

galaxy.tool_util.deps.mulled.mulled_build_tool.main(argv=None)

Main entry-point for the CLI tool.

galaxy.tool_util.deps.mulled.mulled_build_tool.requirements_to_mulled_targets(requirements)

Convert Galaxy’s representation of requirements into mulled Target objects.

Only package requirements are retained.

galaxy.tool_util.deps.mulled.mulled_hash module

Produce a mulled hash for specified conda targets.

Examples

Produce a mulled hash with:

mulled-hash samtools=1.3.1,bedtools=2.22

galaxy.tool_util.deps.mulled.mulled_hash.main(argv=None)

Main entry-point for the CLI tool.

galaxy.tool_util.deps.mulled.mulled_list module

galaxy.tool_util.deps.mulled.mulled_list.get_quay_containers(repository='biocontainers')

Get all quay containers in the biocontainers repo

galaxy.tool_util.deps.mulled.mulled_list.get_singularity_containers()

Get all existing singularity containers from “https://depot.galaxyproject.org/singularity/”

galaxy.tool_util.deps.mulled.mulled_list.get_conda_envs(filepath)

Get list of already existing envs

galaxy.tool_util.deps.mulled.mulled_list.get_missing_containers(quay_list, singularity_list, blocklist_file=None)

Return list of quay containers that do not exist as singularity containers. Files stored in a blocklist will be ignored

galaxy.tool_util.deps.mulled.mulled_list.get_missing_envs(quay_list, conda_list, blocklist_file=None)

Compares list of conda envs and docker containers and returns missing conda envs

galaxy.tool_util.deps.mulled.mulled_list.main()

galaxy.tool_util.deps.mulled.mulled_search module

class galaxy.tool_util.deps.mulled.mulled_search.QuaySearch(organization)

Bases: object

Tool to search within a quay organization for a given software name.

__init__(organization)

build_index()

Create an index to quickly examine the repositories of a given quay.io organization.

search_repository(search_string, non_strict)

Search Docker containers on quay.io. Results are displayed with all available versions, including the complete image name.

get_additional_repository_information(repository_string)

Function downloads additional information from quay.io to get the tag-field which includes the version number.

class galaxy.tool_util.deps.mulled.mulled_search.CondaSearch(channel)

Bases: object

Tool to search the bioconda channel

__init__(channel)

get_json(search_string)

Function takes search_string variable and returns results from the bioconda channel in JSON format

class galaxy.tool_util.deps.mulled.mulled_search.GitHubSearch

Bases: object

Tool to search the GitHub bioconda-recipes repo

get_json(search_string)

Takes search_string variable and return results from the bioconda-recipes github repository in JSON format

DEPRECATED: this method is currently unreliable because the API query sometimes succeeds but returns no items.

process_json(json_response, search_string)

Take JSON input and process it, returning the required data

recipe_present(search_string)

Check if a recipe exists in bioconda-recipes which matches search_string exactly

galaxy.tool_util.deps.mulled.mulled_search.get_package_hash(packages, versions)

Take packages and versions (if the latter are given) and returns a hash for each. Also checks github to see if the container is already present.

galaxy.tool_util.deps.mulled.mulled_search.singularity_search(search_string)

Check if a singularity package is present and return the link.

galaxy.tool_util.deps.mulled.mulled_search.readable_output(json, organization='biocontainers', channel='bioconda')

galaxy.tool_util.deps.mulled.mulled_search.deps_error_message(package)

galaxy.tool_util.deps.mulled.mulled_search.main(argv=None)

galaxy.tool_util.deps.mulled.mulled_update_singularity_containers module

galaxy.tool_util.deps.mulled.mulled_update_singularity_containers.get_list_from_file(filename)

Returns a list of containers stored in a file (one on each line)

galaxy.tool_util.deps.mulled.mulled_update_singularity_containers.docker_to_singularity(container, installation, filepath, no_sudo=False)

Convert docker to singularity container.

galaxy.tool_util.deps.mulled.mulled_update_singularity_containers.singularity_container_test(tests, installation, filepath)

Run tests, record if they pass or fail

galaxy.tool_util.deps.mulled.mulled_update_singularity_containers.main()

galaxy.tool_util.deps.mulled.mulled_update_singularity_containers.container_testing(args=None)

galaxy.tool_util.deps.mulled.util module

Utilities for working with mulled abstractions outside the mulled package.

galaxy.tool_util.deps.mulled.util.build_target(package_name, version=None, build=None, tag=None)

Use supplied arguments to build a Target object.

galaxy.tool_util.deps.mulled.util.conda_build_target_str(target)

galaxy.tool_util.deps.mulled.util.image_name(targets, image_build=None, name_override=None)

Generate mulled hash version 1 container identifier for supplied arguments.

If a single target is specified, simply use the supplied name and version as the repository name and tag respectively. If multiple targets are supplied, hash the package names and versions together as the repository name. For mulled version 1 containers the image build is the repository tag (if supplied).

>>> single_targets = [build_target("samtools", version="1.3.1")]
>>> v1_image_name(single_targets)
'samtools:1.3.1'
>>> multi_targets = [build_target("samtools", version="1.3.1"), build_target("bwa", version="0.7.13")]
>>> v1_image_name(multi_targets)
'mulled-v1-b06ecbd9141f0dbbc0c287375fc0813adfcbdfbd'
>>> multi_targets_on_versionless = [build_target("samtools", version="1.3.1"), build_target("bwa")]
>>> v1_image_name(multi_targets_on_versionless)
'mulled-v1-bda945976caa5734347fbf7f35066d9f58519e0c'
>>> multi_targets_versionless = [build_target("samtools"), build_target("bwa")]
>>> v1_image_name(multi_targets_versionless)
'mulled-v1-fe8faa35dbf6dc65a0f7f5d4ea12e31a79f73e40'

galaxy.tool_util.deps.mulled.util.mulled_tags_for(namespace, image, tag_prefix=None, resolution_cache=None, session=None, expire=300)

Fetch remote tags available for supplied image name.

The result will be sorted so newest tags are first.

galaxy.tool_util.deps.mulled.util.quay_versions(namespace, pkg_name, session=None)

Get all version tags for a Docker image stored on quay.io for supplied package name.

galaxy.tool_util.deps.mulled.util.split_container_name(name)

Takes a container name (e.g. samtools:1.7–1) and returns a list (e.g. [‘samtools’, ‘1.7’, ‘1’]) >>> split_container_name(‘samtools:1.7–1’) [‘samtools’, ‘1.7’, ‘1’]

galaxy.tool_util.deps.mulled.util.split_tag(tag)

Split mulled image tag into conda version and conda build.

class galaxy.tool_util.deps.mulled.util.Target(package_name, version, build, package)

Bases: tuple

property build

Alias for field number 2

property package

Alias for field number 3

property package_name

Alias for field number 0

property version

Alias for field number 1

galaxy.tool_util.deps.mulled.util.v1_image_name(targets, image_build=None, name_override=None)

Generate mulled hash version 1 container identifier for supplied arguments.

If a single target is specified, simply use the supplied name and version as the repository name and tag respectively. If multiple targets are supplied, hash the package names and versions together as the repository name. For mulled version 1 containers the image build is the repository tag (if supplied).

>>> single_targets = [build_target("samtools", version="1.3.1")]
>>> v1_image_name(single_targets)
'samtools:1.3.1'
>>> multi_targets = [build_target("samtools", version="1.3.1"), build_target("bwa", version="0.7.13")]
>>> v1_image_name(multi_targets)
'mulled-v1-b06ecbd9141f0dbbc0c287375fc0813adfcbdfbd'
>>> multi_targets_on_versionless = [build_target("samtools", version="1.3.1"), build_target("bwa")]
>>> v1_image_name(multi_targets_on_versionless)
'mulled-v1-bda945976caa5734347fbf7f35066d9f58519e0c'
>>> multi_targets_versionless = [build_target("samtools"), build_target("bwa")]
>>> v1_image_name(multi_targets_versionless)
'mulled-v1-fe8faa35dbf6dc65a0f7f5d4ea12e31a79f73e40'

galaxy.tool_util.deps.mulled.util.v2_image_name(targets, image_build=None, name_override=None)

Generate mulled hash version 2 container identifier for supplied arguments.

If a single target is specified, simply use the supplied name and version as the repository name and tag respectively. If multiple targets are supplied, hash the package names as the repository name and hash the package versions (if set) as the tag.

>>> single_targets = [build_target("samtools", version="1.3.1")]
>>> v2_image_name(single_targets)
'samtools:1.3.1'
>>> single_targets = [build_target("samtools", version="1.3.1", build="py_1")]
>>> v2_image_name(single_targets)
'samtools:1.3.1--py_1'
>>> single_targets = [build_target("samtools", version="1.3.1")]
>>> v2_image_name(single_targets, image_build="0")
'samtools:1.3.1'
>>> single_targets = [build_target("samtools", version="1.3.1", build="py_1")]
>>> v2_image_name(single_targets, image_build="0")
'samtools:1.3.1--py_1'
>>> multi_targets = [build_target("samtools", version="1.3.1"), build_target("bwa", version="0.7.13")]
>>> v2_image_name(multi_targets)
'mulled-v2-fe8faa35dbf6dc65a0f7f5d4ea12e31a79f73e40:4d0535c94ef45be8459f429561f0894c3fe0ebcf'
>>> multi_targets_on_versionless = [build_target("samtools", version="1.3.1"), build_target("bwa")]
>>> v2_image_name(multi_targets_on_versionless)
'mulled-v2-fe8faa35dbf6dc65a0f7f5d4ea12e31a79f73e40:b0c847e4fb89c343b04036e33b2daa19c4152cf5'
>>> multi_targets_versionless = [build_target("samtools"), build_target("bwa")]
>>> v2_image_name(multi_targets_versionless)
'mulled-v2-fe8faa35dbf6dc65a0f7f5d4ea12e31a79f73e40'

galaxy.tool_util.deps.mulled.util.version_sorted(elements)

Sort iterable based on loose description of “version” from newest to oldest.