September 2020 Galaxy Release (v 20.09)¶
Pluggable Upload Components - Dropbox & WebDav¶
@jmchilton has written a new pluggable interface for upload sources. He has initially added two new backends, you can now import data from Dropbox and any WebDav servers you might have access to. This work also makes it easier for developers to add support for other, new personal data sources in the future.
An example of a Dropbox account:
There will be a new button for “Choose Remote files”, when sources are configured, and then you will be able to see and search across all of the remote data locations to which you might have access.
You will be able to see and load your files easily in Galaxy!
The admin will need to configure this feature, and then you will need to provide your credentials for these services in Galaxy’s user preferences, if you want to use them. Ask you admin!
GTN In Galaxy¶
During the BCC2020 CoFest, @hexylena and @shiltemann worked together to add support for accessing Galaxy Training Network tutorials from within Galaxy. The graduation cap icon will activate the interface.
For updated tutorials, tools will be highlighted as blue buttons. When clicked, these buttons will hide the GTN and take you directly to the correct version of the correct tool within the Galaxy interface. No more time spent figuring out which “cut” tool the tutorial author meant! And when you’re ready, you can easily jump back to the training materials.
Thanks @pvanheus for the video of it in action!
Upload Directly from the Tool Form¶
Did you ever start configuring a tool but forgot to upload your datasets first? And had to start over? Now you can upload datasets directly in the tool form thanks to @jmchilton. Pull Request 9809
Improved Workflow Layout Algorithm¶
The old automatic workflow layout algorithm liked to hide the flow of data within your workflow
So we have replaced the layout algorithm with a newer one which should make the flow of data within your workflows easier to understand. You will still probably want to make manual adjustments after the automatic layout, but hopefully this will save you some time.
Workflow Reporting Improvements¶
When one or more workflows are submitted, the status page reporting on those workflow(s) and their reports has been improved!
Several new functions have been added to the Workflow Report syntax, which you can use in your reports. Thanks @OlegZharkov! Pull Request 9938
invocation-time- The iso time of the workflow invocation time.
generate-time- The iso time of the time of generation of the Markdown.
generate-galaxy-version- The Galaxy MAJOR_VERSION at the time of generation of the Markdown.
dataset-type- The ext/format/datatype of the target dataset.
dataset-name- The name of the target dataset.
You can self-delete your account¶
In (hopefully) rare cases, you might want to close your account and delete the associated data. @astrovsky01 has implemented user self-deletion, so you no longer need to request an admin to do this for you and wait for their response. Pull Request 10107
GalaxyP MVP visualization plugin (thanks to @tmcgowan). Pull Request 10136
From their associated paper:
[The MVP App] displays this example data where the list of variant peptides are shown in the Peptide Overview window (A). One of these peptides (sequence DGDLENPVLYSGAVK) has been selected in this list, and the button “PSMs for Selected Peptides” clicked to display the 2 PSMs that matched to this sequence, along with associated scoring metrics (B). Double-clicking on one of these PSMs opens the Lorikeet MS/MS viewer (C). Lorikeet  renders MS/MS spectra, providing a visualization of the annotated spectra that led to a PSM using the upstream sequence database searching software. C shows an example PSM, where the blue- and red-colored m/z peak values correspond to amino acid fragments that would be predicted to derive from the peptide sequence identified by this PSM
Several community members and committers (@stevecassidy, @hexylena, @anuprulez, and @bgruening, @mvdbeek) worked together from 2017 on, to add datatypes for Audio & Video datatypes. This PR is now merged and available in Galaxies everywhere. This additionally includes a specific visualisation for these files allowing you to view the audio or video media directly in Galaxy. Pull Request 4949
mpg video containers, as well as
BPF audio formats is included.
Add VCF_BGZIP to VCF converter (thanks to @almahmoud). Pull Request 7926
Add NcbiTaxonomySQlite class to describe NCBI Taxonomy SQLite databases (thanks to @pvanheus). Pull Request 9712
Add lastdb datatype for last tool (PR #2749) (thanks to @RomainDallet). Pull Request 9872
Add BLASTDBv5 datatype (for blast >=2.8.1) (thanks to @abretaud). Pull Request 9939
Use compression_utils to safely peek in compressed datasets (thanks to @pvanheus). Pull Request 9990
Add Anndata peek capability (thanks to @mtekman). Pull Request 10013, Pull Request 10555
Fix OSError in fastq_to_fqtoc converter (thanks to @bgruening). Pull Request 10042
Don’t display download link for optional, non-existant metadata files Pull Request 10068
Add “tgz” datatype to config sample file for toolfactory and any other tools generating gzipped tar files (thanks to @fubar2). Pull Request 10080
Fix determining ‘int’, ‘float’ column type in Tabular (thanks to @selten). Pull Request 10155
Decrease pysam verbosity Pull Request 10225
Remove references to missing types from sample config file Pull Request 10269
Fix tuple assignment (fixes anndata, scanpy tool tests) Pull Request 10293
Wavdatatype to inherit from
Audio(thanks to @nsoranzo). Pull Request 10312
Fix wiggle estimated_display_viewport Pull Request 10333
Builtin Tool Updates¶
Fix and simplify built-in trim tool (thanks to @wm75). Pull Request 10145
Allow unary plus and minus in filtering (thanks to @wm75). Pull Request 10154
Fix filtering.py failing all expressions (thanks to @almahmoud). Pull Request 10266
Please see the full release notes for more details.
To stay up to date with Galaxy’s progress watch our screencasts, visit our community hub, and follow @galaxyproject on Twitter.
You can always reach us on Gitter or IRC.
Thanks for using Galaxy!