Warning
This document is for an in-development version of Galaxy. You can alternatively view this page in the latest release if it exists or view the top of the latest release's documentation.
galaxy.job_metrics.instrumenters package
This module describes the abstract interface for InstrumentPlugin
.
These are responsible for collecting and formatting a coherent set of metrics.
- class galaxy.job_metrics.instrumenters.InstrumentPlugin[source]
Bases:
object
Describes how to instrument job scripts and retrieve collected metrics.
- formatter = <galaxy.job_metrics.formatting.JobMetricFormatter object>
- default_safety = 4
- abstract property plugin_type
Short string providing labelling this plugin
- pre_execute_instrument(job_directory: str) str | List[str] | None [source]
Optionally return one or more commands to instrument job. These commands will be executed on the compute server prior to the job running.
- post_execute_instrument(job_directory: str) str | List[str] | None [source]
Optionally return one or more commands to instrument job. These commands will be executed on the compute server after the tool defined command is ran.
- abstract job_properties(job_id, job_directory: str) Dict[str, Any] [source]
Collect properties for this plugin from specified job directory. This method will run on the Galaxy server and can assume files created in job_directory with pre_execute_instrument and post_execute_instrument are available.
Submodules
galaxy.job_metrics.instrumenters.cgroup module
The module describes the cgroup
job metrics plugin.
- class galaxy.job_metrics.instrumenters.cgroup.CgroupPlugin(**kwargs)[source]
Bases:
InstrumentPlugin
Plugin that collects memory and cpu utilization from within a cgroup.
- plugin_type = 'cgroup'
- formatter = <galaxy.job_metrics.instrumenters.cgroup.CgroupPluginFormatter object>
galaxy.job_metrics.instrumenters.core module
The module describes the core
job metrics plugin.
- class galaxy.job_metrics.instrumenters.core.CorePlugin(**kwargs)[source]
Bases:
InstrumentPlugin
Simple plugin that collects data without external dependencies. In particular it currently collects value set for Galaxy slots.
- plugin_type = 'core'
- formatter = <galaxy.job_metrics.instrumenters.core.CorePluginFormatter object>
- default_safety = 6
- pre_execute_instrument(job_directory: str) List[str] [source]
Optionally return one or more commands to instrument job. These commands will be executed on the compute server prior to the job running.
- post_execute_instrument(job_directory: str) List[str] [source]
Optionally return one or more commands to instrument job. These commands will be executed on the compute server after the tool defined command is ran.
galaxy.job_metrics.instrumenters.cpuinfo module
The module describes the cpuinfo
job metrics plugin.
- class galaxy.job_metrics.instrumenters.cpuinfo.CpuInfoPlugin(**kwargs)[source]
Bases:
InstrumentPlugin
Gather information about processor configuration from /proc/cpuinfo. Linux only.
- plugin_type = 'cpuinfo'
- formatter = <galaxy.job_metrics.instrumenters.cpuinfo.CpuInfoFormatter object>
galaxy.job_metrics.instrumenters.env module
The module describes the env
job metrics plugin.
- class galaxy.job_metrics.instrumenters.env.EnvPlugin(**kwargs)[source]
Bases:
InstrumentPlugin
Instrumentation plugin capable of recording all or specific environment variables for a job at runtime.
- plugin_type = 'env'
- formatter = <galaxy.job_metrics.instrumenters.env.EnvFormatter object>
- default_safety = 2
- pre_execute_instrument(job_directory: str)[source]
Use env to dump all environment variables to a file.
galaxy.job_metrics.instrumenters.hostname module
The module describes the hostname
job metrics plugin.
- class galaxy.job_metrics.instrumenters.hostname.HostnamePlugin(**kwargs)[source]
Bases:
InstrumentPlugin
Gather hostname
- plugin_type = 'hostname'
galaxy.job_metrics.instrumenters.meminfo module
The module describes the meminfo
job metrics plugin.
- class galaxy.job_metrics.instrumenters.meminfo.MemInfoPlugin(**kwargs)[source]
Bases:
InstrumentPlugin
Gather information about processor configuration from /proc/cpuinfo. Linux only.
- plugin_type = 'meminfo'
- formatter = <galaxy.job_metrics.instrumenters.meminfo.MemInfoFormatter object>
- default_safety = 6
galaxy.job_metrics.instrumenters.uname module
The module describes the uname
job metrics plugin.
- class galaxy.job_metrics.instrumenters.uname.UnamePlugin(**kwargs)[source]
Bases:
InstrumentPlugin
Use uname to gather operating system information about remote system job is running on. Linux only.
- plugin_type = 'uname'
- formatter = <galaxy.job_metrics.instrumenters.uname.UnameFormatter object>