Snakemake, CWL, WDL, Nextflow are used in bioinformatics workflows.
Just plain old bash seems to work just fine, though.
It is simple and gives you a lot of portability to HPC clusters and general purpose cloud. Not hardwiring to a configuration file and not using an, in practice, un-portable workflow language saves you a lot of pain.
A truly portable cloud/hpc module for python would be a good solution.
Just plain old bash seems to work just fine, though. It is simple and gives you a lot of portability to HPC clusters and general purpose cloud. Not hardwiring to a configuration file and not using an, in practice, un-portable workflow language saves you a lot of pain.
A truly portable cloud/hpc module for python would be a good solution.