To celebrate the release of GATK 4.0, we are giving away free credits for running the GATK4 Best Practices pipelines in FireCloud, our secure online analysis portal. It’s first come first serve, so sign up now to claim your free credits worth $250. Sponsored by Google Cloud. Learn more at https://software.broadinstitute.org/firecloud/documentation/freecredits

Cromwell 25 release

KateVossKateVoss Cambridge, MAMember, Broadie, Moderator
edited June 2017 in WDL Announcements

Happy 25th birthday, Cromwell! You're a quarter of a century old! In this version, we added a major new feature we named "call caching" that could potentially save you tons of money; as well as labels, a TES backend and new WDL functions.

But before you do, have a look at the version highlights below!


Call caching

BREAKING CHANGE: Metadata keys
The metadata key for call caching changed and are now in the callCaching stanza. For more information see the Changelog.

Using Docker Hashes, call caching will soon be available for FireCloud. Call caching is already available through Cromwell directly, and by default it is disabled.

For users who are concerned about running repeatable WDLs we recommend avoiding floating tags, such as "ubuntu:latest". When you use floating tags or expressions those jobs will not be call cached when using Cromwell directly. The reasoning behind this decision is that if the value changes, such as the latest version of Ubuntu, then it could create different results than without call caching. FireCloud will still use call caching when there are floating tags in WDLs.

Note that currently Cromwell doesn't track changes to the output files (there's a feature request), so you could get a call cache hit to a file that has been modified, rather than the originally cached output. To avoid this, make sure to rename the file if you change it.

JES labels

Every call in Cromwell is now labeled by default so you can query them, see the README for how to apply custom labels.

New WDL functions

We added support for reporting the length of an array with length: (Array[X]) => Integer and for generating an array of strings with prefix: (String, Array[X]) => Array[String] .

Batched inputs

MySQL users can use batched inputs by adding "rewriteBatchedStatements=true" to the JDBC URL.

TES Backend

Members of the Cromwell community added support for TES (Task Execution Schema), thanks! Stay tuned to the WDL blog for a post this week with more information about TES.

Notable bug fixes

  • De-duping: When call caching was on, the FireCloud timing diagram would show duplicated results.
  • Optionals: Optionals regression is now fixed.
Post edited by Geraldine_VdAuwera on
Tagged:
Sign In or Register to comment.