We've moved!
For WDL questions, see the WDL specification and WDL docs.
For Cromwell questions, see the Cromwell docs and please post any issues on Github.

Cannot enable Cromwell server on Mac to support GCS and HTTPS filesystems

I cannot get Cromwell to use https or gs paths for input files (it also does not work for https).

I start the Cromwell run like this:

java -Dconfig.file=/Users/waltershands/cromwell.conf -jar ~/Documents/bioinformatics/cromwell-36.jar run u_of_michigan_aligner.wdl -i u_of_michigan_aligner_gcs.json

Here is my cromwell.conf (have the project id filled in in the real conf):
include required(classpath("application"))

include required(classpath("application"))

engine {
  # This instructs the engine which filesystems are at its disposal to perform any IO operation that it might need.
  # For instance, WDL variables declared at the Workflow level will be evaluated using the filesystems declared here.
  # If you intend to be able to run workflows with this kind of declarations:
  # workflow {
  #    String str = read_string("gs://bucket/my-file.txt")
  # }
  # You will need to provide the engine with a gcs filesystem
  # Note that the default filesystem (local) is always available.
  filesystems {
      gcs {
        auth = "application-default"
        # Google project which will be billed for the requests
        project = "<my project id>"
      }
    #  oss {
    #    auth {
    #      endpoint = ""
    #      access-id = ""
    #      access-key = ""
    #      security-token = ""
    #    }
    #  }
    local {
      enabled: true
    }
    http {
      enabled: true
    }
  }
}

backend {
  filesystems {
    gcs {
        auth = "application-default"
        # Google project which will be billed for the requests
        project = "<my project id>"
      }
    local {
      enabled: true
    }
    http {
      enabled: true
    }
  }
}

But I see these errors:

        Could not build the path "gs://topmed_workflow_testing/topmed_aligner/reference_files/hg38/hs38DH.fa.fai". It may refer to a filesystem not su
pported by this instance of Cromwell. Supported filesystems are: HTTP, MacOSXFileSystem. Failures:
HTTP: gs://topmed_workflow_testing/topmed_aligner/reference_files/hg38/hs38DH.fa.fai does not have an http or https scheme (IllegalArgumentException)

How do I fix this?

Tagged:
Sign In or Register to comment.