Cannot enable Cromwell server on Mac to support GCS and HTTPS filesystems

I cannot get Cromwell to use https or gs paths for input files (it also does not work for https).

I start the Cromwell run like this:

java -Dconfig.file=/Users/waltershands/cromwell.conf -jar ~/Documents/bioinformatics/cromwell-36.jar run u_of_michigan_aligner.wdl -i u_of_michigan_aligner_gcs.json

Here is my cromwell.conf (have the project id filled in in the real conf):
include required(classpath("application"))

include required(classpath("application"))

engine {
  # This instructs the engine which filesystems are at its disposal to perform any IO operation that it might need.
  # For instance, WDL variables declared at the Workflow level will be evaluated using the filesystems declared here.
  # If you intend to be able to run workflows with this kind of declarations:
  # workflow {
  #    String str = read_string("gs://bucket/my-file.txt")
  # }
  # You will need to provide the engine with a gcs filesystem
  # Note that the default filesystem (local) is always available.
  filesystems {
      gcs {
        auth = "application-default"
        # Google project which will be billed for the requests
        project = "<my project id>"
      }
    #  oss {
    #    auth {
    #      endpoint = ""
    #      access-id = ""
    #      access-key = ""
    #      security-token = ""
    #    }
    #  }
    local {
      enabled: true
    }
    http {
      enabled: true
    }
  }
}

backend {
  filesystems {
    gcs {
        auth = "application-default"
        # Google project which will be billed for the requests
        project = "<my project id>"
      }
    local {
      enabled: true
    }
    http {
      enabled: true
    }
  }
}

But I see these errors:

        Could not build the path "gs://topmed_workflow_testing/topmed_aligner/reference_files/hg38/hs38DH.fa.fai". It may refer to a filesystem not su
pported by this instance of Cromwell. Supported filesystems are: HTTP, MacOSXFileSystem. Failures:
HTTP: gs://topmed_workflow_testing/topmed_aligner/reference_files/hg38/hs38DH.fa.fai does not have an http or https scheme (IllegalArgumentException)

How do I fix this?

Tagged:
Sign In or Register to comment.