Heads up:
We’re moving the GATK website, docs and forum to a new platform. Read the full story and breakdown of key changes on this blog.
We’re moving the GATK website, docs and forum to a new platform. Read the full story and breakdown of key changes on this blog.
Update: July 26, 2019
This section of the forum is now closed; we are working on a new support model for WDL that we will share here shortly. For Cromwell-specific issues, see the Cromwell docs and post questions on Github.
This section of the forum is now closed; we are working on a new support model for WDL that we will share here shortly. For Cromwell-specific issues, see the Cromwell docs and post questions on Github.
Limit Number of threads in wdl
EADG
KielMember ✭✭✭
Hi Guys,
is there an option to limit the number of threads which a used by wdl? I running wdl locally and have only a limited number of threads/cores.
Greetings EADG
Tagged:
Best Answer
-
You can limit the number of concurrent jobs run by cromwell by setting the option for 'concurrent-job-limit' in the cromwell configuration file.
This is the relevant part of my cromwell config file, I run 2 jobs concurrently.
backend { default = "Local" providers { Local { actor-factory = "cromwell.backend.impl.sfs.config.ConfigBackendLifecycleActorFactory" config { run-in-background = true runtime-attributes = "String? docker" submit = "/bin/bash ${script}" submit-docker = "docker run --rm -v ${cwd}:${docker_cwd} -i ${docker} /bin/bash ${docker_cwd}/ concurrent-job-limit = 2
Answers
You can limit the number of concurrent jobs run by cromwell by setting the option for 'concurrent-job-limit' in the cromwell configuration file.
This is the relevant part of my cromwell config file, I run 2 jobs concurrently.
backend { default = "Local" providers { Local { actor-factory = "cromwell.backend.impl.sfs.config.ConfigBackendLifecycleActorFactory" config { run-in-background = true runtime-attributes = "String? docker" submit = "/bin/bash ${script}" submit-docker = "docker run --rm -v ${cwd}:${docker_cwd} -i ${docker} /bin/bash ${docker_cwd}/ concurrent-job-limit = 2HI @Redmar_van_den_Berg,
thank for your answer, which version of cromewell are you running ?
Greetings EADG
Hi @EADG
I'm running the latest version of cromwell, 24. This option is actually the reason I updated, since it seems to get ignored in the version I was using (21).
Tanks, so i will update to 24 too.