The current GATK version is 3.7-0
Examples: Monday, today, last week, Mar 26, 3/26/04

#### Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

GATK 3.7 is here! Be sure to read the Version Highlights and optionally the full Release Notes.
Register now for the upcoming GATK Best Practices workshop, Feb 20-22 in Leuven, Belgium. Open to all comers! More info and signup at http://bit.ly/2i4mGxz

# HaplotypeCaller takes too long

DenverMember Posts: 68

I'm running the latest GATK nightly build to process human exome-seq data (has 12 samples). It seemed be faster than the older version until I run the HaplotypeCaller. The run summary shows it will take 14 days to finish. I am wondering if there's anything in my below command: How to make it faster without losing data in the output?

java -Xmx10g -Djava.io.tmpdir=/temp/GATK_temp
-jar \$CLASSPATH/GenomeAnalysisTK.jar \
-T HaplotypeCaller \
-R ../GATK_ref/hg19.fasta \
-I ./compressedbam.list \
-L ../GATK_ref/hg19knownGene_UCSC_sorted.bed \
-log ../GATK/VQSR/log/HaplotypeCaller_20131018.log \
-o ../GATK/VQSR/raw.snps_indels.vcf

Tagged:

• Member, Dev Posts: 543 ✭✭✭✭

Use Queue

Failing that, split up your interval manually into n intervals, run n HC jobs in parallel, then combine the resulting VCFs at the end

As we've discussed previously on the forum (search is your friend), adjusting the minPruning and parallelizing (-nct and Queue scatter-gather) will give you the biggest wins.

Geraldine Van der Auwera, PhD

• DenverMember Posts: 68

@Geraldine_VdAuwera said:
As we've discussed previously on the forum (search is your friend), adjusting the minPruning and parallelizing (-nct and Queue scatter-gather) will give you the biggest wins.

thanks, yes, I wold like to use Queue scatter-gather. I've been trying to find good example to run Hapolotypecaller with it, do you have some helpful script that I can look at?

Have a look at the presentations from Tuesday's workshop, hopefully they will help you get started with Queue. The slides are here:

The videos of the talks will be online in a couple of weeks.

Geraldine Van der Auwera, PhD

• DenverMember Posts: 68

If you have multiple vcf files output, how do you merge them exactly? thanks

@pdexheimer said:
Use Queue

Failing that, split up your interval manually into n intervals, run n HC jobs in parallel, then combine the resulting VCFs at the end

• Member, Dev Posts: 543 ✭✭✭✭

CombineVariants

Or if you're running on separate intervals (not separate samples), you can get away with using CatVariants, which is much faster. It's what the Queue gatherer uses internally when you scatter-gather HC jobs.

Geraldine Van der Auwera, PhD

• DenverMember Posts: 68

Let me make sure I understand this. After processing the separate intervals with HC, I should use CatVariants to combine the vcf files. Is this faster than CombineVariants? thanks Geraldine.

@Geraldine_VdAuwera said:
Or if you're running on separate intervals (not separate samples), you can get away with using CatVariants, which is much faster. It's what the Queue gatherer uses internally when you scatter-gather HC jobs.