The current GATK version is 3.7-0
Examples: Monday, today, last week, Mar 26, 3/26/04

Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Did you remember to?


1. Search using the upper-right search box, e.g. using the error message.
2. Try the latest version of tools.
3. Include tool and Java versions.
4. Tell us whether you are following GATK Best Practices.
5. Include relevant details, e.g. platform, DNA- or RNA-Seq, WES (+capture kit) or WGS (PCR-free or PCR+), paired- or single-end, read length, expected average coverage, somatic data, etc.
6. For tool errors, include the error stacktrace as well as the exact command.
7. For format issues, include the result of running ValidateSamFile for BAMs or ValidateVariants for VCFs.
8. For weird results, include an illustrative example, e.g. attach IGV screenshots according to Article#5484.
9. For a seeming variant that is uncalled, include results of following Article#1235.

Did we ask for a bug report?


Then follow instructions in Article#1894.

Formatting tip!


Surround blocks of code, error messages and BAM/VCF snippets--especially content with hashes (#)--with lines with three backticks ( ``` ) each to make a code block.
Powered by Vanilla. Made with Bootstrap.
GATK 3.7 is here! Be sure to read the Version Highlights and optionally the full Release Notes.
Register now for the upcoming GATK Best Practices workshop, Feb 20-22 in Leuven, Belgium. Open to all comers! More info and signup at http://bit.ly/2i4mGxz

HaplotypeCaller takes too long

rcholicrcholic DenverMember Posts: 68

I'm running the latest GATK nightly build to process human exome-seq data (has 12 samples). It seemed be faster than the older version until I run the HaplotypeCaller. The run summary shows it will take 14 days to finish. I am wondering if there's anything in my below command: How to make it faster without losing data in the output?

java -Xmx10g -Djava.io.tmpdir=/temp/GATK_temp
-jar $CLASSPATH/GenomeAnalysisTK.jar \
-T HaplotypeCaller \
-R ../GATK_ref/hg19.fasta \
-I ./compressedbam.list \
-L ../GATK_ref/hg19knownGene_UCSC_sorted.bed \
-log ../GATK/VQSR/log/HaplotypeCaller_20131018.log \
-o ../GATK/VQSR/raw.snps_indels.vcf
Tagged:

Answers

  • pdexheimerpdexheimer Member, Dev Posts: 543 ✭✭✭✭

    Use Queue :)

    Failing that, split up your interval manually into n intervals, run n HC jobs in parallel, then combine the resulting VCFs at the end

  • Geraldine_VdAuweraGeraldine_VdAuwera Administrator, Dev Posts: 11,141 admin

    As we've discussed previously on the forum (search is your friend), adjusting the minPruning and parallelizing (-nct and Queue scatter-gather) will give you the biggest wins.

    Geraldine Van der Auwera, PhD

  • rcholicrcholic DenverMember Posts: 68

    @Geraldine_VdAuwera said:
    As we've discussed previously on the forum (search is your friend), adjusting the minPruning and parallelizing (-nct and Queue scatter-gather) will give you the biggest wins.

    thanks, yes, I wold like to use Queue scatter-gather. I've been trying to find good example to run Hapolotypecaller with it, do you have some helpful script that I can look at?

  • Geraldine_VdAuweraGeraldine_VdAuwera Administrator, Dev Posts: 11,141 admin

    Have a look at the presentations from Tuesday's workshop, hopefully they will help you get started with Queue. The slides are here:

    http://gatkforums.broadinstitute.org/discussion/3367/presentation-slides-for-the-oct-2013-workshop-are-online

    The videos of the talks will be online in a couple of weeks.

    Geraldine Van der Auwera, PhD

  • rcholicrcholic DenverMember Posts: 68

    If you have multiple vcf files output, how do you merge them exactly? thanks

    @pdexheimer said:
    Use Queue :)

    Failing that, split up your interval manually into n intervals, run n HC jobs in parallel, then combine the resulting VCFs at the end

  • pdexheimerpdexheimer Member, Dev Posts: 543 ✭✭✭✭

    CombineVariants

  • Geraldine_VdAuweraGeraldine_VdAuwera Administrator, Dev Posts: 11,141 admin

    Or if you're running on separate intervals (not separate samples), you can get away with using CatVariants, which is much faster. It's what the Queue gatherer uses internally when you scatter-gather HC jobs.

    Geraldine Van der Auwera, PhD

  • rcholicrcholic DenverMember Posts: 68

    Let me make sure I understand this. After processing the separate intervals with HC, I should use CatVariants to combine the vcf files. Is this faster than CombineVariants? thanks Geraldine.

    @Geraldine_VdAuwera said:
    Or if you're running on separate intervals (not separate samples), you can get away with using CatVariants, which is much faster. It's what the Queue gatherer uses internally when you scatter-gather HC jobs.

  • Geraldine_VdAuweraGeraldine_VdAuwera Administrator, Dev Posts: 11,141 admin

    After processing the separate intervals with HC, I should use CatVariants to combine the vcf files.

    Yes, that's correct. It's faster than CombineVariants because it will just straight up concatenate the variants from the different runs, and won't check for overlaps or try to do any kind of fancy merging. The caveat is that you should only use this on VCFs generated for the same set of samples for different non-overlapping intervals.

    Geraldine Van der Auwera, PhD

Sign In or Register to comment.