We've moved!
This site is now read-only. You can find our new documentation site and support forum for posting questions here.
Be sure to read our welcome blog!

CombineGVCFs (gatk-4.1.2.0) tool throwing java memory error despite high memory provided

AlvaAlva SwitzerlandMember ✭✭
edited July 2019 in Ask the GATK team

Dear All,

I am runinng CombineGVCFs tool for combining 310 gvf files. Initially when I ran the command line as following (without java-options),

            export PATH=$PATH:/cluster/work/grlab/share/software/gatk-4.1.2.0
            export PATH=/usr/bin:$PATH
            module load jdk
            gatk CombineGVCFs -R $reference $mergefiles -O ${outdir}/${outid}.g.vcf.gz > ${outdir}/${outid}.gatk.log 2>&1 && touch ${outdir}/${outid}.gvcf.done

It threw the following error message,

A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00002abde45fb02e, pid=50102, tid=0x00002abde30da280
#
# JRE version: Java(TM) SE Runtime Environment (8.0_172-b11) (build 1.8.0_172-b11)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.172-b11 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# V  [libjvm.so+0x92c02e]  SR_handler(int, siginfo*, ucontext*)+0x3e
#
# Core dump written. Default location: /cluster/work/grlab/projects/tmp_alva/test_wxs_aml/scripts/core or core.50102
#
# An error report file with more information is saved as:
# /cluster/work/grlab/projects/tmp_alva/test_wxs_aml/scripts/hs_err_pid50102.log
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp

Then in the second run, I tried with java-options as following,

gatk --java-options '-Xms454m -Xmx3181m -XX:+UseSerialGC' CombineGVCFs -R $reference $mergefiles -O ${outdir}/${outid}.g.vcf.gz && touch ${outdir}/${outid}.gvcf.done

From the second run (above command) I am getting the following error,

10:21:44.374 INFO  CombineGVCFs - Shutting down engine
[July 22, 2019 10:21:48 AM CEST] org.broadinstitute.hellbender.tools.walkers.CombineGVCFs done. Elapsed time: 2.30 minutes.
Runtime.totalMemory()=3225354240
Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
    at htsjdk.tribble.readers.TabixReader.readIndex(TabixReader.java:274)
    at htsjdk.tribble.readers.TabixReader.readIndex(TabixReader.java:287)
    at htsjdk.tribble.readers.TabixReader.<init>(TabixReader.java:165)
    at htsjdk.tribble.readers.TabixReader.<init>(TabixReader.java:129)
    at htsjdk.tribble.TabixFeatureReader.<init>(TabixFeatureReader.java:80)
    at htsjdk.tribble.AbstractFeatureReader.getFeatureReader(AbstractFeatureReader.java:116)
    at org.broadinstitute.hellbender.engine.FeatureDataSource.getTribbleFeatureReader(FeatureDataSource.java:350)
    at org.broadinstitute.hellbender.engine.FeatureDataSource.getFeatureReader(FeatureDataSource.java:305)
    at org.broadinstitute.hellbender.engine.FeatureDataSource.<init>(FeatureDataSource.java:256)
    at org.broadinstitute.hellbender.engine.FeatureManager.addToFeatureSources(FeatureManager.java:234)
    at org.broadinstitute.hellbender.engine.MultiVariantWalker.lambda$initializeDrivingVariants$0(MultiVariantWalker.java:73)
    at org.broadinstitute.hellbender.engine.MultiVariantWalker$$Lambda$58/1622066826.accept(Unknown Source)
    at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382)
    at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580)
    at org.broadinstitute.hellbender.engine.MultiVariantWalker.initializeDrivingVariants(MultiVariantWalker.java:63)
    at org.broadinstitute.hellbender.engine.VariantWalkerBase.initializeFeatures(VariantWalkerBase.java:55)
    at org.broadinstitute.hellbender.engine.GATKTool.onStartup(GATKTool.java:697)
    at org.broadinstitute.hellbender.engine.MultiVariantWalker.onStartup(MultiVariantWalker.java:46)
    at org.broadinstitute.hellbender.cmdline.CommandLineProgram.runTool(CommandLineProgram.java:137)
    at org.broadinstitute.hellbender.cmdline.CommandLineProgram.instanceMainPostParseArgs(CommandLineProgram.java:191)
    at org.broadinstitute.hellbender.cmdline.CommandLineProgram.instanceMain(CommandLineProgram.java:210)
    at org.broadinstitute.hellbender.Main.runCommandLineProgram(Main.java:162)
    at org.broadinstitute.hellbender.Main.mainEntry(Main.java:205)
    at org.broadinstitute.hellbender.Main.main(Main.java:291)

Any clue/ suggestions would help go forward with the step. Thank you!!

Best Answer

Answers

Sign In or Register to comment.