Notice:
If you happen to see a question you know the answer to, please do chime in and help your fellow community members. We encourage our fourm members to be more involved, jump in and help out your fellow researchers with their questions. GATK forum is a community forum and helping each other with using GATK tools and research is the cornerstone of our success as a genomics research community.We appreciate your help!

Test-drive the GATK tools and Best Practices pipelines on Terra


Check out this blog post to learn how you can get started with GATK and try out the pipelines in preconfigured workspaces (with a user-friendly interface!) without having to install anything.

GATK without swap usage

Hi,

I asked a recent question about using picardtools on a cluster with strict swap limits, now I've moved onto using the indelrealigner tool in GATK. My issue is that if GATK starts using the swap, it is killed. I can get more ram by requesting more cores, but I want to minimize the number of cores I'm using.

I've been changing my total ram, and also the amount of ram I give java using the -Xmx option. After some experimentation, it seems like giving java more ram actually makes it worse. For example if I run it with 60G of ram total for the job, and give java 50G, it will almost immediately go into the swap, even though my BAM file is only 5G. On the other hand, if I only have 8G of ram for the job and give java 1G, it runs for much longer, although I'm unsure if this fixes the issue for all files.

My main question is if there is a general rule of thumb for using GATK without using the swap. Is it to minimize the amount of ram given to java? Does this even make sense based on how the program works?

Issue · Github
by Sheila

Issue Number
1446
State
closed
Last Updated
Assignee
Array
Milestone
Array
Closed By
vdauwera

Answers

  • Geraldine_VdAuweraGeraldine_VdAuwera Cambridge, MAMember, Administrator, Broadie admin

    Hi Greg, it sounds like you might be requesting more ram than is physically available to whatever machine(s) you're working on. That would explain why you go to swap almost immediately when you increase the requested amount of ram. Do you access to the actual specs of the machines?

Sign In or Register to comment.