memory allocation for DataProcessingPipeline in internal broad network

naarkhoonaarkhoo Posts: 38Member
edited January 2013 in Ask the GATK team

Is there any rule of thumb for allocating memory through "bsub" for running DataProcessingPipeline per bam file or per number of reads ?

Thanks

Post edited by Geraldine_VdAuwera on

Answers

  • Geraldine_VdAuweraGeraldine_VdAuwera Posts: 7,122Administrator, GATK Developer admin

    Sorry, we don't provide recommendations at that level. Perhaps other users may want to share their experience in this matter?

    Geraldine Van der Auwera, PhD

  • naarkhoonaarkhoo Posts: 38Member

    and just to add some other aspect to my questions for other users, what could be an efficient way to retrieve the processing; meaning continuing the pipeline from the point that it got terminated.

  • pdexheimerpdexheimer Posts: 417Member, GSA Collaborator ✭✭✭✭

    I'm a little confused by what you're asking. Queue automatically checkpoints the steps as it runs them, and will restart from the appropriate point by itself (assuming you don't tell it otherwise).

    As for the memory, that's controlled in the qscript, not from the bsub command. The actual Queue job that you submit doesn't consume much in the way of resources, I think I give it 4GB of RAM, but that's probably way too much

Sign In or Register to comment.