The current GATK version is 3.7-0
Examples: Monday, today, last week, Mar 26, 3/26/04

Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Get notifications!


You can opt in to receive email notifications, for example when your questions get answered or when there are new announcements, by following the instructions given here.

Got a problem?


1. Search using the upper-right search box, e.g. using the error message.
2. Try the latest version of tools.
3. Include tool and Java versions.
4. Tell us whether you are following GATK Best Practices.
5. Include relevant details, e.g. platform, DNA- or RNA-Seq, WES (+capture kit) or WGS (PCR-free or PCR+), paired- or single-end, read length, expected average coverage, somatic data, etc.
6. For tool errors, include the error stacktrace as well as the exact command.
7. For format issues, include the result of running ValidateSamFile for BAMs or ValidateVariants for VCFs.
8. For weird results, include an illustrative example, e.g. attach IGV screenshots according to Article#5484.
9. For a seeming variant that is uncalled, include results of following Article#1235.

Did we ask for a bug report?


Then follow instructions in Article#1894.

Formatting tip!


Wrap blocks of code, error messages and BAM/VCF snippets--especially content with hashes (#)--with lines with three backticks ( ``` ) each to make a code block as demonstrated here.

Jump to another community
Picard 2.10.2 is now available at https://github.com/broadinstitute/picard/releases.
GATK version 4.beta.2 (i.e. the second beta release) is out. See the GATK4 BETA page for download and details.

UnifiedGenotyper queue extension

edited August 2012 in Ask the GATK team

It says in the "ExampleUnifiedGenotyper" qscript that it runs an incomplete version of the UnifiedGenotyper. I have a two questions about this.

  • I cannot find the org.broadinstitute.sting.queue.extensions.gatk.UnifiedGenotyper class, is this not in the public source or am I blind?
  • Does the "incomplete" in the script starting comment mean that this extension is incomplete in its functionality? Or is it something else that is incomplete in its nature?

Basically I'm wondering if there are any pitfalls for me if I start using the example script as a base for my own variant calling qscript.

Best Answer

  • kshakirkshakir Dev
    Accepted Answer

    Most of the queue.extensions are generated classes once you run 'ant'. The generated classes are Queue compatible versions of the walker command arguments. Instead of looking at the generated scala file you can find the same or better argument descriptions in the the gatkdocs for each walker.

    The 'incomplete' status of the script means that it is only a technical example, and will need to be tweaked for your specific requirements in your calling pipeline. Feel free to explore different command line options with the UG. For example using Queue you can create two instances of the UG and test using with BAQ and without. As for what UG commands you should be using, see the UG gatkdocs and the Best Practices for an overall description of where the UG fits in a calling pipeline.

Answers

  • kshakirkshakir Dev
    Accepted Answer

    Most of the queue.extensions are generated classes once you run 'ant'. The generated classes are Queue compatible versions of the walker command arguments. Instead of looking at the generated scala file you can find the same or better argument descriptions in the the gatkdocs for each walker.

    The 'incomplete' status of the script means that it is only a technical example, and will need to be tweaked for your specific requirements in your calling pipeline. Feel free to explore different command line options with the UG. For example using Queue you can create two instances of the UG and test using with BAQ and without. As for what UG commands you should be using, see the UG gatkdocs and the Best Practices for an overall description of where the UG fits in a calling pipeline.

  • Thank you! That cleared things up for me.

  • I also cannot find the UnifiedGenotyper class, and I have ran ant. Classes for other walkers are there. Does this class even exist or it is just mentioned as an example?

  • Geraldine_VdAuweraGeraldine_VdAuwera Cambridge, MAMember, Administrator, Broadie

    @armen, can you tell me a bit more about what you are trying to do and what problem you are experiencing?

  • Hi @Geraldine_VdAuwera,

    I followed the instructions on http://gatkforums.broadinstitute.org/discussion/1309/queue-with-intellij-idea to setup Queue with IntelliJ, and I'm trying to edit the example Unified Genotyper script public/scala/qscript/org/broadinstitute/sting/queue/qscripts/examples/ExampleUnifiedGenotyper.scala. However, the IDE tells me that the class UnifiedGenotyper doesn't exist.

    If I run ExampleUnifiedGenotyper.scala using Queue:

    java -jar dist/Queue.jar -S public/scala/qscript/org/broadinstitute/sting/queue/qscripts/examples/ExampleUnifiedGenotyper.scala -help

    I get errors for the same reason:

    INFO 16:31:27,906 QScriptManager - Compiling 1 QScript
    ERROR 16:31:29,701 QScriptManager - ExampleUnifiedGenotyper.scala:73: not found: type UnifiedGenotyper
    ERROR 16:31:29,706 QScriptManager - val genotyper = new UnifiedGenotyper with UnifiedGenotyperArguments
    ERROR 16:31:29,706 QScriptManager - ^
    ERROR 16:31:29,906 QScriptManager - ExampleUnifiedGenotyper.scala:78: value scatterCount is not a member of AnyRef with ExampleUnifiedGenotyper.this.UnifiedGenotyperArguments
    ERROR 16:31:29,909 QScriptManager - genotyper.scatterCount = 3
    ERROR 16:31:29,909 QScriptManager - ^
    ERROR 16:31:30,245 QScriptManager - ExampleUnifiedGenotyper.scala:80: value out is not a member of AnyRef with ExampleUnifiedGenotyper.this.UnifiedGenotyperArguments
    ERROR 16:31:30,247 QScriptManager - genotyper.out = swapExt(qscript.bamFile, "bam", "unfiltered.vcf")
    ERROR 16:31:30,248 QScriptManager - ^
    ERROR 16:31:30,279 QScriptManager - ExampleUnifiedGenotyper.scala:82: value out is not a member of AnyRef with ExampleUnifiedGenotyper.this.UnifiedGenotyperArguments
    ERROR 16:31:30,281 QScriptManager - evalUnfiltered.eval :+= genotyper.out
    ERROR 16:31:30,282 QScriptManager - ^
    ERROR 16:31:30,319 QScriptManager - ExampleUnifiedGenotyper.scala:83: value out is not a member of AnyRef with ExampleUnifiedGenotyper.this.UnifiedGenotyperArguments
    ERROR 16:31:30,321 QScriptManager - evalUnfiltered.out = swapExt(genotyper.out, "vcf", "eval")
    ERROR 16:31:30,323 QScriptManager - ^
    ERROR 16:31:30,354 QScriptManager - ExampleUnifiedGenotyper.scala:85: value out is not a member of AnyRef with ExampleUnifiedGenotyper.this.UnifiedGenotyperArguments
    ERROR 16:31:30,356 QScriptManager - variantFilter.variant = genotyper.out
    ERROR 16:31:30,356 QScriptManager - ^
    ERROR 16:31:30,441 QScriptManager - 6 errors found

    ERROR ------------------------------------------------------------------------------------------
    ERROR stack trace

    org.broadinstitute.sting.queue.QException: Compile of public/scala/qscript/org/broadinstitute/sting/queue/qscripts/examples/ExampleUnifiedGenotyper.scala failed with 6 errors
    at org.broadinstitute.sting.queue.QScriptManager.loadScripts(QScriptManager.scala:71)
    at org.broadinstitute.sting.queue.QCommandLine.org$broadinstitute$sting$queue$QCommandLine$$qScriptPluginManager(QCommandLine.scala:95)
    at org.broadinstitute.sting.queue.QCommandLine.getArgumentSources(QCommandLine.scala:227)
    at org.broadinstitute.sting.commandline.CommandLineProgram.start(CommandLineProgram.java:202)
    at org.broadinstitute.sting.commandline.CommandLineProgram.start(CommandLineProgram.java:152)
    at org.broadinstitute.sting.queue.QCommandLine$.main(QCommandLine.scala:62)
    at org.broadinstitute.sting.queue.QCommandLine.main(QCommandLine.scala)

    ERROR ------------------------------------------------------------------------------------------
    ERROR A GATK RUNTIME ERROR has occurred (version 2.7-1-g9092aa6):
    ERROR
    ERROR This might be a bug. Please check the documentation guide to see if this is a known problem.
    ERROR If not, please post the error message, with stack trace, to the GATK forum.
    ERROR Visit our website and forum for extensive documentation and answers to
    ERROR commonly asked questions http://www.broadinstitute.org/gatk
    ERROR
    ERROR MESSAGE: Compile of public/scala/qscript/org/broadinstitute/sting/queue/qscripts/examples/ExampleUnifiedGenotyper.scala failed with 6 errors
    ERROR ------------------------------------------------------------------------------------------

    INFO 16:31:30,601 QCommandLine - Shutting down jobs. Please wait...

  • I'm getting the same error. If I checkout the git repository and build using ant, I'm unable to find the GATK extensions. However, the prebuilt version of Queue works fine.

  • Just for more clarifications...the Piccard extensions work fine and I cloned the repo on Monday.

  • Geraldine_VdAuweraGeraldine_VdAuwera Cambridge, MAMember, Administrator, Broadie

    Hi folks, two quick questions to help find out what the problem is:

    1. Are you running ant clean before building? Sometimes just ant isn't enough.

    2. What is the output of the command: jar tvf dist/Queue.jar | grep 'extensions/gatk'?

    1. I tried it with ant clean and then ant queue, but still same errors.
    2. The output is attached.
    txt
    txt
    output.txt
    25K
  • I also tried git checkout tags/2.6 followed by ant clean and ant queue. The error persists. It might be ivy related?

  • Same results for me.

    @kunalbhutani said:
    1. I tried it with ant clean and then ant queue, but still same errors.
    2. The output is attached.

  • droazendroazen Cambridge, MADev

    Based on the output you attached, it looks like you're building from our "GATK framework only" repository (https://github.com/broadgsa/gatk) instead of our full "framework + tools" repository (https://github.com/broadgsa/gatk-protected), which includes both the core framework as well as our flagship tools like the UnifiedGenotyper and the HaplotypeCaller. In order to use the UnifiedGenotyper with Queue you'll need to clone and build from the gatk-protected repository.

    Hope this helps,
    David

  • Gotcha, thanks!

  • Thank you @droazen, it works now!

    It would be helpful to put the link to the full repository in http://gatkforums.broadinstitute.org/discussion/1306/overview-of-queue.

  • Geraldine_VdAuweraGeraldine_VdAuwera Cambridge, MAMember, Administrator, Broadie

    @armen, I'll add the link. Thanks for the suggestion!

Sign In or Register to comment.