Notice:
If you happen to see a question you know the answer to, please do chime in and help your fellow community members. We encourage our fourm members to be more involved, jump in and help out your fellow researchers with their questions. GATK forum is a community forum and helping each other with using GATK tools and research is the cornerstone of our success as a genomics research community.We appreciate your help!

Test-drive the GATK tools and Best Practices pipelines on Terra


Check out this blog post to learn how you can get started with GATK and try out the pipelines in preconfigured workspaces (with a user-friendly interface!) without having to install anything.
Attention:
We will be out of the office on October 14, 2019, due to the U.S. holiday. We will return to monitoring the forum on October 15.

gatk-package-4.0.9.0-local.jar, GenomicsDBImport

manolismanolis ✭✭Member ✭✭
edited September 2018 in Ask the GATK team
Hi, I have this error ... I'm working with a linux server with simply bash codes. With the older versions I did not have this problem



Using GATK jar /home/manolis/bin/gatk-4.0.9.0/gatk-package-4.0.9.0-local.jar
Running:
    java -Dsamjdk.use_async_io_read_samtools=false -Dsamjdk.use_async_io_write_samtools=true -Dsamjdk.use_async_io_write_tribble=false -Dsamjdk.compression_level=2 -Xmx10
g -jar /home/manolis/bin/gatk-4.0.9.0/gatk-package-4.0.9.0-local.jar GenomicsDBImport --genomicsdb-workspace-path /home/manolis/GATK4/germlineVariants/3.genomicsDB/PROVA/
21 --batch-size 1 -L chr21 --sample-name-map gVCF.list --reader-threads 1 -ip 100
08:44:49.154 INFO  NativeLibraryLoader - Loading libgkl_compression.so from jar:file:/home/manolis/bin/gatk-4.0.9.0/gatk-package-4.0.9.0-local.jar!/com/intel/gkl/native/l
ibgkl_compression.so
Sep 28, 2018 8:44:49 AM shaded.cloud_nio.com.google.auth.oauth2.ComputeEngineCredentials runningOnComputeEngine
WARNING: Failed to detect whether we are running on Google Compute Engine.
java.net.NoRouteToHostException: No route to host (Host unreachable)
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
        at java.net.Socket.connect(Socket.java:589)
        at sun.net.NetworkClient.doConnect(NetworkClient.java:175)
        at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
        at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
        at sun.net.www.http.HttpClient.<init>(HttpClient.java:211)
        at sun.net.www.http.HttpClient.New(HttpClient.java:308)
        at sun.net.www.http.HttpClient.New(HttpClient.java:326)
        at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1202)
        at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1138)
        at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1032)
        at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:966)
        at shaded.cloud_nio.com.google.api.client.http.javanet.NetHttpRequest.execute(NetHttpRequest.java:104)
        at shaded.cloud_nio.com.google.api.client.http.HttpRequest.execute(HttpRequest.java:981)
        at shaded.cloud_nio.com.google.auth.oauth2.ComputeEngineCredentials.runningOnComputeEngine(ComputeEngineCredentials.java:210)
        at shaded.cloud_nio.com.google.auth.oauth2.DefaultCredentialsProvider.tryGetComputeCredentials(DefaultCredentialsProvider.java:290)
        at shaded.cloud_nio.com.google.auth.oauth2.DefaultCredentialsProvider.getDefaultCredentialsUnsynchronized(DefaultCredentialsProvider.java:207)
        at shaded.cloud_nio.com.google.auth.oauth2.DefaultCredentialsProvider.getDefaultCredentials(DefaultCredentialsProvider.java:124)
        at shaded.cloud_nio.com.google.auth.oauth2.GoogleCredentials.getApplicationDefault(GoogleCredentials.java:127)
        at shaded.cloud_nio.com.google.auth.oauth2.GoogleCredentials.getApplicationDefault(GoogleCredentials.java:100)
        at com.google.cloud.ServiceOptions.defaultCredentials(ServiceOptions.java:304)
        at com.google.cloud.ServiceOptions.<init>(ServiceOptions.java:278)
        at com.google.cloud.storage.StorageOptions.<init>(StorageOptions.java:83)
        at com.google.cloud.storage.StorageOptions.<init>(StorageOptions.java:31)
        at com.google.cloud.storage.StorageOptions$Builder.build(StorageOptions.java:78)
        at org.broadinstitute.hellbender.utils.gcs.BucketUtils.setGlobalNIODefaultOptions(BucketUtils.java:360)
        at org.broadinstitute.hellbender.cmdline.CommandLineProgram.instanceMainPostParseArgs(CommandLineProgram.java:183)
        at org.broadinstitute.hellbender.cmdline.CommandLineProgram.instanceMain(CommandLineProgram.java:211)
        at org.broadinstitute.hellbender.Main.runCommandLineProgram(Main.java:160)
        at org.broadinstitute.hellbender.Main.mainEntry(Main.java:203)
        at org.broadinstitute.hellbender.Main.main(Main.java:289)

Sep 28, 2018 8:44:49 AM shaded.cloud_nio.com.google.auth.oauth2.ComputeEngineCredentials runningOnComputeEngine
WARNING: Failed to detect whether we are running on Google Compute Engine.
java.net.NoRouteToHostException: No route to host (Host unreachable)
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
        at java.net.Socket.connect(Socket.java:589)
        at sun.net.NetworkClient.doConnect(NetworkClient.java:175)
        at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
        at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
        at sun.net.www.http.HttpClient.<init>(HttpClient.java:211)
        at sun.net.www.http.HttpClient.New(HttpClient.java:308)
        at sun.net.www.http.HttpClient.New(HttpClient.java:326)
        at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1202)
        at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1138)
        at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1032)
        at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:966)
        at shaded.cloud_nio.com.google.api.client.http.javanet.NetHttpRequest.execute(NetHttpRequest.java:104)
        at shaded.cloud_nio.com.google.api.client.http.HttpRequest.execute(HttpRequest.java:981)
        at shaded.cloud_nio.com.google.auth.oauth2.ComputeEngineCredentials.runningOnComputeEngine(ComputeEngineCredentials.java:210)
        at shaded.cloud_nio.com.google.auth.oauth2.DefaultCredentialsProvider.tryGetComputeCredentials(DefaultCredentialsProvider.java:290)
        at shaded.cloud_nio.com.google.auth.oauth2.DefaultCredentialsProvider.getDefaultCredentialsUnsynchronized(DefaultCredentialsProvider.java:207)
        at shaded.cloud_nio.com.google.auth.oauth2.DefaultCredentialsProvider.getDefaultCredentials(DefaultCredentialsProvider.java:124)
        at shaded.cloud_nio.com.google.auth.oauth2.GoogleCredentials.getApplicationDefault(GoogleCredentials.java:127)
        at shaded.cloud_nio.com.google.auth.oauth2.GoogleCredentials.getApplicationDefault(GoogleCredentials.java:100)
        at com.google.cloud.ServiceOptions.defaultCredentials(ServiceOptions.java:304)
        at com.google.cloud.ServiceOptions.<init>(ServiceOptions.java:278)
        at com.google.cloud.storage.StorageOptions.<init>(StorageOptions.java:83)
        at com.google.cloud.storage.StorageOptions.<init>(StorageOptions.java:31)
        at com.google.cloud.storage.StorageOptions$Builder.build(StorageOptions.java:78)
        at org.broadinstitute.hellbender.utils.gcs.BucketUtils.setGlobalNIODefaultOptions(BucketUtils.java:360)
        at org.broadinstitute.hellbender.cmdline.CommandLineProgram.instanceMainPostParseArgs(CommandLineProgram.java:183)
        at org.broadinstitute.hellbender.cmdline.CommandLineProgram.instanceMain(CommandLineProgram.java:211)
        at org.broadinstitute.hellbender.Main.runCommandLineProgram(Main.java:160)
        at org.broadinstitute.hellbender.Main.mainEntry(Main.java:203)
        at org.broadinstitute.hellbender.Main.main(Main.java:289)

Best Answer

Answers

  • bhanuGandhambhanuGandham admin Cambridge MAMember, Administrator, Broadie, Moderator admin

    Hi @manolis

    Would you please give me the exact command you are using, the dataset you are using the tool on and the version of gatk please.
    Thank you.

    Regards
    Bhanu

  • manolismanolis ✭✭ Member ✭✭
    edited October 2018

    Hi,

    this "warning" is totally random, sometimes I have this warning another times no ...

    gatk-4.0.9.0

    ${GATK4} --java-options "-Xmx10g" GenomicsDBImport --genomicsdb-workspace-path /home/${variantdb}/21 --batch-size 1 -L chr21 --sample-name-map gVCF.list --reader-threads 1 -ip 100

    gVCF.list is a list of 105 gVCF

    Thanks

  • manolismanolis ✭✭ Member ✭✭

    just some more informations... for GenomicsDBImport are available totally 25G RAM (10G for java, -Xmx) and I also tried with --batch-size 5 and --reader-threads 5.

    The same warning is always random also sometimes with BQSR, ApplyBQSR, HaplotypeCaller ... Maybe it depends from my server setting?

    Could you tell me under what conditions I must have this warning?

    Thanks

  • manolismanolis ✭✭ Member ✭✭

    Hi, considering that I always have a final output file from each command, I would like to know if I can use it for downstream analysis even I have this warning.

    In the post October 8, the command is --batch-size 50 not --batch-size 5

  • manolismanolis ✭✭ Member ✭✭
Sign In or Register to comment.