We've moved!
For WDL questions, see the WDL specification and WDL docs.
For Cromwell questions, see the Cromwell docs and please post any issues on Github.

"File not found" errors when using call caching

I've enabled call-caching as shown below. However, when I remove a cromwell-execution folder, I expected the cache to be invalidated, and the whole analysis to be run again. However, cromwell crashes with a bunch of 'File not found' errors since it cannot find the cached files.

Now, I can't even re-run my analysis, since cromwell keeps crashing due to the missing cache files. Is this the expected behaviour?

Cromwell config:

// Optional call-caching configuration.                                                                
call-caching {                                                                                         
  # Allows re-use of existing results for jobs you've already run                                      
  # (default: false)                                                                                   
  enabled = true                                                                                       

  # Whether to invalidate a cache result forever if we cannot reuse them. Disable this if you expect some cache copies
  # to fail for external reasons which should not invalidate the cache (e.g. auth differences between users):
  # (default: true)                                                                                    
  invalidate-bad-cache-results = true                                                                  
} 

File not found errors:

Could not localize /home/redmar/devel/wdl/cromwell-executions/resfinder/c381d730-1b3d-424f-ad64-6fa29634ac03/call-trim/shard-0/execution/lane_21_1.trimmed.gz -> /home/redmar/devel/wdl/cromwell-executions/resfinder/c381d730-1b3d-424f-ad64-6fa29634ac03/call-abyssPE/shard-0/inputs/home/redmar/devel/wdl/cromwell-executions/resfinder/c381d730-1b3d-424f-ad64-6fa29634ac03/call-trim/shard-0/execution/lane_21_1.trimmed.gz:
    /home/redmar/devel/wdl/cromwell-executions/resfinder/c381d730-1b3d-424f-ad64-6fa29634ac03/call-trim/shard-0/execution/lane_21_1.trimmed.gz doesn't exists
    File not found /home/redmar/devel/wdl/cromwell-executions/resfinder/c381d730-1b3d-424f-ad64-6fa29634ac03/call-abyssPE/shard-0/inputs/home/redmar/devel/wdl/cromwell-executions/resfinder/c381d730-1b3d-424f-ad64-6fa29634ac03/call-trim/shard-0/execution/lane_21_1.trimmed.gz -> /home/redmar/devel/wdl/cromwell-executions/resfinder/c381d730-1b3d-424f-ad64-6fa29634ac03/call-trim/shard-0/execution/lane_21_1.trimmed.gz
    File not found /home/redmar/devel/wdl/cromwell-executions/resfinder/c381d730-1b3d-424f-ad64-6fa29634ac03/call-trim/shard-0/execution/lane_21_1.trimmed.gz
    File not found /home/redmar/devel/wdl/cromwell-executions/resfinder/c381d730-1b3d-424f-ad64-6fa29634ac03/call-trim/shard-0/execution/lane_21_1.trimmed.gz

Issue · Github
by Geraldine_VdAuwera

Issue Number
1689
State
open
Last Updated
Assignee
Array
Milestone
Array

Best Answer

Answers

Sign In or Register to comment.