Jobs have been queued in Cromwell for a couple of hours for myself and multiple other users. The following error comes up when I tried to relaunch jobs to see if that would help (image)
@breardon We pushed a release today with retry fixes for a google issue we started experiencing since Jan 8th. The google issue may lead to the UI reporting that the workspace bucket is unreadable or there may be workflow failures - potentially like the one that you and the other users are seeing. Refreshing or retrying should help but eventually we are waiting for google to resolve this issue. However, I will double check with the team that this issue is actually related to this problem and not something else and get back to you.
I was able to rekick off the jobs and they completed successfully. The previous jobs are still queued in cromwell, but I will cancel them. You can close this inquiry.
@SChaluvadi thank you! It looks like we replied to the thread at the same time haha
@breardon Awesome - glad to hear it!