Deleting un-needed submission directories

yfarjounyfarjoun Broad InstituteDev ✭✭✭

After a bout of developing a method in Firecloud one is left with many abandoned submission directories, many of which may contain large files. Some are needed (they are referenced by the data in the data folder) others are not (they are not referenced by the data model). I know that Alex has a script to remove such submission folders but it's scary to use it...it would be great if there was a button next to each submission "delete data" that would become enabled once the data in that folder is not actively used. (perhaps a separate tool could inform me what files from a certain submission are currently used )

This would help me cut down on my storage costs and thereby encourage me to develop tools in and use FireCloud.

Answers

  • gordon123gordon123 BroadMember, Broadie

    I like this as a UI concept.

    Some additional issues to consider for polish or edge-case handling:

    1) Display storage used for each submission (deletable or not), be able to sort based on this.

    2) Distinguish between referenced and unreferenced files within a given submission directory, to give the opportunity to purge the unreferenced files while leaving the referenced, or to purge both.

    3) Make it possible to dump what is referencing files in a given submission, ie which entities and which attributes. Probably lists of each would be better than than a full table. This is to answer the question of whether you really care that a submission is being referenced.

  • KateNKateN Cambridge, MAMember, Broadie, Moderator admin

    This is an excellent suggestion! I will put in a feature request for this straight away, and I apologize for the delay thus far.

Sign In or Register to comment.