support for git-annex as the filesystem

ilyailya BroadMember, Broadie

It would be good if Cromwell could support git-annex ( https://git-annex.branchable.com/ ) as a filesystem option. You'd specify files not by pathname but by checksum of their contents, e.g.
git-annex://SHA256E-s392--76e76a9b100816ab8d576baa106b04e398be7bbd8ad8431cdc04e5709bfc783a.json
git-annex keeps track of where each file is stored, and has commands to fetch the file by checksum and to push files to configured destinations (cloud or local). It can be used to version analysis code and data together in a consistent way ( http://datalad.org ).

Answers

  • RuchiRuchi Member, Broadie, Moderator, Dev admin
    edited September 28

    Hey @ilya

    This is an interesting idea! For me to learn more about it, can you summarize what are the biggest advantages of using git-annex over file paths? Is there some kind of speed or convenience boost using git-annex?

    Thanks

    Post edited by Ruchi on
Sign In or Register to comment.