git-annex has been around for quite some time, but never really gained momentum.
Git LFS is rather young and is already supported by GitHub, Bitbucket and GitLab.

Both tools handle binary files in git repositories. On the other hand, GitLab seems to have replaced git-annex with Git LFS within one year.

  • What are the technical differences?
  • Do they solve the same problem?
up vote 38 down vote accepted

They do solve the same problem.

Let me start off with pro/con, then I'll move into technical differences.

git-annex

Pros:

  • Supports multiple remotes that you can store the binaries.
  • Can be used without support from hosting provider (for more details see here).

Cons:

  • Windows support in beta, and has been for a long time
  • Users need to learn separate commands for day-to-day work
  • not supported by github and bitbucket

git-lfs

Pros:

  • Supported by github, bitbucket and gitlab
  • Most supported on all os's
  • Easy to use.
  • automated based on filters

Cons:

Technical

git-annex

git-annex works by creating a symlink in your repo that gets committed. The actual data gets stored into a separate backend (S3, rsync, and MANY others). It is written in haskell. Since it uses symlinks, windows users are forced to use annex in a much different manner, which makes the learning curve higher.

git-lfs

Pointer files are written. A git-lfs api is used to write the BLOBs to lfs. A special LFS server is required due to this. Git lfs uses filters so you only have to set up lfs once, and again when you want to specify which types of files you want to push to lfs.

  • Great summary! I have two more questions. Do Windows users of git-annex lose some of the functionality of git-annex? Can there be several LFS servers (comparable to multiple backends in git-annex)? – Stefanus Sep 6 '16 at 17:47
  • 1
    There could be, LFS works a LOT like the actual git servers work. You would simply add another remote and push the branch to both remotes. – Pachonk Sep 7 '16 at 18:28
  • “automated based on filters” It appears git annex can do the same too: git-annex.branchable.com/tips/largefiles – Rufflewind Jan 20 '17 at 4:59
  • a lot more cons, see my post below... – Karl Forner Oct 20 '17 at 11:06
  • I welcome any modification to this list if anybody would like to add pros/cons. – Pachonk Oct 20 '17 at 22:05

A major advantage of git annex is that you can choose which file you want to donwload.

You still know which files are available thanks to the symlinks.

For example suppose that you have a directory full of ISO files. You can list the files, then decide which one you want to download by typing: git annex get my_file.

Another advantage is that the files are not duplicated in your checkout. With LFS, lfs files are present as git objects both in .git/lfs/objects and in your working repository. So If you have 20 GB of LFS files, you need 40 GB on your disk. While with git annex, files are symlinked so in this case only 20 GB is required.

  • Thanks for this answer! I'm still trying to understand things, but wouldn't GVFS (github.com/Microsoft/gvfs) paired with git/git-lfs address the issue of downloading individual files. From their readme... "GVFS virtualizes the file system beneath your git repo so that git and all tools see what appears to be a normal repo, but GVFS only downloads objects as they are needed" – Vivek Gani Jun 11 '17 at 19:58
  • 2
    GVFS seems to be windows only for the moment. – Karl Forner Jun 12 '17 at 8:18
  • 2
    Thanks for mentioning the data duplication of LFS, I didn't see that mentioned anywhere else. I'd rather not duplicate my media directory disk usage for no good reason. – Ragnar Jul 29 '17 at 16:58

Your Answer

 

By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

Not the answer you're looking for? Browse other questions tagged or ask your own question.