DEV Community

loading...

Discussion on: How to version large files with Git

Collapse
_garybell profile image
Gary Bell

Whilst it would still initially be slow, if the large files rarely change you could put them in their own repository, and include them as a git sub module. That way you get the performance you would expect from git in your main repo, whilst being able to version large files

Collapse
shcheklein profile image
Ivan Shcheklein Author

Good point, haven't tried this before. Probably it might work for smaller datasets, but will start breaking at multi GB data because of Git servers limits in terms of overall Git repo size.

Collapse
_garybell profile image
Gary Bell

Sub modules are an interesting beast of their own. But yes, multi gigabyte repos will still cause issues

Forem Open with the Forem app