Move large data files in share/ etc. to a new repository
Having example data sets is a useful feature for us to show examples, run tests, or verify algorithms work as intended.
However, keeping all data in one repository, especially when data formats change over time, can be restrictive. It becomes harder to track provenance of data examples and if multiple repositories require the same reference data sets then we risk duplication between repositories. This is even harder to manage if the data files are larger than 100MB and require us to use Git LFS.
To address this concern, we recommend creating a new spiir-archive
or spiir-data
repository that can archive important and well-documented data.