Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ENH] - Archiving/recreation of old builds #889

Open
peytondmurray opened this issue Sep 23, 2024 · 0 comments
Open

[ENH] - Archiving/recreation of old builds #889

peytondmurray opened this issue Sep 23, 2024 · 0 comments
Labels
area: user experience 👩🏻‍💻 Items impacting the end-user experience impact: high 🟥 This issue affects most of the conda-store users or is a critical issue needs: discussion 💬

Comments

@peytondmurray
Copy link
Contributor

peytondmurray commented Sep 23, 2024

Feature description

Current deployments of conda-store require manual intervention to recover disk space when many users create many environment builds, because conda-store keeps old builds indefinitely. This issue is to discuss proposals for implementing a format by which a old build can be archived when not in use, and recreated if a user requests for it to be activated again.

Value and/or benefit

Currently, keeping every build keeps every package in each build. In cases where many old build exists, this accounts for the majority of the disk space used by conda-store, when only the most recent build or two for each environment is actually being used. Archiving old builds would recover most of the disk space while still allowing users to revert if need be, greatly reducing the maintenance burden for existing conda-store deployments.

Related issues

See also #791, which is a proposal to update the default conda-store storage limits. While that approach could alleviate some of the pressure on existing deployments, a long term fix will involve more robust archiving/recreation capabilities.

@peytondmurray peytondmurray added needs: discussion 💬 impact: high 🟥 This issue affects most of the conda-store users or is a critical issue area: user experience 👩🏻‍💻 Items impacting the end-user experience labels Sep 23, 2024
@peytondmurray peytondmurray changed the title [ENH] - Archiving/rehydration of old builds [ENH] - Archiving/recreation of old builds Sep 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area: user experience 👩🏻‍💻 Items impacting the end-user experience impact: high 🟥 This issue affects most of the conda-store users or is a critical issue needs: discussion 💬
Projects
Status: New 🚦
Development

No branches or pull requests

1 participant