-
Notifications
You must be signed in to change notification settings - Fork 400
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support Optimize on non-append-only tables #1125
Comments
Do we have more details on scenarios where the table might get corrupted besides when the table uses deletion vectors ? |
Don't quite remember what the specific issue was when this was created. My assumption would be that the corruption was due to the fact that we were not doing conflict resolution on failing commits. This would not have been an issue for append only tables. Since then we added conflict resolution, but not sure if that is in the latest python release. So i think this could be resolved now. |
I think we can consider this fixed by #632, but we need to update the documentation for Optimize, since it currently claims it could corrupt tables. |
Description
We note here that optimize only works on append-only tables. We should get it to work for all tables.
delta-rs/rust/src/optimize.rs
Lines 7 to 8 in 2c66b19
Use Case
Related Issue(s)
The text was updated successfully, but these errors were encountered: