Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve FSTree behaviour for partially written objects #2208

Merged
merged 3 commits into from
Jan 24, 2023

Conversation

fyrchik
Copy link
Contributor

@fyrchik fyrchik commented Jan 23, 2023

  1. Partially written object is deleted.
  2. First write to a temporary file to avoid partially written files during hard-reset

Also, log time-consuming operations to help administrator observe system behaviour until we have a proper async operations support in control service.

Currently the only way to tell whether `evacuate/set-mode` is finished
is to set a very big timeout and _hope_ that the operation will finish.
In this commit we add INFO logs for such operations which should
simplify the life of an administrator.

Signed-off-by: Evgenii Stratonikov <[email protected]>
@codecov
Copy link

codecov bot commented Jan 23, 2023

Codecov Report

Merging #2208 (dad7895) into support/v0.35 (1a7c827) will increase coverage by 0.02%.
The diff coverage is 91.66%.

❗ Current head dad7895 differs from pull request most recent head afaf309. Consider uploading reports for the commit afaf309 to get more accurate results

@@                Coverage Diff                @@
##           support/v0.35    #2208      +/-   ##
=================================================
+ Coverage          30.88%   30.90%   +0.02%     
=================================================
  Files                383      383              
  Lines              28354    28364      +10     
=================================================
+ Hits                8757     8766       +9     
- Misses             18851    18852       +1     
  Partials             746      746              
Impacted Files Coverage Δ
pkg/local_object_storage/blobstor/fstree/fstree.go 66.48% <75.00%> (-0.18%) ⬇️
pkg/local_object_storage/engine/evacuate.go 84.09% <100.00%> (+0.56%) ⬆️
pkg/local_object_storage/shard/mode.go 100.00% <100.00%> (ø)

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

Copy link
Member

@roman-khimov roman-khimov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good, but something should clean up f# files on startup or as some additional maintenance command.

@fyrchik fyrchik merged commit eda6fba into nspcc-dev:support/v0.35 Jan 24, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants