Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[v23.2.x] cloud_storage: Prevent misaligned segment reuploads #12973

Conversation

vbotbuildovich
Copy link
Collaborator

@vbotbuildovich vbotbuildovich commented Aug 23, 2023

Backport of PR #12966

Fixes #12974 12974

The tests are checking compacted reupload that starts in a gap. The
situation is impossible in redpanda since we can't have gaps in the
manifest. The tests are failing when strict checks on segment metadata
are enabled. Only alinged segment reuploads are allowed by these checks
so the reupload that starts in the gap can't really be registred by
the archival STM.

(cherry picked from commit aa2348f)
Validate compacted segments inside the 'safe_segment_meta_to_add'
method. Do not allow segment reuploads which are not aligned with
existing segments in the manifest.

(cherry picked from commit b72061c)
@vbotbuildovich vbotbuildovich added this to the v23.2.x-next milestone Aug 23, 2023
@vbotbuildovich vbotbuildovich added the kind/backport PRs targeting a stable branch label Aug 23, 2023
@Lazin Lazin marked this pull request as ready for review August 23, 2023 19:12
@piyushredpanda
Copy link
Contributor

Failure seems to be #12402

@piyushredpanda piyushredpanda merged commit 40275c0 into redpanda-data:v23.2.x Aug 24, 2023
11 checks passed
@piyushredpanda piyushredpanda modified the milestones: v23.2.x-next, v23.2.7 Aug 24, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/redpanda kind/backport PRs targeting a stable branch
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants