Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[6.2.0] Correctly handle templated tree artifacts in the prefetcher. #17735

Merged
merged 1 commit into from
Mar 11, 2023

Conversation

tjgq
Copy link
Contributor

@tjgq tjgq commented Mar 10, 2023

Due to the existence of templated tree artifacts (tree artifacts where each file is produced by a separate action) and nested artifacts (artifacts whose output path is a descendant of another artifact's), the prefetcher must not assume every tree artifact is fetched as a whole.

In addition, concurrent actions calling the prefetcher might write to the same directory in the output tree, so they must synchronize when making the directory temporarily writable.

Fixes #16333.

PiperOrigin-RevId: 513205572
Change-Id: I827c4643643f63c9425e63bdf9177805c5f0f409

Due to the existence of templated tree artifacts (tree artifacts where each file is produced by a separate action) and nested artifacts (artifacts whose output path is a descendant of another artifact's), the prefetcher must not assume every tree artifact is fetched as a whole.

In addition, concurrent actions calling the prefetcher might write to the same directory in the output tree, so they must synchronize when making the directory temporarily writable.

Fixes bazelbuild#16333.

PiperOrigin-RevId: 513205572
Change-Id: I827c4643643f63c9425e63bdf9177805c5f0f409
@tjgq tjgq requested a review from ShreeM01 as a code owner March 10, 2023 22:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
team-Remote-Exec Issues and PRs for the Execution (Remote) team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants