Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ensure test cluster classpath inputs have predictable ordering #43938

Merged

Conversation

mark-vieira
Copy link
Contributor

Because we build test cluster distribution classpaths using a unordered set implementation, file order for otherwise identical sets can differ across build invocations. The result of this is different build cache keys and cache misses. To combat this we sort these collections so that we can ensure stable and predictable ordering given the same set of files. As an example, here's a build scan where the classpath is otherwise identical except for order.

@mark-vieira mark-vieira requested a review from rjernst July 3, 2019 18:50
@mark-vieira mark-vieira added the :Delivery/Build Build or test infrastructure label Jul 3, 2019
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-core-infra

Copy link
Member

@rjernst rjernst left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mark-vieira mark-vieira force-pushed the elasticsearch-node-consistent-inputs branch from c1e3bb5 to e1a3f0a Compare July 3, 2019 20:08
@mark-vieira
Copy link
Contributor Author

@elasticmachine run elasticsearch-ci/packaging-sample

1 similar comment
@mark-vieira
Copy link
Contributor Author

@elasticmachine run elasticsearch-ci/packaging-sample

@mark-vieira mark-vieira merged commit baabb75 into elastic:master Jul 3, 2019
@mark-vieira mark-vieira deleted the elasticsearch-node-consistent-inputs branch July 3, 2019 22:15
mark-vieira added a commit to mark-vieira/elasticsearch that referenced this pull request Jul 10, 2019
@mark-vieira mark-vieira added the Team:Delivery Meta label for Delivery team label Nov 11, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Delivery/Build Build or test infrastructure Team:Delivery Meta label for Delivery team v8.0.0-alpha1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants