Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: fix flaky test-http-server-consumed-timeout #7717

Closed
wants to merge 1 commit into from

Conversation

Trott
Copy link
Member

@Trott Trott commented Jul 13, 2016

Checklist
  • make -j4 test (UNIX), or vcbuild test nosign (Windows) passes
  • tests and/or benchmarks are included
  • commit message follows commit guidelines
Affected core subsystem(s)

test http

Description of change

Using identical timeout values appears to have eliminated the flakiness in the test.

Fixes: #7643

With this change to the test and removing the fix in #6286, everything fails (as it should): https://ci.nodejs.org/job/node-stress-single-test/804/ (Test run just once on each platform)

With this change to the test only, everything passes (as it should): https://ci.nodejs.org/job/node-stress-single-test/805/ (Test run 100 times on each platform)

And with this change, the test is not flaky on FreeBSD:
https://ci.nodejs.org/job/node-stress-single-test/806/nodes=freebsd10-64/console (9999 runs, 0 failures)

For comparison, the test is flaky on current master on FreeBSD:
https://ci.nodejs.org/job/node-stress-single-test/807/nodes=freebsd10-64/console
(also 9999 runs, 1 failure, so not the overwhelming results I was hoping for, but at least it wasn't 0 failures...)

/cc @indutny

The flakiness is not terribly reproducible in the stress tests, but if it stands to reason that this reduces any race condition window, then it's probably worth doing.

Using identical timeout values appears to have eliminated the flakiness
in the test.

Fixes: nodejs#7643
@Trott Trott added http Issues or PRs related to the http subsystem. test Issues and PRs related to the tests. freebsd Issues and PRs related to the FreeBSD platform. labels Jul 13, 2016
@indutny
Copy link
Member

indutny commented Jul 13, 2016

Argh... I don't feel good about it, but if it helps... LGTM

@indutny
Copy link
Member

indutny commented Jul 13, 2016

Please disregard my LGTM

@indutny
Copy link
Member

indutny commented Jul 13, 2016

After a bit of chat on IRC, LGTM again 💃 👍

@Trott
Copy link
Member Author

Trott commented Jul 15, 2016

Trott added a commit to Trott/io.js that referenced this pull request Jul 17, 2016
Using identical timeout values appears to have eliminated the flakiness
in the test.

Fixes: nodejs#7643
PR-URL: nodejs#7717
Reviewed-By: Fedor Indutny <[email protected]>
@Trott
Copy link
Member Author

Trott commented Jul 17, 2016

Landed in 7cb70e9

@Trott Trott closed this Jul 17, 2016
evanlucas pushed a commit that referenced this pull request Jul 19, 2016
Using identical timeout values appears to have eliminated the flakiness
in the test.

Fixes: #7643
PR-URL: #7717
Reviewed-By: Fedor Indutny <[email protected]>
evanlucas pushed a commit that referenced this pull request Jul 20, 2016
Using identical timeout values appears to have eliminated the flakiness
in the test.

Fixes: #7643
PR-URL: #7717
Reviewed-By: Fedor Indutny <[email protected]>
MylesBorins pushed a commit that referenced this pull request Oct 10, 2016
Using identical timeout values appears to have eliminated the flakiness
in the test.

Fixes: #7643
PR-URL: #7717
Reviewed-By: Fedor Indutny <[email protected]>
rvagg pushed a commit that referenced this pull request Oct 18, 2016
Using identical timeout values appears to have eliminated the flakiness
in the test.

Fixes: #7643
PR-URL: #7717
Reviewed-By: Fedor Indutny <[email protected]>
MylesBorins pushed a commit that referenced this pull request Oct 26, 2016
Using identical timeout values appears to have eliminated the flakiness
in the test.

Fixes: #7643
PR-URL: #7717
Reviewed-By: Fedor Indutny <[email protected]>
@MylesBorins MylesBorins mentioned this pull request Oct 26, 2016
@Trott Trott deleted the http-timeout branch January 13, 2022 22:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
freebsd Issues and PRs related to the FreeBSD platform. http Issues or PRs related to the http subsystem. test Issues and PRs related to the tests.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Investigate flaky test-http-server-consumed-timeout on FreeBSD
3 participants