Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve failure accounting #14895

Closed
nickpalmer opened this issue Feb 3, 2021 · 2 comments
Closed

Improve failure accounting #14895

nickpalmer opened this issue Feb 3, 2021 · 2 comments

Comments

@nickpalmer
Copy link

nickpalmer commented Feb 3, 2021

What would you like?

If a "before" block fails cypress correctly cancels the tests associated with that before. However, it does not account for those failures properly. It shows a single failure in the dashboard and shows all the dependent tests as "pending" even though they were canceled.

Why is this needed?

It would be nice if the canceled tests showed as failures instead of being accounted as "pending". This could be by adding a "Canceled" bucket to indicate they were canceled, or adding them to failures, but they are clearly not "pending".

This is an example run, which is finished, and had a failure in a before block which caused a cancel of the 25 tests associated with the before block:

Screen Shot 2021-02-03 at 12 42 07 PM

@nickpalmer
Copy link
Author

Related to #3092

@jennifer-shehane
Copy link
Member

Duplicate of #3092

Please feel free to put your input in that issue which encompasses the 'skipping' of tests when hooks fail.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants