Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add dry run feature #754

Closed
Narcalen opened this issue Jul 4, 2022 · 8 comments
Closed

Add dry run feature #754

Narcalen opened this issue Jul 4, 2022 · 8 comments

Comments

@Narcalen
Copy link

Narcalen commented Jul 4, 2022

Would be nice to have dry run feature similar to cucumber-js (doc)

@badeball
Copy link
Owner

badeball commented Jul 5, 2022

Hi, @Narcalen, I like the idea. Which use-cases specifically are you looking to see solved with this?

@Narcalen
Copy link
Author

Narcalen commented Jul 5, 2022

Hi @badeball,
I would like to set up PR checks for our automated test framework to make sure that all steps in feature files are implemented, otherwise fail the build. Dry run should be faster than running the tests.

@badeball
Copy link
Owner

badeball commented Sep 17, 2022

I've introduced a diagnostics utility with v13.0.0, read more about it in docs/diagnostics.md. Please try it out and provide feedback.

NB: This is as experimental as it gets.

@Narcalen
Copy link
Author

The feature is working as expected, thanks!
its performance is suboptimal though: for a set of 58 feature files, dry run executes for 80 minutes, and if diagnostics utility is applied for each feature file in loop, it takes 3 minutes to complete the dry run.

@badeball
Copy link
Owner

Ouf. I tried it on a relatively medium project of mine own, but apparently didn't encounter such terrible performance. I'm guessing I've implemented something with O(n^2) runtime or similar.

@badeball
Copy link
Owner

Eh, it turns out that cli-table3 is actually the culprit, ref. cli-table/cli-table3#68....

@badeball
Copy link
Owner

I've released v13.0.3 which contains some improvements, including replacing cli-table3. Please try it out.

@Narcalen
Copy link
Author

Ran diagnostics in v13.0.3, performance is good now:
real 0m6.291s
user 0m12.305s
sys 0m1.446s

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants