Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release 4.8.0 - Beta 1 - Wazuh UI regression testing #6386

Closed
1 task done
lucianogorza opened this issue Feb 6, 2024 · 3 comments
Closed
1 task done

Release 4.8.0 - Beta 1 - Wazuh UI regression testing #6386

lucianogorza opened this issue Feb 6, 2024 · 3 comments
Assignees
Labels
level/task Task issue type/test Test issue

Comments

@lucianogorza
Copy link
Contributor

lucianogorza commented Feb 6, 2024

The following issue aims to run manual tests for the current release candidate, report the results, and open new issues for any encountered errors.

Wazuh UI tests information

Main release candidate issue wazuh/wazuh#21774
Version 4.8.0
Release candidate # Beta 1
Tag v4.8.0-2.10.0-beta1
Previous UI regression tests issue #6307

Test report procedure

TL;DR

  1. The specified tests will be executed in every platform and version mentioned in this issue.
  2. Include evidence of each test performed.
  3. Report any problem or bug. Open a new issue for each of them and link them here.
  4. Justify skipped tests.

All test results must have one the following statuses:

Doesn't apply
The test hasn't started yet.
🟢 All checks passed.
🔴 There is at least one failed check.
🟡 There is at least one expected fail or skipped test and no failures.

Any failing test must be properly addressed with a new issue, detailing the error and the possible cause.
It must be included in the Problems section of the current release candidate issue.

Any expected fail or skipped test must be justified with a reason.
All auditors must validate the justification for an expected fail or skipped test.

An extended report of the test results must be attached as a zip, txt or images.
This report can be used by the auditors to dig deeper into any possible failures and details.

Test template

Test Chrome Firefox Safari
-

Test plan

  1. Verify the app package installs and operates as expected.
  2. Failure of script during Mac OS Agent deployment
  3. Incorrect abbreviation for Fully Qualified Domain Name
  4. The Server address field in the Deploy new agent section does not accept hostnames as indicated in the documentation
  5. MITRE ATT&CK dashboard cutout graphs
  6. Disable the discover legacy callout warning by default
  7. The vulnerability detector event filter can sometimes be removed, displaying confusing information
  8. Disable by default the vulnerabilities health-check
  9. Maximized visualizations don't display properly in vulnerabilities dashboard
  10. Vulnerabilities inventory tab table doesn't maximize properly
  11. Remove scroll from vulnerabilities inventory table
  12. Vulnerability detail truncated text in big fields
  13. Server stat "Archives queue usage" is picking the wrong value
  14. Statistics error when cluster mode is disabled
  15. Remove WAZUH_REGISTRATION_SERVER from Windows deploy cmd
  16. Wazuh's favicon does not appear in safari
  17. Add agent name and id in vulnerability inventory as a default field
  18. Refactor "run as" render in server APIs
  19. Refactor top N tables in vulnerabilities dashboard
  20. Split index/dashboard management menu
  21. Add tooltip to most active agent label
  22. Add pinned agent to vulnerability section
  23. Remove IT hygiene section
  24. Remove compilation date from dashboard
  25. Refactor the home section top kpi
  26. Remove duplicated links from help menu
  27. Change API configuration title
  28. Support new vulnerability configuration block

Test

Test Chrome Firefox Safari
Verify the app package installs and operates as expected 🟢 🟢
Failure of script during Mac OS Agent deployment 🟢 🟢
Incorrect abbreviation for Fully Qualified Domain Name 🟢 🟢
The Server address field in the Deploy new agent section does not accept hostnames as indicated in the documentation 🟢 🟢
MITRE ATT&CK dashboard cutout graphs 🟢 🟢
Disable the discover legacy callout warning by default 🟢 🟢
The vulnerability detector event filter can sometimes be removed, displaying confusing information 🟢 🟢
Disable by default the vulnerabilities health-check 🟢 🟢
Maximized visualizations don't display properly in vulnerabilities dashboard 🟢 🟢
Vulnerabilities inventory tab table doesn't maximize properly 🟢 🟢
Remove scroll from vulnerabilities inventory table 🟢 🟢
Vulnerability detail truncated text in big fields 🟢 🟢
Server stat "Archives queue usage" is picking the wrong value 🟢 🟢
Statistics error when cluster mode is disabled 🟢 🟢
Remove WAZUH_REGISTRATION_SERVER from Windows deploy cmd 🟢 🟢
Wazuh's favicon does not appear in safari 🟢 🟢 🟢
Add agent name and id in vulnerability inventory as a default field 🟢 🟢
Refactor "run as" render in server APIs 🟢 🟢
Refactor top N tables in vulnerabilities dashboard 🟢 🟢
Split index/dashboard management menu 🔴 🔴
Add tooltip to most active agent label 🟢 🟢
Add pinned agent to vulnerability section 🟢 🟢
Remove IT hygiene section 🟢 🟢
Remove compilation date from dashboard 🟢 🟢
Refactor the home section top kpi 🟢 🟢
Remove duplicated links from help menu 🟢 🟢
Change API configuration title 🟢 🟢
Support new vulnerability configuration block 🟢 🟢

Conclusions

All tests have been executed and the results can be seen above.
We found that the issue Split index/dashboard management menu is not implemented in the app because this Pull Request was merged after this Tag was created.
We only tested in Safari the issue Wazuh's favicon does not appear in safari because we needed a third-party device to do it.

Auditors validation

The definition of done for this one is the validation of the conclusions and the test results from all auditors.

All checks from below must be accepted to close this issue.

@lucianogorza
Copy link
Contributor Author

lucianogorza commented Feb 7, 2024

Test

Test Chrome Firefox Safari
Verify the app package installs and operates as expected 🟢 🟢
Failure of script during Mac OS Agent deployment 🟢 🟢
Incorrect abbreviation for Fully Qualified Domain Name 🟢 🟢
The Server address field in the Deploy new agent section does not accept hostnames as indicated in the documentation 🟢 🟢
MITRE ATT&CK dashboard cutout graphs 🟢 🟢
Disable the discover legacy callout warning by default 🟢 🟢
The vulnerability detector event filter can sometimes be removed, displaying confusing information 🟢 🟢
Disable by default the vulnerabilities health-check 🟢 🟢
Maximized visualizations don't display properly in vulnerabilities dashboard 🟢 🟢
Vulnerabilities inventory tab table doesn't maximize properly 🟢 🟢
Remove scroll from vulnerabilities inventory table 🟢 🟢
Vulnerability detail truncated text in big fields 🟢 🟢
Server stat "Archives queue usage" is picking the wrong value 🟢 🟢
Statistics error when cluster mode is disabled 🟢 🟢
Remove WAZUH_REGISTRATION_SERVER from Windows deploy cmd 🟢 🟢
Wazuh's favicon does not appear in safari 🟢 🟢 🟢
Add agent name and id in vulnerability inventory as a default field 🟢 🟢
Refactor "run as" render in server APIs 🟢 🟢
Refactor top N tables in vulnerabilities dashboard 🟢 🟢
Split index/dashboard management menu 🔴 🔴
Add tooltip to most active agent label 🟢 🟢
Add pinned agent to vulnerability section 🟢 🟢
Remove IT hygiene section 🟢 🟢
Remove compilation date from dashboard 🟢 🟢
Refactor the home section top kpi 🟢 🟢
Remove duplicated links from help menu 🟢 🟢
Change API configuration title 🟢 🟢
Support new vulnerability configuration block 🟢 🟢

Verify the app package installs and operates as expected.

🟢 Chrome

image

image

🟢 Firefox

image

image

Failure of script during Mac OS Agent deployment

🟢 Chrome

image

image

🟢 Firefox

image

image

Incorrect abbreviation for Fully Qualified Domain Name

🟢 Chrome

image

🟢 Firefox

image

The Server address field in the Deploy new agent section does not accept hostnames as indicated in the documentation

🟢 Chrome

image
image
image
image
image
image
image

🟢 Firefox

image
image
image
image
image
image
image

MITRE ATT&CK dashboard cutout graphs

🟢 Chrome

image

🟢 Firefox

image

Disable the discover legacy callout warning by default

🟢 Chrome

image

🟢 Firefox

image

The vulnerability detector event filter can sometimes be removed, displaying confusing information

🟢 Chrome
vd.-.filters.-.chrome.webm
vn.-.ma.-.chrome.webm
🟢 Firefox
vd.-.filters.-.firefox.webm

Disable by default the vulnerabilities health-check

🟢 Chrome

image

🟢 Firefox

image

Maximized visualizations don't display properly in vulnerabilities dashboard

🟢 Chrome

image

image

image

image

image

image

🟢 Firefox

image

image

image

image

image

image

Vulnerabilities inventory tab table doesn't maximize properly

🟢 Chrome

image

image

🟢 Firefox

image

image

Remove scroll from vulnerabilities inventory table

🟢 Chrome
vd.-.inventory.scroll.-.chrome.webm
🟢 Firefox

image

image

image

Vulnerability detail truncated text in big fields

🟢 Chrome

image

🟢 Firefox

image

Server stat "Archives queue usage" is picking the wrong value

🟢 Chrome

image

🟢 Firefox

image

Statistics error when cluster mode is disabled

🟢 Chrome

Cluster mode disabled

image

image

image

image

image

image

Cluster mode enabled

image

🟢 Firefox

Cluster mode disabled

image

image

image

image

image

image

Cluster mode enabled

image

Remove WAZUH_REGISTRATION_SERVER from Windows deploy cmd

🟢 Chrome

image

🟢 Firefox

image

Wazuh's favicon does not appear in Safari

🟢 Chrome

image

🟢 Firefox

image

🟢 Safari

mac logo

Add agent name and id in vulnerability inventory as a default field

🟢 Chrome

image

🟢 Firefox

image

Refactor "run as" render in server APIs

🟢 Chrome

image

🟢 Firefox

image

Refactor top N tables in vulnerabilities dashboard

🟢 Chrome

Windows width: 1920px

image

Windows width: 1440px

image

Windows width: 1024px

image

Windows width: 767px

image

🟢 Firefox

Windows width: 1920px

image

Windows width: 1440px

image

Windows width: 1024px

image

Windows width: 767px

image

Split index/dashboard management menu

Dashboard Management option must be in Dashboard management menu.
An issue was not created because the PR was merged after the Tag was created.

🔴 Chrome

image

🔴 Firefox

image

Add tooltip to most active agent label

🟢 Chrome

image

🟢 Firefox

image

Add pinned agent to vulnerability section

🟢 Chrome

image

image

image

image

image

🟢 Firefox

image

image

image

image

image

Remove IT hygiene section

🟢 Chrome

image

image

🟢 Firefox

image

image

Remove compilation date from dashboard

🟢 Chrome

image

🟢 Firefox

image

Refactor the home section top kpi

🟢 Chrome

image

image

🟢 Firefox

image

image

Remove duplicated links from help menu

🟢 Chrome

image

🟢 Firefox

image

Change API configuration title

🟢 Chrome

image

🟢 Firefox

image

Support new vulnerability configuration block

🟢 Chrome

image

image

image

🟢 Firefox

image

image

image

@asteriscos
Copy link
Member

LGTM 🟢

@davidjiglesias
Copy link
Member

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
level/task Task issue type/test Test issue
Projects
No open projects
Status: Done
Development

No branches or pull requests

3 participants