Research and Fix failures of Windows FIM tests with "scheduled" mode on Jenkins.

[damarisg]

Description

It consists of investigating and resolving issues when the scheduled mode is enabled for Windows executions in FIM integration tests.
We must ensure that it not only works locally but also in Jenkins.

This problem was found in 4.2 and continues in future releases.

[Deblintrake09]

Update 15/12/21 - 17/12/2021

• Research on possible ways to detect if tests where being run on Jenkins
• Talked to CICD automation team for info on Jenkins
• Researched the API that is exposed on Jenkins instances.
• Using the API meant a call to the API on each test
• Talked to Jhonathan on what would be a best to apply
• Decided to generate a pytest parameter that could be automatically passed on Jenkins to skip scheduled tests
• Developed parameter --skip_scan_tests and fixture skip_scheduled_windows_jenkins to mark tests to be skipped.
• Applied fixture on local repo and tested each test after applying fixture.

Update 20/12/2021 - 23/12/2021

• After Meet with Pedro talked about approach.
• Changed to a config file that will include flags. This file will be added on Jenkins, and confest should read it. Then we can apply changes or skips according to the flags on the config file.
• Generated cloud_config.yaml file and modified fixture to work with new method.
• Tested on Jenkins on Linux Agent 🟢 Manager 🟢 and Windows Agent 🔴
• Had Local Failures on Windows when running full fim suite.
• Try to find cause for failures since fim was 🟢 on master.

Version	Type	Modes	Results	Date	By	Notes
4.3.0-master17	Linux Agent - Jenkins	Scheduled +whodata +realtime	🟢	2021/12/23	@Deblintrake09	added config_cloud.yaml on the VM to test fix does not affect linux
4.3.0-master17	Linux Agent - Jenkins	Scheduled +whodata +realtime	🟢	2021/12/23	@Deblintrake09	added config_cloud.yaml on the VM to test fix does not affect linux
4.3.0-master17	Linux Agent - Jenkins	Scheduled +whodata +realtime	🟢	2021/12/23	@Deblintrake09	added config_cloud.yaml on the VM to test fix does not affect linux
4.3.0-master17	Manager - Jenkins	Scheduled +whodata +realtime	🟢	2021/12/23	@Deblintrake09	added config_cloud.yaml on the VM to test fix does not affect linux
4.3.0-master17	Manager - Jenkins	Scheduled +whodata +realtime	🟢	2021/12/23	@Deblintrake09	added config_cloud.yaml on the VM to test fix does not affect linux
4.3.0-master17	Manager - Jenkins	Scheduled +whodata +realtime	🟢	2021/12/23	@Deblintrake09	added config_cloud.yaml on the VM to test fix does not affect linux
4.3.0-master17	Windows - Jenkins	Scheduled +whodata +realtime	🔴	2021/12/23	@Deblintrake09
4.3.0-master17	Windows - Jenkins	whodata +realtime	🔴	2021/12/23	@Deblintrake09	Jenkins Failure

Update 27/12/21 - 29/12/2021

• Tried to launch on Solaris and Macos - both pipelines are failing at the moment. asked CICD team
• Launching local tests to debug windows Jenkins fails.
• Analizing local Windows fails.
• Asked for help to Core FIM team to analyze why tests fail on windows, while they are passing on Linux.
• Opened Jenkins Issue # 3147 to add cloud_config.yaml file on VMs to complete windows testing.
• Launched Master on Local with and without scheduled - Fails on 3 different VMs 🔴
• Moved to blocked until Issue Manual testing - Fix CPE Helper to find vulnerabilities in unversioned packages #3147 is resolved and we further analyze the fails.

Version	Type	Modes	Results	Date	By	Notes
4.3.0-master17	Macos - Jenkins	scheduled + whodata +realtime	🔴	2021/12/27	@Deblintrake09	Without adding cloud_config.yaml to VM
4.3.0-master17	Macos - Jenkins	scheduled + whodata +realtime	🔴	2021/12/27	@Deblintrake09	Added cloud_config.yaml to VM
4.3.0-master17	Windows - Jenkins	whodata +realtime	🟢	2021/12/28	@Deblintrake09

Testing Master to check Fails

Version	Type	Modes	Results	Date	By	Notes
4.3.0-master17	Windows - Jenkins	whodata +realtime	🟢	2021/12/28	@Deblintrake09
4.3.0-master17	Windows - Local	scheduled + whodata +realtime	🔴	2021/12/28	@Deblintrake09	Local test
4.3.0-master17	Windows - Local	whodata +realtime	🔴	2021/12/28	@Deblintrake09	Local test
4.3.0-master17	Windows - Local	scheduled + whodata +realtime	🔴	2021/12/28	@Deblintrake09	Local test

[Deblintrake09]

• Work for this Issue has been done on branch 2305-fim-cloud-windows-skip
• PR has not been generated because this issue is blocked by errors found that are being treated on Issue #2141
• Opened wazuh-jenkins Issue #3147 needed for adding could_config.yaml file to VMs.

[damarisg]

We decided to close them as it was not planned.