Cherry-pick to 7.12: [CI] Add resilience when installing required tooling (#24542) #24583

v1v · 2021-03-17T10:01:17Z

Backports the following commits to 7.12:

[CI] Add resilience when installing required tooling ([CI] Add resilience when installing required tooling #24542)

elasticmachine · 2021-03-17T10:14:33Z

💔 Tests Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Build Cause: v1v commented: /test
Start Time: 2021-03-18T08:45:27.571+0000
Duration: 56 min 39 sec
Commit: 1a81ef9

Test stats 🧪

Test	Results
Failed	1
Passed	46488
Skipped	4981
Total	51470

Trends 🧪

Test errors

Expand to view the tests failures

`Build&Test / metricbeat-goIntegTest / TestFetch – github.com/elastic/beats/v7/metricbeat/module/redis/info`

Expand to view the error details

 Failed

Expand to view the stacktrace

 === RUN   TestFetch
Found orphan containers (metricbeat_7_12_0_b6892bda95-snapshot_prometheus_1, metricbeat_7_12_0_b6892bda95-snapshot_postgresql_1, metricbeat_7_12_0_b6892bda95-snapshot_phpfpm_1, metricbeat_7_12_0_b6892bda95-snapshot_nginx_1, metricbeat_7_12_0_b6892bda95-snapshot_logstash_1, metricbeat_7_12_0_b6892bda95-snapshot_kafka_1) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up.
Creating metricbeat_7_12_0_b6892bda95-snapshot_redis_1 ... 
Creating metricbeat_7_12_0_b6892bda95-snapshot_redis_1 ... error

ERROR: for metricbeat_7_12_0_b6892bda95-snapshot_redis_1  Cannot create container for service redis: Conflict. The container name "/metricbeat_7_12_0_b6892bda95-snapshot_redis_1" is already in use by container "8f97330e33d2f4f0862e5b87b0fbdfd911a0a7aad87c5222985f40313d5f30d2". You have to remove (or rename) that container to be able to reuse that name.

ERROR: for redis  Cannot create container for service redis: Conflict. The container name "/metricbeat_7_12_0_b6892bda95-snapshot_redis_1" is already in use by container "8f97330e33d2f4f0862e5b87b0fbdfd911a0a7aad87c5222985f40313d5f30d2". You have to remove (or rename) that container to be able to reuse that name.
Encountered errors while bringing up the project.
    info_integration_test.go:33: failed to start service 'redis: exit status 1
Found orphan containers (metricbeat_7_12_0_b6892bda95-snapshot_prometheus_1, metricbeat_7_12_0_b6892bda95-snapshot_postgresql_1, metricbeat_7_12_0_b6892bda95-snapshot_phpfpm_1, metricbeat_7_12_0_b6892bda95-snapshot_nginx_1, metricbeat_7_12_0_b6892bda95-snapshot_logstash_1, metricbeat_7_12_0_b6892bda95-snapshot_kafka_1) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up.
Recreating 8f97330e33d2_metricbeat_7_12_0_b6892bda95-snapshot_redis_1 ... 
Recreating 8f97330e33d2_metricbeat_7_12_0_b6892bda95-snapshot_redis_1 ... error

ERROR: for 8f97330e33d2_metricbeat_7_12_0_b6892bda95-snapshot_redis_1  Cannot create container for service redis: Conflict. The container name "/metricbeat_7_12_0_b6892bda95-snapshot_redis_1" is already in use by container "831cc2db77bf893422732a4bacde74d09d679c961dd35efb101de2249e35ccdd". You have to remove (or rename) that container to be able to reuse that name.

ERROR: for redis  Cannot create container for service redis: Conflict. The container name "/metricbeat_7_12_0_b6892bda95-snapshot_redis_1" is already in use by container "831cc2db77bf893422732a4bacde74d09d679c961dd35efb101de2249e35ccdd". You have to remove (or rename) that container to be able to reuse that name.
Encountered errors while bringing up the project.
    info_integration_test.go:33: failed to start service 'redis: exit status 1
Found orphan containers (metricbeat_7_12_0_b6892bda95-snapshot_prometheus_1, metricbeat_7_12_0_b6892bda95-snapshot_postgresql_1, metricbeat_7_12_0_b6892bda95-snapshot_phpfpm_1, metricbeat_7_12_0_b6892bda95-snapshot_nginx_1, metricbeat_7_12_0_b6892bda95-snapshot_logstash_1, metricbeat_7_12_0_b6892bda95-snapshot_kafka_1) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up.
Recreating metricbeat_7_12_0_b6892bda95-snapshot_redis_1 ... 
Recreating metricbeat_7_12_0_b6892bda95-snapshot_redis_1 ... error

ERROR: for metricbeat_7_12_0_b6892bda95-snapshot_redis_1  Renaming a container with the same name as its current name

ERROR: for redis  Renaming a container with the same name as its current name
Encountered errors while bringing up the project.
    info_integration_test.go:33: failed to start service 'redis: exit status 1
    info_integration_test.go:33: getting host for redis
--- FAIL: TestFetch (10.22s)

Steps errors

Expand to view the steps failures

`metricbeat-goIntegTest - mage goIntegTest`

Took 26 min 36 sec . View more details on here
Description: mage goIntegTest

`Error signal`

Took 0 min 0 sec . View more details on here
Description: Error 'hudson.AbortException: script returned exit code 1'

Log output

Expand to view the last 100 lines of log output

[2021-03-18T09:39:22.149Z]  API version:       1.41
[2021-03-18T09:39:22.149Z]  Go version:        go1.13.15
[2021-03-18T09:39:22.149Z]  Git commit:        48d30b5
[2021-03-18T09:39:22.149Z]  Built:             Fri Jan 29 14:33:13 2021
[2021-03-18T09:39:22.149Z]  OS/Arch:           linux/amd64
[2021-03-18T09:39:22.149Z]  Context:           default
[2021-03-18T09:39:22.149Z]  Experimental:      true
[2021-03-18T09:39:22.149Z] 
[2021-03-18T09:39:22.149Z] Server: Docker Engine - Community
[2021-03-18T09:39:22.149Z]  Engine:
[2021-03-18T09:39:22.149Z]   Version:          20.10.3
[2021-03-18T09:39:22.149Z]   API version:      1.41 (minimum version 1.12)
[2021-03-18T09:39:22.149Z]   Go version:       go1.13.15
[2021-03-18T09:39:22.149Z]   Git commit:       46229ca
[2021-03-18T09:39:22.149Z]   Built:            Fri Jan 29 14:31:25 2021
[2021-03-18T09:39:22.149Z]   OS/Arch:          linux/amd64
[2021-03-18T09:39:22.149Z]   Experimental:     false
[2021-03-18T09:39:22.149Z]  containerd:
[2021-03-18T09:39:22.149Z]   Version:          1.4.4
[2021-03-18T09:39:22.149Z]   GitCommit:        05f951a3781f4f2c1911b05e61c160e9c30eaa8e
[2021-03-18T09:39:22.149Z]  runc:
[2021-03-18T09:39:22.149Z]   Version:          1.0.0-rc93
[2021-03-18T09:39:22.149Z]   GitCommit:        12644e614e25b05da6fd08a38ffa0cfe1903fdec
[2021-03-18T09:39:22.149Z]  docker-init:
[2021-03-18T09:39:22.149Z]   Version:          0.19.0
[2021-03-18T09:39:22.149Z]   GitCommit:        de40ad0
[2021-03-18T09:39:22.149Z] Change ownership of all files inside the specific folder from root/root to current user/group
[2021-03-18T09:39:22.149Z] Unable to find image 'alpine:3.4' locally
[2021-03-18T09:39:22.719Z] 3.4: Pulling from library/alpine
[2021-03-18T09:39:22.979Z] c1e54eec4b57: Pulling fs layer
[2021-03-18T09:39:23.238Z] c1e54eec4b57: Verifying Checksum
[2021-03-18T09:39:23.238Z] c1e54eec4b57: Download complete
[2021-03-18T09:39:23.238Z] c1e54eec4b57: Pull complete
[2021-03-18T09:39:23.238Z] Digest: sha256:b733d4a32c4da6a00a84df2ca32791bb03df95400243648d8c539e7b4cce329c
[2021-03-18T09:39:23.238Z] Status: Downloaded newer image for alpine:3.4
[2021-03-18T09:39:25.150Z] Change permissions with write access of all files inside the specific folder
[2021-03-18T09:39:26.559Z] Running in /var/lib/jenkins/workspace/PR-24583-2-f55336ea-1002-48d4-b511-a99b6f457257/src/github.com/elastic/beats/build
[2021-03-18T09:39:26.862Z] + rm -rf ve
[2021-03-18T09:39:26.862Z] + find . -type d -name vendor -exec rm -r {} ;
[2021-03-18T09:39:27.188Z] + python .ci/scripts/pre_archive_test.py
[2021-03-18T09:39:42.114Z] Copy ./x-pack/metricbeat/build into build/x-pack/metricbeat/build
[2021-03-18T09:39:42.114Z] Copy ./x-pack/metricbeat/build/golang-crossbuild into build/x-pack/metricbeat/build/golang-crossbuild
[2021-03-18T09:39:42.114Z] Copy ./x-pack/metricbeat/build/package/metricbeat/metricbeat-linux-amd64.docker/docker-build into build/x-pack/metricbeat/build/package/metricbeat/metricbeat-linux-amd64.docker/docker-build
[2021-03-18T09:39:42.114Z] Copy ./x-pack/metricbeat/build/package/metricbeat-ubi8/metricbeat-linux-amd64.docker/docker-build into build/x-pack/metricbeat/build/package/metricbeat-ubi8/metricbeat-linux-amd64.docker/docker-build
[2021-03-18T09:39:42.115Z] Copy ./x-pack/elastic-agent/build into build/x-pack/elastic-agent/build
[2021-03-18T09:39:42.115Z] Copy ./x-pack/elastic-agent/build/golang-crossbuild into build/x-pack/elastic-agent/build/golang-crossbuild
[2021-03-18T09:39:42.115Z] Copy ./x-pack/elastic-agent/build/package/elastic-agent/elastic-agent-linux-amd64.docker/docker-build into build/x-pack/elastic-agent/build/package/elastic-agent/elastic-agent-linux-amd64.docker/docker-build
[2021-03-18T09:39:42.115Z] Copy ./x-pack/elastic-agent/build/package/elastic-agent-ubi8/elastic-agent-linux-amd64.docker/docker-build into build/x-pack/elastic-agent/build/package/elastic-agent-ubi8/elastic-agent-linux-amd64.docker/docker-build
[2021-03-18T09:39:42.115Z] Copy ./x-pack/heartbeat/build into build/x-pack/heartbeat/build
[2021-03-18T09:39:42.115Z] Copy ./x-pack/heartbeat/build/golang-crossbuild into build/x-pack/heartbeat/build/golang-crossbuild
[2021-03-18T09:39:42.115Z] Copy ./x-pack/filebeat/build into build/x-pack/filebeat/build
[2021-03-18T09:39:42.115Z] Copy ./x-pack/filebeat/build/golang-crossbuild into build/x-pack/filebeat/build/golang-crossbuild
[2021-03-18T09:39:42.115Z] Copy ./x-pack/filebeat/build/package/filebeat-ubi8/filebeat-linux-amd64.docker/docker-build into build/x-pack/filebeat/build/package/filebeat-ubi8/filebeat-linux-amd64.docker/docker-build
[2021-03-18T09:39:42.115Z] Copy ./x-pack/filebeat/build/package/filebeat/filebeat-linux-amd64.docker/docker-build into build/x-pack/filebeat/build/package/filebeat/filebeat-linux-amd64.docker/docker-build
[2021-03-18T09:39:42.132Z] Running in /var/lib/jenkins/workspace/PR-24583-2-f55336ea-1002-48d4-b511-a99b6f457257/src/github.com/elastic/beats/build
[2021-03-18T09:39:42.154Z] Recording test results
[2021-03-18T09:39:44.909Z] None of the test reports contained any result
[2021-03-18T09:39:44.919Z] [Checks API] No suitable checks publisher found.
[2021-03-18T09:39:45.303Z] + go clean -modcache
[2021-03-18T09:39:49.891Z] Cleaning up /var/lib/jenkins/workspace/PR-24583-2-f55336ea-1002-48d4-b511-a99b6f457257
[2021-03-18T09:39:49.892Z] Client: Docker Engine - Community
[2021-03-18T09:39:49.892Z]  Version:           20.10.3
[2021-03-18T09:39:49.892Z]  API version:       1.41
[2021-03-18T09:39:49.892Z]  Go version:        go1.13.15
[2021-03-18T09:39:49.892Z]  Git commit:        48d30b5
[2021-03-18T09:39:49.892Z]  Built:             Fri Jan 29 14:33:13 2021
[2021-03-18T09:39:49.892Z]  OS/Arch:           linux/amd64
[2021-03-18T09:39:49.892Z]  Context:           default
[2021-03-18T09:39:49.892Z]  Experimental:      true
[2021-03-18T09:39:49.892Z] 
[2021-03-18T09:39:49.892Z] Server: Docker Engine - Community
[2021-03-18T09:39:49.892Z]  Engine:
[2021-03-18T09:39:49.892Z]   Version:          20.10.3
[2021-03-18T09:39:49.892Z]   API version:      1.41 (minimum version 1.12)
[2021-03-18T09:39:49.892Z]   Go version:       go1.13.15
[2021-03-18T09:39:49.892Z]   Git commit:       46229ca
[2021-03-18T09:39:49.892Z]   Built:            Fri Jan 29 14:31:25 2021
[2021-03-18T09:39:49.892Z]   OS/Arch:          linux/amd64
[2021-03-18T09:39:49.892Z]   Experimental:     false
[2021-03-18T09:39:49.892Z]  containerd:
[2021-03-18T09:39:49.892Z]   Version:          1.4.4
[2021-03-18T09:39:49.892Z]   GitCommit:        05f951a3781f4f2c1911b05e61c160e9c30eaa8e
[2021-03-18T09:39:49.892Z]  runc:
[2021-03-18T09:39:49.892Z]   Version:          1.0.0-rc93
[2021-03-18T09:39:49.892Z]   GitCommit:        12644e614e25b05da6fd08a38ffa0cfe1903fdec
[2021-03-18T09:39:49.892Z]  docker-init:
[2021-03-18T09:39:49.892Z]   Version:          0.19.0
[2021-03-18T09:39:49.892Z]   GitCommit:        de40ad0
[2021-03-18T09:39:49.892Z] Change ownership of all files inside the specific folder from root/root to current user/group
[2021-03-18T09:40:57.607Z] Change permissions with write access of all files inside the specific folder
[2021-03-18T09:40:57.638Z] Running in /var/lib/jenkins/workspace/PR-24583-2-f55336ea-1002-48d4-b511-a99b6f457257
[2021-03-18T09:41:04.149Z] Stage "Packaging" skipped due to earlier failure(s)
[2021-03-18T09:41:04.235Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-24583/src/github.com/elastic/beats
[2021-03-18T09:41:05.349Z] Running on worker-1244230 in /var/lib/jenkins/workspace/Beats_beats_PR-24583
[2021-03-18T09:41:05.416Z] [INFO] getVaultSecret: Getting secrets
[2021-03-18T09:41:05.558Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-03-18T09:41:07.750Z] + chmod 755 generate-build-data.sh
[2021-03-18T09:41:07.750Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-24583/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-24583/runs/2 FAILURE 3338716
[2021-03-18T09:41:07.750Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-24583/runs/2/steps/?limit=10000 -o steps-info.json
[2021-03-18T09:41:15.446Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-24583/runs/2/tests/?status=FAILED -o tests-errors.json

🐛 Flaky test report

❕ There are test failures but not known flaky tests.

Expand to view the summary

Test stats 🧪

Test	Results
Failed	1
Passed	46488
Skipped	4981
Total	51470

v1v · 2021-03-18T08:45:05Z

/test

…lastic#24583)

[CI] Add resilience when installing required tooling (elastic#24542)

1a81ef9

v1v self-assigned this Mar 17, 2021

botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Mar 17, 2021

v1v added automation backport ci skip-ci Skip the build in the CI but linting Team:Automation Label for the Observability productivity team labels Mar 17, 2021

botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Mar 17, 2021

v1v removed the skip-ci Skip the build in the CI but linting label Mar 18, 2021

v1v merged commit 988179f into elastic:7.12 Mar 18, 2021

v1v deleted the backport/7.12/pr-24542 branch March 18, 2021 14:53

leweafan pushed a commit to leweafan/beats that referenced this pull request Apr 28, 2023

[CI] Add resilience when installing required tooling (elastic#24542) (e…

ff14bb8

…lastic#24583)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Cherry-pick to 7.12: [CI] Add resilience when installing required tooling (#24542) #24583

Cherry-pick to 7.12: [CI] Add resilience when installing required tooling (#24542) #24583

v1v commented Mar 17, 2021

elasticmachine commented Mar 17, 2021 •

edited by jenkins-beats-ci bot

Loading

Build stats

Test stats 🧪

Trends 🧪

`Build&Test / metricbeat-goIntegTest / TestFetch – github.com/elastic/beats/v7/metricbeat/module/redis/info`

`metricbeat-goIntegTest - mage goIntegTest`

`Error signal`

Test stats 🧪

v1v commented Mar 18, 2021

Cherry-pick to 7.12: [CI] Add resilience when installing required tooling (#24542) #24583

Cherry-pick to 7.12: [CI] Add resilience when installing required tooling (#24542) #24583

Conversation

v1v commented Mar 17, 2021

elasticmachine commented Mar 17, 2021 • edited by jenkins-beats-ci bot Loading

💔 Tests Failed

Build stats

Test stats 🧪

Trends 🧪

Test errors

Build&Test / metricbeat-goIntegTest / TestFetch – github.com/elastic/beats/v7/metricbeat/module/redis/info

Steps errors

metricbeat-goIntegTest - mage goIntegTest

Error signal

Log output

🐛 Flaky test report

Test stats 🧪

v1v commented Mar 18, 2021

elasticmachine commented Mar 17, 2021 •

edited by jenkins-beats-ci bot

Loading

`Build&Test / metricbeat-goIntegTest / TestFetch – github.com/elastic/beats/v7/metricbeat/module/redis/info`

`metricbeat-goIntegTest - mage goIntegTest`

`Error signal`