Cherry-pick #22793 to 7.x: [Ingest Management] Agent expose metrics #23105
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* [Ingest Manager] Log level reloadable from fleet (elastic#22690) [Ingest Manager] Log level reloadable from fleet (elastic#22690) * aa * create drop * updated drop * process contains everything * drop start time * undo exposed endpoint * sanitize dataset name * ups * agent expose http * collect all metrics from beats * colelct all from beats * golint * cleaner docs * updated structure * cgroup * long live file saving issues (cherry picked from commit 49c8d87)
botelastic
bot
added
the
needs_team
|
Pinging @elastic/ingest-management (Team:Ingest Management) |
botelastic
bot
removed
the
needs_team
|
This PR contains #23106 for the changelog. |
❕ Build Aborted
Expand to view the summary
Build stats
Test stats 🧪
Steps errors
Expand to view the steps failures
|
ph
approved these changes
Dec 14, 2020
|
@v1v Have you ever see that? |
|
Yep, that's related to the cloud testing that was enabled by default, so it seems there is a bottleneck in the number of resources. @jsoriano pointed that the cloud testing was on demand rather by default, but when moving to the monorepo jenkinsfile.yml approach I enabled the cloud testing by default, not sure what's the best strategy here |
Maybe we should disable them?
This is worrying, could it be that db instances are not being properly destroyed? |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Cherry-pick of PR #22793 to 7.x branch. Original message:
What does this PR do?
Using system package focused on agent process we are collecting CPU,disk and memory metrics which are sent to ds.elastic_agent-elastic-agent
At first i was playing with exposing endpoint and using
beatmodule to collect some information about agent but i let it go as most of information collected using this module is not relevant expect for go-routines and it makes code bloated with unnecessary setups providing empty values for fields which are noncollectable/unreportable from agent point of view.Why is it important?
#22394
Checklist
CHANGELOG.next.asciidocorCHANGELOG-developer.next.asciidoc.Example of final doc
linux
{ "_index": ".ds-metrics-elastic_agent.elastic_agent-default-000001", "_id": "1d6qYHYBIHKyMD4EYWSe", "_version": 1, "_score": null, "_source": { "@timestamp": "2020-12-14T09:52:26.506Z", "ecs": { "version": "1.7.0" }, "metricset": { "period": 10000, "name": "json" }, "service": { "address": "http://unix/stats", "type": "http" }, "elastic_agent": { "snapshot": false, "version": "8.0.0", "id": "76069e50-3df1-11eb-a870-73a635b35320", "process": "elastic-agent" }, "agent": { "version": "8.0.0", "ephemeral_id": "2198b42f-be51-45f9-acfe-0c3e47021d64", "id": "5ce18284-c42b-46a4-9149-5df70be787a6", "name": "vagrant", "type": "metricbeat" }, "event": { "dataset": "elastic_agent.elastic_agent", "module": "http", "duration": 9794045 }, "host": { "architecture": "x86_64", "os": { "platform": "ubuntu", "version": "16.04.1 LTS (Xenial Xerus)", "family": "debian", "name": "Ubuntu", "kernel": "4.4.0-31-generic", "codename": "xenial" }, "name": "vagrant", "id": "c0cc2a7efa902a719ada8ab6584b6bcb", "containerized": false, "ip": [ "172.17.0.1", ], "mac": [ "08:00:27:08:27:32", ], "hostname": "vagrant" }, "data_stream": { "dataset": "elastic_agent.elastic_agent", "namespace": "default", "type": "metrics" }, "system": { "process": { "cpu": { "system": { "ticks": 1190, "time": { "ms": 1196 } }, "total": { "time": { "ms": 4464 }, "value": 4450, "ticks": 4450 }, "user": { "ticks": 3260, "time": { "ms": 3268 } } }, "memory": { "size": 73482496 }, "fd": { "limit": { "hard": 4096, "soft": 1024 }, "open": 21 }, "cgroup": { "cpu": { "id": "elastic-agent.service", "stats": { "throttled": { "ns": 0, "periods": 0 }, "periods": 0 }, "cfs": { "quota": { "us": 0 }, "period": { "us": 100000 } } }, "cpuacct": { "id": "elastic-agent.service", "total": { "ns": 13885517853 } }, "memory": { "id": "elastic-agent.service", "mem": { "usage": { "bytes": 428773376 }, "limit": { "bytes": 9223372036854772000 } } } } } } }, "fields": { "@timestamp": [ "2020-12-14T09:52:26.506Z" ] }, "sort": [ 1607939546506 ] }mac
{ "_index": ".ds-metrics-elastic_agent.elastic_agent-default-000001", "_id": "2QxlPHYBjGFDnaF_EkU-", "_version": 1, "_score": null, "_source": { "@timestamp": "2020-12-07T08:50:24.348Z", "event": { "dataset": "elastic_agent.elastic_agent", "module": "http", "duration": 3040126 }, "metricset": { "name": "json", "period": 10000 }, "system": { "process": { "cpu": { "system": { "ticks": 1745, "time": { "ms": 1745 } }, "total": { "ticks": 7291, "time": { "ms": 7291 }, "value": 7291 }, "user": { "time": { "ms": 5546 }, "ticks": 5546 } }, "memory": { "size": 74531072 } } }, "host": { "mac": [ "ac:de:48:ac:de:48" ], "name": "MacBook-Pro-2.local", "hostname": "MacBook-Pro-2.local", "architecture": "x86_64", "os": { "name": "Mac OS X", "kernel": "18.7.0", "build": "18G6032", "platform": "darwin", "version": "10.14.6", "family": "darwin" }, "id": "FC609F24-07E1-54EA-8E33-56F9D5A7A97E", "ip": [ "127.0.0.2" ] }, "agent": { "ephemeral_id": "0cf156d9-4398-4c29-a52d-596ec7a93f5f", "id": "e09c86a1-f5dd-4fe8-898c-70de832e2a9e", "name": "MacBook-Pro-2.local", "type": "metricbeat", "version": "8.0.0" }, "service": { "address": "http://unix/stats", "type": "http" }, "data_stream": { "dataset": "elastic_agent.elastic_agent", "namespace": "default", "type": "metrics" }, "elastic_agent": { "snapshot": false, "version": "8.0.0", "id": "02e6478a-72b9-4a5e-bd63-0f6be2ef4dba", "process": "elastic-agent" }, "ecs": { "version": "1.6.0" } }, "fields": { "@timestamp": [ "2020-12-07T08:50:24.348Z" ] }, "sort": [ 1607331024348 ] }