Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[aws] missing metrics when include_linked_accounts set to false #40071

Closed
kaiyan-sheng opened this issue Jul 1, 2024 · 2 comments · Fixed by #40135
Closed

[aws] missing metrics when include_linked_accounts set to false #40071

kaiyan-sheng opened this issue Jul 1, 2024 · 2 comments · Fixed by #40135
Assignees
Labels
bug Team:obs-ds-hosted-services Label for the Observability Hosted Services team

Comments

@kaiyan-sheng
Copy link
Contributor

  • Version: v1.51.3 AWS integration with 8.8.2 agent
  • Operating System: agent running on linux EC2 instance
  • Steps to Reproduce:
  1. Create RDS instances in the same account and make sure there are metrics coming into CloudWatch:
Screenshot 2024-07-01 at 3 01 52 PM 2. Run agent and install AWS RDS integration with config `latency=10m` just to make sure metric collection does not get impacted by latency. Keep `include_linked_accounts = false` and here are the metrics you can see from Kibana: Screenshot 2024-07-01 at 2 18 32 PM We only see metrics from 2 RDS instances. 3. Change agent policy to `include_linked_accounts = true`, save the policy and here are the metrics you can see from Kibana: Screenshot 2024-07-01 at 2 41 47 PM We can see metrics from all 5 RDS instances.

These RDS instances are all from the same AWS account, cross account monitoring is not enabled either. include_linked_accounts should not affect the results.

@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Jul 1, 2024
@kaiyan-sheng kaiyan-sheng added the Team:obs-ds-hosted-services Label for the Observability Hosted Services team label Jul 1, 2024
@elasticmachine
Copy link
Collaborator

Pinging @elastic/obs-ds-hosted-services (Team:obs-ds-hosted-services)

@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Jul 1, 2024
@kaiyan-sheng
Copy link
Contributor Author

Test list-metrics API, which is the one uses include_linked_accounts config parameter:

aws cloudwatch list-metrics --namespace AWS/RDS --metric-name CPUUtilization --region eu-west-3 --profile elastic-observability --recently-active PT3H --include-linked-accounts --dimensions Name=DBClusterIdentifier

and

aws cloudwatch list-metrics --namespace AWS/RDS --metric-name CPUUtilization --region eu-west-3 --profile elastic-observability --recently-active PT3H --no-include-linked-accounts --dimensions Name=DBClusterIdentifier

returns the same result.

Will test with metricbeat directly next.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Team:obs-ds-hosted-services Label for the Observability Hosted Services team
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants