-
-
Notifications
You must be signed in to change notification settings - Fork 91
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix: Improve AzureMonitorScraper Error Handling for Time Series Missing Requested Dimension Value #2345
fix: Improve AzureMonitorScraper Error Handling for Time Series Missing Requested Dimension Value #2345
Conversation
Thank you for your contribution! 🙏 We will review it as soon as possible. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Added a few comments, would you mind updating the changelog please?
Thanks for the review! Besides everything that's already talked about, I'd also like to know where I should put tests. I couldn't really find unit tests for AzureMonitorScraper/Client |
Because unfortunately we don't have any given the tight integration and mocking everything is too much work/brittle |
Please make sure to sign the CLA |
Ah okay, I think I signed it with my personal account, but committed with my company's account. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just two more questions - Sorry :)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, thanks!
We're good to go! Would you mind checking the merge conflict + code factor flag please? |
Hey Tom, looks like the code is conflict-free now. Although build is failing on a single failing integration test. The exception looks like something transient unrelated to my changes?
Would you mind re-running the pipeline again? I don't think I have the privileges |
/azp run Promitor CI - Scraper Agent |
No commit pushedDate could be found for PR 2345 in repo tomkerkhove/promitor |
/azp run Promitor CI - Scraper Agent |
No commit pushedDate could be found for PR 2345 in repo tomkerkhove/promitor |
Thanks for responding in your evening Tom :) My most recent commit should have fixed warnings reported by R#(they were indeed real problems) |
Happy to help a contributor out :) Thanks! |
Hey Tom, just letting you know that this has not been forgotten :) I was just a bit swamped these past few days. I'll look into how to run R# locally and also that one failing integration test when I get a chance. Wrt to that test - seems like it timed out for whatever reason. I have to look at exactly what the code is myself to see if it's related to my changes. You have way more context though, so maybe you could share some potential insights? |
Hey Tom, it's ready for another look. I see that there was a recent feature added to master that supported scraping multiple dimensions. You might wanna have a second look at if I merged correctly(I think I did). Thanks! |
/azp run Promitor CI - Scraper Agent |
Azure Pipelines successfully started running 1 pipeline(s). |
1 similar comment
Azure Pipelines successfully started running 1 pipeline(s). |
We should be good - Thanks! |
Thank you! |
Fixes #2331
At Axon, we observed that Azure Monitor may, from time to time, return time series without the requested dimension. The previous try catch logic is at the metric level, ensuring that failure to scrape one metric will not affect all metrics; however, there are many time series within a metric, and failure to process one time series will result in a metric gap for that metric. I am adding a try-catch when looping over time series to prevent that from happening.
I am very new to this repo though, and couldn't find my way around how to write tests for this. Some help would be much appreciated.