Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support OpenTSDB pre aggregated values #4341

Closed
seanlook opened this issue Jun 23, 2018 · 6 comments
Closed

Support OpenTSDB pre aggregated values #4341

seanlook opened this issue Jun 23, 2018 · 6 comments
Labels
area/opentsdb feature request Requests for new plugin and for new features to existing plugins

Comments

@seanlook
Copy link

Now aggregator plugin basicstats is more like downsampling across time for a single timeseries. But sometimes we need to pre-aggregate to group by some of tags within a specific time or a range time.

refer: http://opentsdb.net/docs/build/html/api_http/rollup.html

@glinton glinton added the feature request Requests for new plugin and for new features to existing plugins label Jun 28, 2018
@glinton
Copy link
Contributor

glinton commented Jun 28, 2018

Is your use case to dump the basicstats output to TSDB's /api/rollup, or are you saying you'd like to see the "rollup" behavior mimicked?

@seanlook
Copy link
Author

seanlook commented Jul 5, 2018

I mean data is rolled up in telegraf, and sent using normal /api/put. (OpenTSDB is not good at it, see rolled-up-pre-aggregates). Besides, many plugins do not use /api/rollup to save data

The ① is what basicstas does. The ② is what I mean:
tim 20180705115841

@danielnelson
Copy link
Contributor

If I'm understanding correctly, we need to keep more metadata about the created aggregates internally, somewhat similar to what was discussed in #3670, and then the opentsdb output could use the /api/rollup endpoint for sending the aggregate data.

@seanlook
Copy link
Author

seanlook commented Jul 7, 2018

No need to keep much data in telegraf internally. The dimension to aggregate is fields, not time.

/api/rollup endpoint do that aggregation in opentsdb inside, but for now, telegraf do not use this endpoint?

@danielnelson
Copy link
Contributor

Currently the opentsdb output uses only the /api/put endpoint.

@glinton
Copy link
Contributor

glinton commented Jul 17, 2018

@seanlook, does #4347 provide what you need?

@danielnelson danielnelson changed the title need an aggregator plugin to groupby tags Support OpenTSDB pre aggregated values Nov 12, 2018
@sspaink sspaink closed this as completed Nov 2, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/opentsdb feature request Requests for new plugin and for new features to existing plugins
Projects
None yet
Development

No branches or pull requests

5 participants