-
Notifications
You must be signed in to change notification settings - Fork 5.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Rate limit multiple batch sends #14802
Labels
feature request
Requests for new plugin and for new features to existing plugins
Comments
powersj
added
the
feature request
Requests for new plugin and for new features to existing plugins
label
Feb 13, 2024
next steps: look into this |
srebhan
changed the title
Rate limit multiple batche sends
Rate limit multiple batch sends
May 16, 2024
1 task
1 task
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Use Case
In the case or scenario where an output goes down for a little bit, the buffer will accumulate metrics. Once connectivity is restored to the output, then the output could get hit essentially a mini-DOS of batches from telegraf. Telegraf will send multiple batches immediately, rather than gently sending them.
Expected behavior
Opt-in configuration option to allow turning rate limiting on.
Actual behavior
Lots of messages sent at once, for example from an old issue:
Additional info
Go includes a rate limiting package: https://pkg.go.dev/golang.org/x/time/rate that we could make use of in the flushLoop or in the flushBatch functions.
The text was updated successfully, but these errors were encountered: