-
Notifications
You must be signed in to change notification settings - Fork 331
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Temporary File Cleanup Can Cause Kinesis Producer to Fail #81
Comments
pfifer
added a commit
that referenced
this issue
Nov 25, 2016
* The Java process will periodically reset the last modified times for native components. This will help to ensure that these files aren't deleted by automated cleanup scripts. * Fixes Issue #81
Released new version 0.12.3 that fixes this. |
I'm having this issue even using 0.12.5... |
Still happening for me with 0.12.7.
Bouncing the JVM will fix but is not ideal having downtime for this. |
I'm using 0.12.6 and recently run into this problem. The CPU load was around 15% the errors are similar to what @umatrangolo had. I had to restart the JVM to fix the problem but we had downtime because if this bug. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
The Kinesis Producer, by default, stores native files in a directory in /tmp. This includes the executable, and certificates used to access Kinesis itself. Temporary cleanup cron jobs can remove these files, and while the Kinesis Producer will still run it will be unable to make TLS connections due to a missing certificates.
Failures of the KPL will include an error similar to below
If you're affected by this the current best fix is to restart the parent Java process. This will restore the missing files, and return the KPL to normal.
There are a couple of temporary workarounds:
Adding this as a cron job should keep the certificate file from being cleaned up
After each restart the Java process should replace the files.
The text was updated successfully, but these errors were encountered: