HELK never finishes install #321
Labels
Comments
|
i have the same issue as well |
|
after I found that option 4 was not installed, I chose option 2, and this is my out-put for helk-elastalert and docker ps.
|
|
yup, you can choose a new install option after we figure out whats going on. even with this option “2”. did the install script hang & you have a bad gateway (after user/password prompt) like previously mentioned? Give me a little bit (an hour or so) and I will test a new install to replicate whats going on. hopefully this is just bad luck, right as we are in the process of pushing a bunch of fixes. |
|
Thanks for reply so fast, |
|
I just ran option 4 with no issues, granted it took a little bit of time.. did you use the trail or basic license? are you able to send the output of the following file, after you run the install with option 4? |
|
i was use basic license for install option4, do i have to uninstall option2 first then install option4? or its other way to do? |
|
and if i do need to uninstall option3 first, what code should i use to unstiall them |
|
no problem. You do not need to uninstall.
However, if you hit any errors about not having enough memory then run
“sudo ./helk_remove_containers.sh” before new install.
…On Sun, Sep 1, 2019 at 6:55 AM Ol1ver26 ***@***.***> wrote:
and if i do need to uninstall option3 first, what code should i use to
unstiall them
sorry for asking so many questiones, i am new to this area
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
<#321?email_source=notifications&email_token=ABQOXYWTLW2QRQ7K7ORG7TDQHONQJA5CNFSM4ISSF3TKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD5T7WBQ#issuecomment-526908166>,
or mute the thread
<https:/notifications/unsubscribe-auth/ABQOXYQUYPUCH4HITQSKDCLQHONQJANCNFSM4ISSF3TA>
.
|
|
I got this error
|
|
go ahead and ignore that, try the install now
…On Mon, Sep 2, 2019 at 6:07 AM Ol1ver26 ***@***.***> wrote:
I got this error
[image: image]
<https://user-images.githubusercontent.com/36188251/64107178-3c8e9100-cdbd-11e9-935b-107750f9455f.png>
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
<#321?email_source=notifications&email_token=ABQOXYQWTJXIVHPOOCBSF23QHTQVVA5CNFSM4ISSF3TKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD5VL46Y#issuecomment-527089275>,
or mute the thread
<https:/notifications/unsubscribe-auth/ABQOXYSJ3DYA4UOJOOXWBX3QHTQVVANCNFSM4ISSF3TA>
.
|
|
I will reinstall now and let you know as well. |
|
I am installing now, I noticed this log a couple times during the install: |
|
hmmm,
what operating system is this? and version?
example: “Ubuntu 18.04” or “Centos 7”
…On Mon, Sep 2, 2019 at 10:39 AM Robert Nixon ***@***.***> wrote:
I am installing now, I noticed this log a couple times during the install:
update-alternatives: using /usr/share/postgresql/10/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode
invoke-rc.d: could not determine current runlevel
invoke-rc.d: policy-rc.d denied execution of start.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
<#321?email_source=notifications&email_token=ABQOXYXB7XZ4N64ED5VKTITQHUQTHA5CNFSM4ISSF3TKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD5V722Q#issuecomment-527170922>,
or mute the thread
<https:/notifications/unsubscribe-auth/ABQOXYWXGBW4LF2WU4R7MFDQHUQTHANCNFSM4ISSF3TA>
.
|
i did, but helk_install.sh doesnt allow me, says i dont have enough memory, i have 16 GB ram (67% used by option2) and 150GB disk space |
|
@neu5ron This is Ubuntu 18.04 |
|
@Ol1ver26 @robertnixon2003 go ahead and run these commands in order, skip over if any errors and then try the install.. we need to update the logic for the remove script some more.. |
|
Got this error: |
|
I had to run this as well to get rid of the error above: |
|
So after doing that and trying a reinstall it still hangs at waiting for services to come up. That was 2 hours ago when I started. Going to try option 3. |
|
sorry for all these troubles
Can you send the output of /var/log/helk-install.log
…On Mon, Sep 2, 2019 at 6:14 PM Robert Nixon ***@***.***> wrote:
So after doing that and trying a reinstall it still hangs at waiting for
services to come up. That was 2 hours ago when I started. Going to try
option 3.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#321?email_source=notifications&email_token=ABQOXYQ2RESPUJ3YRRJTAWTQHWF27A5CNFSM4ISSF3TKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD5WTK3Y#issuecomment-527250799>,
or mute the thread
<https:/notifications/unsubscribe-auth/ABQOXYXSI3EXGBV7JJHYUOTQHWF27ANCNFSM4ISSF3TA>
.
|
|
Good evening @robertnixon2003 , I cannot replicate your issues with option 4. A few things before we keep re-installing and removing containers.
This is my helk-install-log file: These are the containers running: These are the only images that you should have and their tags: I cannot replicate what you are experiencing at the moment. |
Where did you get that?? ^^ Can you share more information about where you are seeing those error messages?? Just in case, postgresql is part of
Thank you for your patience @robertnixon2003 |
Hey @robertnixon2003 , I see were you get the postgresql messages. Ignore those. As you can see in the Jupyter Logs, the server is started properly: Also I checked if everything is running properly from a postgresql perspective in the Jupyter container and it is: In other words ignore the following messages: I still cannot replicate why it would hang for hours for you. |
|
I will wipe the server and try again. Not sure whats going on. I installed it before and it worked fine on this same box. |
|
Hello, I have the same issue too docker logs elasticsearch:7.1.0[HELK-ES-DOCKER-INSTALLATION-INFO] Setting ES_JAVA_OPTS to -Xms3200m -Xmx3200m -XX:-UseConcMarkSweepGC -XX:-UseCMSInitiatingOccupancyOnly -XX:+UseG1GC [HELK-ES-DOCKER-INSTALLATION-INFO] Setting Elastic license to basic [HELK-ES-DOCKER-INSTALLATION-INFO] Running docker-entrypoint script.. {"type": "server", "timestamp": "2019-09-07T12:42:20,336+0000", "level": "INFO", "component": "o.e.e.NodeEnvironment", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/mapper/sever--vg-root)]], net usable_space [860.6gb], net total_space [914.2gb], types [ext4]" } {"type": "server", "timestamp": "2019-09-07T12:42:20,346+0000", "level": "INFO", "component": "o.e.e.NodeEnvironment", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "heap size [3.1gb], compressed ordinary object pointers [true]" } {"type": "server", "timestamp": "2019-09-07T12:42:20,351+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "node name [helk-1], node ID [tQDXBakjTMir3sRmURfvFQ], cluster name [helk-cluster]" } {"type": "server", "timestamp": "2019-09-07T12:42:20,352+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "version[7.1.0], pid[12], build[default/docker/606a173/2019-05-16T00:43:15.323135Z], OS[Linux/4.15.0-60-generic/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/12.0.1/12.0.1+12]" } {"type": "server", "timestamp": "2019-09-07T12:42:20,353+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "JVM home [/usr/share/elasticsearch/jdk]" } {"type": "server", "timestamp": "2019-09-07T12:42:20,353+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch-1373145707971171539, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Djava.locale.providers=COMPAT, -Dio.netty.allocator.type=unpooled, -Des.cgroups.hierarchy.override=/, -Xms3200m, -Xmx3200m, -XX:-UseConcMarkSweepGC, -XX:-UseCMSInitiatingOccupancyOnly, -XX:+UseG1GC, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=docker, -Des.bundled_jdk=true]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,501+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [aggs-matrix-stats]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,505+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [analysis-common]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,512+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [ingest-common]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,514+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [ingest-geoip]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,514+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [ingest-user-agent]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,515+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [lang-expression]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,515+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [lang-mustache]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,516+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [lang-painless]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,516+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [mapper-extras]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,517+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [parent-join]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,521+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [percolator]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,522+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [rank-eval]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,522+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [reindex]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,525+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [repository-url]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,526+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [transport-netty4]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,533+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-ccr]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,534+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-core]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,534+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-deprecation]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,535+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-graph]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,535+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-ilm]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,535+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-logstash]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,537+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-ml]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,545+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-monitoring]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,549+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-rollup]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,551+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-security]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,553+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-sql]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,554+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-watcher]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,555+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "no plugins loaded" } {"type": "deprecation", "timestamp": "2019-09-07T12:42:48,258+0000", "level": "WARN", "component": "o.e.d.c.s.Settings", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "[discovery.zen.minimum_master_nodes] setting was deprecated in Elasticsearch and will be removed in a future release! See the breaking changes documentation for the next major version." } {"type": "server", "timestamp": "2019-09-07T12:43:05,175+0000", "level": "WARN", "component": "o.e.b.ElasticsearchUncaughtExceptionHandler", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "uncaught exception in thread [main]" , "stacktrace": ["org.elasticsearch.bootstrap.StartupException: ElasticsearchException[Failed to create native process factories for Machine Learning]; nested: FileNotFoundException[/tmp/elasticsearch-1373145707971171539/controller_log_12 (No such file or directory)];", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124) ~[elasticsearch-cli-7.1.0.jar:7.1.0]", "at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-7.1.0.jar:7.1.0]", "Caused by: org.elasticsearch.ElasticsearchException: Failed to create native process factories for Machine Learning", "at org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:433) ~[?:?]", "at org.elasticsearch.node.Node.lambda$new$9(Node.java:440) ~[elasticsearch-7.1.0.jar:7.1.0]", "at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]", "at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654) ~[?:?]", "at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]", "at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]", "at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]", "at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]", "at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]", "at org.elasticsearch.node.Node.(Node.java:443) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.node.Node.(Node.java:252) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:325) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.1.0.jar:7.1.0]", "... 6 more", "Caused by: java.io.FileNotFoundException: /tmp/elasticsearch-1373145707971171539/controller_log_12 (No such file or directory)", "at java.io.FileInputStream.open0(Native Method) ~[?:?]", "at java.io.FileInputStream.open(FileInputStream.java:213) ~[?:?]", "at java.io.FileInputStream.(FileInputStream.java:155) ~[?:?]", "at java.io.FileInputStream.(FileInputStream.java:110) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper$PrivilegedInputPipeOpener.run(NamedPipeHelper.java:288) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper$PrivilegedInputPipeOpener.run(NamedPipeHelper.java:277) ~[?:?]", "at java.security.AccessController.doPrivileged(AccessController.java:310) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper.openNamedPipeInputStream(NamedPipeHelper.java:130) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper.openNamedPipeInputStream(NamedPipeHelper.java:97) ~[?:?]", "at org.elasticsearch.xpack.ml.process.ProcessPipes.connectStreams(ProcessPipes.java:131) ~[?:?]", "at org.elasticsearch.xpack.ml.process.NativeController.(NativeController.java:61) ~[?:?]", "at org.elasticsearch.xpack.ml.process.NativeControllerHolder.getNativeController(NativeControllerHolder.java:40) ~[?:?]", "at org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:418) ~[?:?]", "at org.elasticsearch.node.Node.lambda$new$9(Node.java:440) ~[elasticsearch-7.1.0.jar:7.1.0]", "at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]", "at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654) ~[?:?]", "at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]", "at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]", "at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]", "at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]", "at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]", "at org.elasticsearch.node.Node.(Node.java:443) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.node.Node.(Node.java:252) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:325) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.1.0.jar:7.1.0]", "... 6 more"] } [HELK-ES-DOCKER-INSTALLATION-INFO] Setting ES_JAVA_OPTS to -Xms3200m -Xmx3200m -XX:-UseConcMarkSweepGC -XX:-UseCMSInitiatingOccupancyOnly -XX:+UseG1GC [HELK-ES-DOCKER-INSTALLATION-INFO] Setting Elastic license to basic [HELK-ES-DOCKER-INSTALLATION-INFO] Running docker-entrypoint script.. {"type": "server", "timestamp": "2019-09-07T12:43:16,586+0000", "level": "INFO", "component": "o.e.e.NodeEnvironment", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/mapper/sever--vg-root)]], net usable_space [860.6gb], net total_space [914.2gb], types [ext4]" } {"type": "server", "timestamp": "2019-09-07T12:43:16,597+0000", "level": "INFO", "component": "o.e.e.NodeEnvironment", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "heap size [3.1gb], compressed ordinary object pointers [true]" } {"type": "server", "timestamp": "2019-09-07T12:43:16,601+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "node name [helk-1], node ID [tQDXBakjTMir3sRmURfvFQ], cluster name [helk-cluster]" } {"type": "server", "timestamp": "2019-09-07T12:43:16,602+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "version[7.1.0], pid[12], build[default/docker/606a173/2019-05-16T00:43:15.323135Z], OS[Linux/4.15.0-60-generic/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/12.0.1/12.0.1+12]" } {"type": "server", "timestamp": "2019-09-07T12:43:16,603+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "JVM home [/usr/share/elasticsearch/jdk]" } {"type": "server", "timestamp": "2019-09-07T12:43:16,604+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch-2864629304196106528, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Djava.locale.providers=COMPAT, -Dio.netty.allocator.type=unpooled, -Des.cgroups.hierarchy.override=/, -Xms3200m, -Xmx3200m, -XX:-UseConcMarkSweepGC, -XX:-UseCMSInitiatingOccupancyOnly, -XX:+UseG1GC, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=docker, -Des.bundled_jdk=true]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,701+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [aggs-matrix-stats]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,701+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [analysis-common]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,702+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [ingest-common]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,703+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [ingest-geoip]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,704+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [ingest-user-agent]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,705+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [lang-expression]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,706+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [lang-mustache]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,708+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [lang-painless]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,708+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [mapper-extras]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,710+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [parent-join]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,710+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [percolator]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,710+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [rank-eval]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,711+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [reindex]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,711+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [repository-url]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,714+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [transport-netty4]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,715+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-ccr]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,726+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-core]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,726+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-deprecation]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,727+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-graph]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,727+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-ilm]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,729+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-logstash]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,730+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-ml]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,730+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-monitoring]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,731+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-rollup]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,732+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-security]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,733+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-sql]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,734+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-watcher]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,736+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "no plugins loaded" } {"type": "deprecation", "timestamp": "2019-09-07T12:43:24,169+0000", "level": "WARN", "component": "o.e.d.c.s.Settings", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "[discovery.zen.minimum_master_nodes] setting was deprecated in Elasticsearch and will be removed in a future release! See the breaking changes documentation for the next major version." } {"type": "server", "timestamp": "2019-09-07T12:43:36,319+0000", "level": "WARN", "component": "o.e.b.ElasticsearchUncaughtExceptionHandler", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "uncaught exception in thread [main]" , "stacktrace": ["org.elasticsearch.bootstrap.StartupException: ElasticsearchException[Failed to create native process factories for Machine Learning]; nested: FileNotFoundException[/tmp/elasticsearch-2864629304196106528/controller_log_12 (No such file or directory)];", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124) ~[elasticsearch-cli-7.1.0.jar:7.1.0]", "at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-7.1.0.jar:7.1.0]", "Caused by: org.elasticsearch.ElasticsearchException: Failed to create native process factories for Machine Learning", "at org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:433) ~[?:?]", "at org.elasticsearch.node.Node.lambda$new$9(Node.java:440) ~[elasticsearch-7.1.0.jar:7.1.0]", "at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]", "at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654) ~[?:?]", "at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]", "at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]", "at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]", "at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]", "at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]", "at org.elasticsearch.node.Node.(Node.java:443) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.node.Node.(Node.java:252) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:325) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.1.0.jar:7.1.0]", "... 6 more", "Caused by: java.io.FileNotFoundException: /tmp/elasticsearch-2864629304196106528/controller_log_12 (No such file or directory)", "at java.io.FileInputStream.open0(Native Method) ~[?:?]", "at java.io.FileInputStream.open(FileInputStream.java:213) ~[?:?]", "at java.io.FileInputStream.(FileInputStream.java:155) ~[?:?]", "at java.io.FileInputStream.(FileInputStream.java:110) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper$PrivilegedInputPipeOpener.run(NamedPipeHelper.java:288) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper$PrivilegedInputPipeOpener.run(NamedPipeHelper.java:277) ~[?:?]", "at java.security.AccessController.doPrivileged(AccessController.java:310) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper.openNamedPipeInputStream(NamedPipeHelper.java:130) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper.openNamedPipeInputStream(NamedPipeHelper.java:97) ~[?:?]", "at org.elasticsearch.xpack.ml.process.ProcessPipes.connectStreams(ProcessPipes.java:131) ~[?:?]", "at org.elasticsearch.xpack.ml.process.NativeController.(NativeController.java:61) ~[?:?]", "at org.elasticsearch.xpack.ml.process.NativeControllerHolder.getNativeController(NativeControllerHolder.java:40) ~[?:?]", "at org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:418) ~[?:?]", "at org.elasticsearch.node.Node.lambda$new$9(Node.java:440) ~[elasticsearch-7.1.0.jar:7.1.0]", "at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]", "at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654) ~[?:?]", "at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]", "at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]", "at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]", "at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]", "at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]", "at org.elasticsearch.node.Node.(Node.java:443) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.node.Node.(Node.java:252) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:325) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.1.0.jar:7.1.0]", "... 6 more"] } [HELK-ES-DOCKER-INSTALLATION-INFO] Setting ES_JAVA_OPTS to -Xms3200m -Xmx3200m -XX:-UseConcMarkSweepGC -XX:-UseCMSInitiatingOccupancyOnly -XX:+UseG1GC [HELK-ES-DOCKER-INSTALLATION-INFO] Setting Elastic license to basic [HELK-ES-DOCKER-INSTALLATION-INFO] Running docker-entrypoint script.. {"type": "server", "timestamp": "2019-09-07T12:43:46,183+0000", "level": "INFO", "component": "o.e.e.NodeEnvironment", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/mapper/sever--vg-root)]], net usable_space [860.6gb], net total_space [914.2gb], types [ext4]" } {"type": "server", "timestamp": "2019-09-07T12:43:46,188+0000", "level": "INFO", "component": "o.e.e.NodeEnvironment", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "heap size [3.1gb], compressed ordinary object pointers [true]" } {"type": "server", "timestamp": "2019-09-07T12:43:46,193+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "node name [helk-1], node ID [tQDXBakjTMir3sRmURfvFQ], cluster name [helk-cluster]" } {"type": "server", "timestamp": "2019-09-07T12:43:46,194+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "version[7.1.0], pid[12], build[default/docker/606a173/2019-05-16T00:43:15.323135Z], OS[Linux/4.15.0-60-generic/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/12.0.1/12.0.1+12]" } {"type": "server", "timestamp": "2019-09-07T12:43:46,194+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "JVM home [/usr/share/elasticsearch/jdk]" } {"type": "server", "timestamp": "2019-09-07T12:43:46,195+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch-3670512058239285020, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Djava.locale.providers=COMPAT, -Dio.netty.allocator.type=unpooled, -Des.cgroups.hierarchy.override=/, -Xms3200m, -Xmx3200m, -XX:-UseConcMarkSweepGC, -XX:-UseCMSInitiatingOccupancyOnly, -XX:+UseG1GC, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=docker, -Des.bundled_jdk=true]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,189+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [aggs-matrix-stats]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,191+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [analysis-common]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,192+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [ingest-common]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,193+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [ingest-geoip]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,194+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [ingest-user-agent]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,198+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [lang-expression]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,201+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [lang-mustache]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,206+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [lang-painless]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,209+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [mapper-extras]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,211+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [parent-join]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,211+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [percolator]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,212+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [rank-eval]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,212+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [reindex]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,213+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [repository-url]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,217+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [transport-netty4]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,218+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-ccr]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,223+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-core]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,224+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-deprecation]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,225+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-graph]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,225+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-ilm]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,225+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-logstash]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,229+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-ml]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,230+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-monitoring]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,230+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-rollup]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,231+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-security]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,231+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-sql]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,231+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-watcher]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,233+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "no plugins loaded" } {"type": "deprecation", "timestamp": "2019-09-07T12:43:53,630+0000", "level": "WARN", "component": "o.e.d.c.s.Settings", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "[discovery.zen.minimum_master_nodes] setting was deprecated in Elasticsearch and will be removed in a future release! See the breaking changes documentation for the next major version." } {"type": "server", "timestamp": "2019-09-07T12:44:05,915+0000", "level": "WARN", "component": "o.e.b.ElasticsearchUncaughtExceptionHandler", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "uncaught exception in thread [main]" , "stacktrace": ["org.elasticsearch.bootstrap.StartupException: ElasticsearchException[Failed to create native process factories for Machine Learning]; nested: FileNotFoundException[/tmp/elasticsearch-3670512058239285020/controller_log_12 (No such file or directory)];", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124) ~[elasticsearch-cli-7.1.0.jar:7.1.0]", "at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-7.1.0.jar:7.1.0]", "Caused by: org.elasticsearch.ElasticsearchException: Failed to create native process factories for Machine Learning", "at org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:433) ~[?:?]", "at org.elasticsearch.node.Node.lambda$new$9(Node.java:440) ~[elasticsearch-7.1.0.jar:7.1.0]", "at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]", "at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654) ~[?:?]", "at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]", "at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]", "at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]", "at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]", "at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]", "at org.elasticsearch.node.Node.(Node.java:443) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.node.Node.(Node.java:252) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:325) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.1.0.jar:7.1.0]", "... 6 more", "Caused by: java.io.FileNotFoundException: /tmp/elasticsearch-3670512058239285020/controller_log_12 (No such file or directory)", "at java.io.FileInputStream.open0(Native Method) ~[?:?]", "at java.io.FileInputStream.open(FileInputStream.java:213) ~[?:?]", "at java.io.FileInputStream.(FileInputStream.java:155) ~[?:?]", "at java.io.FileInputStream.(FileInputStream.java:110) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper$PrivilegedInputPipeOpener.run(NamedPipeHelper.java:288) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper$PrivilegedInputPipeOpener.run(NamedPipeHelper.java:277) ~[?:?]", "at java.security.AccessController.doPrivileged(AccessController.java:310) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper.openNamedPipeInputStream(NamedPipeHelper.java:130) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper.openNamedPipeInputStream(NamedPipeHelper.java:97) ~[?:?]", "at org.elasticsearch.xpack.ml.process.ProcessPipes.connectStreams(ProcessPipes.java:131) ~[?:?]", "at org.elasticsearch.xpack.ml.process.NativeController.(NativeController.java:61) ~[?:?]", "at org.elasticsearch.xpack.ml.process.NativeControllerHolder.getNativeController(NativeControllerHolder.java:40) ~[?:?]", "at org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:418) ~[?:?]", "at org.elasticsearch.node.Node.lambda$new$9(Node.java:440) ~[elasticsearch-7.1.0.jar:7.1.0]", "at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]", "at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654) ~[?:?]", "at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]", "at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]", "at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]", "at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]", "at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]", "at org.elasticsearch.node.Node.(Node.java:443) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.node.Node.(Node.java:252) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:325) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.1.0.jar:7.1.0]", "... 6 more"] } |
|
Can you send the output of
/var/log/helk-install.log
…On Sat, Sep 7, 2019 at 9:13 AM sugarp0pe ***@***.***> wrote:
Hello, I have the same issue too
Ubuntu 18.04.3
Docker 19.03.2
docker-compose v.1.24.1
Running option 2 helk_install.sh
elasticsearch container always restarting every 30 seconds
docker logs elasticsearch:7.1.0 HELK-ES-DOCKER-INSTALLATION-INFO] Setting
ES_JAVA_OPTS to -Xms3200m -Xmx3200m -XX:-UseConcMarkSweepGC
-XX:-UseCMSInitiatingOccupancyOnly -XX:+UseG1GC
[HELK-ES-DOCKER-INSTALLATION-INFO] Setting Elastic license to basic
[HELK-ES-DOCKER-INSTALLATION-INFO] Running docker-entrypoint script..
{"type": "server", "timestamp": "2019-09-07T12:42:20,336+0000", "level":
"INFO", "component": "o.e.e.NodeEnvironment", "cluster.name":
"helk-cluster", "node.name": "helk-1", "message": "using [1] data paths,
mounts [[/usr/share/elasticsearch/data (/dev/mapper/sentinel--vg-root)]],
net usable_space [860.6gb], net total_space [914.2gb], types [ext4]" }
{"type": "server", "timestamp": "2019-09-07T12:42:20,346+0000", "level":
"INFO", "component": "o.e.e.NodeEnvironment", "cluster.name":
"helk-cluster", "node.name": "helk-1", "message": "heap size [3.1gb],
compressed ordinary object pointers [true]" } {"type": "server",
"timestamp": "2019-09-07T12:42:20,351+0000", "level": "INFO", "component":
"o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1",
"message": "node name [helk-1], node ID [tQDXBakjTMir3sRmURfvFQ], cluster
name [helk-cluster]" } {"type": "server", "timestamp":
"2019-09-07T12:42:20,352+0000", "level": "INFO", "component": "o.e.n.Node",
"cluster.name": "helk-cluster", "node.name": "helk-1", "message":
"version[7.1.0], pid[12],
build[default/docker/606a173/2019-05-16T00:43:15.323135Z],
OS[Linux/4.15.0-60-generic/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit
Server VM/12.0.1/12.0.1+12]" } {"type": "server", "timestamp":
"2019-09-07T12:42:20,353+0000", "level": "INFO", "component": "o.e.n.Node",
"cluster.name": "helk-cluster", "node.name": "helk-1", "message": "JVM
home [/usr/share/elasticsearch/jdk]" } {"type": "server", "timestamp":
"2019-09-07T12:42:20,353+0000", "level": "INFO", "component": "o.e.n.Node",
"cluster.name": "helk-cluster", "node.name": "helk-1", "message": "JVM
arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC,
-XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly,
-Des.networkaddress.cache.ttl=60,
-Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m,
-Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true,
-XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true,
-Dio.netty.noKeySetOptimization=true,
-Dio.netty.recycler.maxCapacityPerThread=0,
-Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true,
-Djava.io.tmpdir=/tmp/elasticsearch-1373145707971171539,
-XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data,
-XX:ErrorFile=logs/hs_err_pid%p.log,
-Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m,
-Djava.locale.providers=COMPAT, -Dio.netty.allocator.type=unpooled,
-Des.cgroups.hierarchy.override=/, -Xms3200m, -Xmx3200m,
-XX:-UseConcMarkSweepGC, -XX:-UseCMSInitiatingOccupancyOnly, -XX:+UseG1GC,
-Des.path.home=/usr/share/elasticsearch,
-Des.path.conf=/usr/share/elasticsearch/config,
-Des.distribution.flavor=default, -Des.distribution.type=docker,
-Des.bundled_jdk=true]" } {"type": "server", "timestamp":
"2019-09-07T12:42:34,501+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [aggs-matrix-stats]" } {"type":
"server", "timestamp": "2019-09-07T12:42:34,505+0000", "level": "INFO",
"component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "
node.name": "helk-1", "message": "loaded module [analysis-common]" }
{"type": "server", "timestamp": "2019-09-07T12:42:34,512+0000", "level":
"INFO", "component": "o.e.p.PluginsService", "cluster.name":
"helk-cluster", "node.name": "helk-1", "message": "loaded module
[ingest-common]" } {"type": "server", "timestamp":
"2019-09-07T12:42:34,514+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [ingest-geoip]" } {"type": "server",
"timestamp": "2019-09-07T12:42:34,514+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [ingest-user-agent]" } {"type":
"server", "timestamp": "2019-09-07T12:42:34,515+0000", "level": "INFO",
"component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "
node.name": "helk-1", "message": "loaded module [lang-expression]" }
{"type": "server", "timestamp": "2019-09-07T12:42:34,515+0000", "level":
"INFO", "component": "o.e.p.PluginsService", "cluster.name":
"helk-cluster", "node.name": "helk-1", "message": "loaded module
[lang-mustache]" } {"type": "server", "timestamp":
"2019-09-07T12:42:34,516+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [lang-painless]" } {"type": "server",
"timestamp": "2019-09-07T12:42:34,516+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [mapper-extras]" } {"type": "server",
"timestamp": "2019-09-07T12:42:34,517+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [parent-join]" } {"type": "server",
"timestamp": "2019-09-07T12:42:34,521+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [percolator]" } {"type": "server",
"timestamp": "2019-09-07T12:42:34,522+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [rank-eval]" } {"type": "server",
"timestamp": "2019-09-07T12:42:34,522+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [reindex]" } {"type": "server",
"timestamp": "2019-09-07T12:42:34,525+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [repository-url]" } {"type": "server",
"timestamp": "2019-09-07T12:42:34,526+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [transport-netty4]" } {"type":
"server", "timestamp": "2019-09-07T12:42:34,533+0000", "level": "INFO",
"component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "
node.name": "helk-1", "message": "loaded module [x-pack-ccr]" } {"type":
"server", "timestamp": "2019-09-07T12:42:34,534+0000", "level": "INFO",
"component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "
node.name": "helk-1", "message": "loaded module [x-pack-core]" } {"type":
"server", "timestamp": "2019-09-07T12:42:34,534+0000", "level": "INFO",
"component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "
node.name": "helk-1", "message": "loaded module [x-pack-deprecation]" }
{"type": "server", "timestamp": "2019-09-07T12:42:34,535+0000", "level":
"INFO", "component": "o.e.p.PluginsService", "cluster.name":
"helk-cluster", "node.name": "helk-1", "message": "loaded module
[x-pack-graph]" } {"type": "server", "timestamp":
"2019-09-07T12:42:34,535+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [x-pack-ilm]" } {"type": "server",
"timestamp": "2019-09-07T12:42:34,535+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [x-pack-logstash]" } {"type": "server",
"timestamp": "2019-09-07T12:42:34,537+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [x-pack-ml]" } {"type": "server",
"timestamp": "2019-09-07T12:42:34,545+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [x-pack-monitoring]" } {"type":
"server", "timestamp": "2019-09-07T12:42:34,549+0000", "level": "INFO",
"component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "
node.name": "helk-1", "message": "loaded module [x-pack-rollup]" }
{"type": "server", "timestamp": "2019-09-07T12:42:34,551+0000", "level":
"INFO", "component": "o.e.p.PluginsService", "cluster.name":
"helk-cluster", "node.name": "helk-1", "message": "loaded module
[x-pack-security]" } {"type": "server", "timestamp":
"2019-09-07T12:42:34,553+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [x-pack-sql]" } {"type": "server",
"timestamp": "2019-09-07T12:42:34,554+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [x-pack-watcher]" } {"type": "server",
"timestamp": "2019-09-07T12:42:34,555+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "no plugins loaded" } {"type": "deprecation",
"timestamp": "2019-09-07T12:42:48,258+0000", "level": "WARN", "component":
"o.e.d.c.s.Settings", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "[discovery.zen.minimum_master_nodes] setting was
deprecated in Elasticsearch and will be removed in a future release! See
the breaking changes documentation for the next major version." } {"type":
"server", "timestamp": "2019-09-07T12:43:05,175+0000", "level": "WARN",
"component": "o.e.b.ElasticsearchUncaughtExceptionHandler", "cluster.name":
"helk-cluster", "node.name": "helk-1", "message": "uncaught exception in
thread [main]" , "stacktrace":
["org.elasticsearch.bootstrap.StartupException:
ElasticsearchException[Failed to create native process factories for
Machine Learning]; nested:
FileNotFoundException[/tmp/elasticsearch-1373145707971171539/controller_log_12
(No such file or directory)];", "at
org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124)
~[elasticsearch-cli-7.1.0.jar:7.1.0]", "at
org.elasticsearch.cli.Command.main(Command.java:90)
~[elasticsearch-cli-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92)
~[elasticsearch-7.1.0.jar:7.1.0]", "Caused by:
org.elasticsearch.ElasticsearchException: Failed to create native process
factories for Machine Learning", "at
org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:433)
~[?:?]", "at org.elasticsearch.node.Node.lambda$new$9(Node.java:440)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271)
~[?:?]", "at
java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654)
~[?:?]", "at
java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
~[?:?]", "at
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
~[?:?]", "at
java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
~[?:?]", "at
java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
~[?:?]", "at
java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
~[?:?]", "at org.elasticsearch.node.Node.(Node.java:443)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.node.Node.(Node.java:252)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:211)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:211)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:325)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159)
~[elasticsearch-7.1.0.jar:7.1.0]", "... 6 more", "Caused by:
java.io.FileNotFoundException:
/tmp/elasticsearch-1373145707971171539/controller_log_12 (No such file or
directory)", "at java.io.FileInputStream.open0(Native Method) ~[?:?]", "at
java.io.FileInputStream.open(FileInputStream.java:213) ~[?:?]", "at
java.io.FileInputStream.(FileInputStream.java:155) ~[?:?]", "at
java.io.FileInputStream.(FileInputStream.java:110) ~[?:?]", "at
org.elasticsearch.xpack.ml.utils.NamedPipeHelper$PrivilegedInputPipeOpener.run(NamedPipeHelper.java:288)
~[?:?]", "at
org.elasticsearch.xpack.ml.utils.NamedPipeHelper$PrivilegedInputPipeOpener.run(NamedPipeHelper.java:277)
~[?:?]", "at
java.security.AccessController.doPrivileged(AccessController.java:310)
~[?:?]", "at
org.elasticsearch.xpack.ml.utils.NamedPipeHelper.openNamedPipeInputStream(NamedPipeHelper.java:130)
~[?:?]", "at
org.elasticsearch.xpack.ml.utils.NamedPipeHelper.openNamedPipeInputStream(NamedPipeHelper.java:97)
~[?:?]", "at
org.elasticsearch.xpack.ml.process.ProcessPipes.connectStreams(ProcessPipes.java:131)
~[?:?]", "at
org.elasticsearch.xpack.ml.process.NativeController.(NativeController.java:61)
~[?:?]", "at
org.elasticsearch.xpack.ml.process.NativeControllerHolder.getNativeController(NativeControllerHolder.java:40)
~[?:?]", "at
org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:418)
~[?:?]", "at org.elasticsearch.node.Node.lambda$new$9(Node.java:440)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271)
~[?:?]", "at
java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654)
~[?:?]", "at
java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
~[?:?]", "at
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
~[?:?]", "at
java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
~[?:?]", "at
java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
~[?:?]", "at
java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
~[?:?]", "at org.elasticsearch.node.Node.(Node.java:443)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.node.Node.(Node.java:252)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:211)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:211)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:325)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159)
~[elasticsearch-7.1.0.jar:7.1.0]", "... 6 more"] }
[HELK-ES-DOCKER-INSTALLATION-INFO] Setting ES_JAVA_OPTS to -Xms3200m
-Xmx3200m -XX:-UseConcMarkSweepGC -XX:-UseCMSInitiatingOccupancyOnly
-XX:+UseG1GC [HELK-ES-DOCKER-INSTALLATION-INFO] Setting Elastic license to
basic [HELK-ES-DOCKER-INSTALLATION-INFO] Running docker-entrypoint script..
{"type": "server", "timestamp": "2019-09-07T12:43:16,586+0000", "level":
"INFO", "component": "o.e.e.NodeEnvironment", "cluster.name":
"helk-cluster", "node.name": "helk-1", "message": "using [1] data paths,
mounts [[/usr/share/elasticsearch/data (/dev/mapper/sentinel--vg-root)]],
net usable_space [860.6gb], net total_space [914.2gb], types [ext4]" }
{"type": "server", "timestamp": "2019-09-07T12:43:16,597+0000", "level":
"INFO", "component": "o.e.e.NodeEnvironment", "cluster.name":
"helk-cluster", "node.name": "helk-1", "message": "heap size [3.1gb],
compressed ordinary object pointers [true]" } {"type": "server",
"timestamp": "2019-09-07T12:43:16,601+0000", "level": "INFO", "component":
"o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1",
"message": "node name [helk-1], node ID [tQDXBakjTMir3sRmURfvFQ], cluster
name [helk-cluster]" } {"type": "server", "timestamp":
"2019-09-07T12:43:16,602+0000", "level": "INFO", "component": "o.e.n.Node",
"cluster.name": "helk-cluster", "node.name": "helk-1", "message":
"version[7.1.0], pid[12],
build[default/docker/606a173/2019-05-16T00:43:15.323135Z],
OS[Linux/4.15.0-60-generic/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit
Server VM/12.0.1/12.0.1+12]" } {"type": "server", "timestamp":
"2019-09-07T12:43:16,603+0000", "level": "INFO", "component": "o.e.n.Node",
"cluster.name": "helk-cluster", "node.name": "helk-1", "message": "JVM
home [/usr/share/elasticsearch/jdk]" } {"type": "server", "timestamp":
"2019-09-07T12:43:16,604+0000", "level": "INFO", "component": "o.e.n.Node",
"cluster.name": "helk-cluster", "node.name": "helk-1", "message": "JVM
arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC,
-XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly,
-Des.networkaddress.cache.ttl=60,
-Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m,
-Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true,
-XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true,
-Dio.netty.noKeySetOptimization=true,
-Dio.netty.recycler.maxCapacityPerThread=0,
-Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true,
-Djava.io.tmpdir=/tmp/elasticsearch-2864629304196106528,
-XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data,
-XX:ErrorFile=logs/hs_err_pid%p.log,
-Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m,
-Djava.locale.providers=COMPAT, -Dio.netty.allocator.type=unpooled,
-Des.cgroups.hierarchy.override=/, -Xms3200m, -Xmx3200m,
-XX:-UseConcMarkSweepGC, -XX:-UseCMSInitiatingOccupancyOnly, -XX:+UseG1GC,
-Des.path.home=/usr/share/elasticsearch,
-Des.path.conf=/usr/share/elasticsearch/config,
-Des.distribution.flavor=default, -Des.distribution.type=docker,
-Des.bundled_jdk=true]" } {"type": "server", "timestamp":
"2019-09-07T12:43:19,701+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [aggs-matrix-stats]" } {"type":
"server", "timestamp": "2019-09-07T12:43:19,701+0000", "level": "INFO",
"component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "
node.name": "helk-1", "message": "loaded module [analysis-common]" }
{"type": "server", "timestamp": "2019-09-07T12:43:19,702+0000", "level":
"INFO", "component": "o.e.p.PluginsService", "cluster.name":
"helk-cluster", "node.name": "helk-1", "message": "loaded module
[ingest-common]" } {"type": "server", "timestamp":
"2019-09-07T12:43:19,703+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [ingest-geoip]" } {"type": "server",
"timestamp": "2019-09-07T12:43:19,704+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [ingest-user-agent]" } {"type":
"server", "timestamp": "2019-09-07T12:43:19,705+0000", "level": "INFO",
"component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "
node.name": "helk-1", "message": "loaded module [lang-expression]" }
{"type": "server", "timestamp": "2019-09-07T12:43:19,706+0000", "level":
"INFO", "component": "o.e.p.PluginsService", "cluster.name":
"helk-cluster", "node.name": "helk-1", "message": "loaded module
[lang-mustache]" } {"type": "server", "timestamp":
"2019-09-07T12:43:19,708+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [lang-painless]" } {"type": "server",
"timestamp": "2019-09-07T12:43:19,708+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [mapper-extras]" } {"type": "server",
"timestamp": "2019-09-07T12:43:19,710+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [parent-join]" } {"type": "server",
"timestamp": "2019-09-07T12:43:19,710+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [percolator]" } {"type": "server",
"timestamp": "2019-09-07T12:43:19,710+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [rank-eval]" } {"type": "server",
"timestamp": "2019-09-07T12:43:19,711+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [reindex]" } {"type": "server",
"timestamp": "2019-09-07T12:43:19,711+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [repository-url]" } {"type": "server",
"timestamp": "2019-09-07T12:43:19,714+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [transport-netty4]" } {"type":
"server", "timestamp": "2019-09-07T12:43:19,715+0000", "level": "INFO",
"component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "
node.name": "helk-1", "message": "loaded module [x-pack-ccr]" } {"type":
"server", "timestamp": "2019-09-07T12:43:19,726+0000", "level": "INFO",
"component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "
node.name": "helk-1", "message": "loaded module [x-pack-core]" } {"type":
"server", "timestamp": "2019-09-07T12:43:19,726+0000", "level": "INFO",
"component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "
node.name": "helk-1", "message": "loaded module [x-pack-deprecation]" }
{"type": "server", "timestamp": "2019-09-07T12:43:19,727+0000", "level":
"INFO", "component": "o.e.p.PluginsService", "cluster.name":
"helk-cluster", "node.name": "helk-1", "message": "loaded module
[x-pack-graph]" } {"type": "server", "timestamp":
"2019-09-07T12:43:19,727+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [x-pack-ilm]" } {"type": "server",
"timestamp": "2019-09-07T12:43:19,729+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [x-pack-logstash]" } {"type": "server",
"timestamp": "2019-09-07T12:43:19,730+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [x-pack-ml]" } {"type": "server",
"timestamp": "2019-09-07T12:43:19,730+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [x-pack-monitoring]" } {"type":
"server", "timestamp": "2019-09-07T12:43:19,731+0000", "level": "INFO",
"component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "
node.name": "helk-1", "message": "loaded module [x-pack-rollup]" }
{"type": "server", "timestamp": "2019-09-07T12:43:19,732+0000", "level":
"INFO", "component": "o.e.p.PluginsService", "cluster.name":
"helk-cluster", "node.name": "helk-1", "message": "loaded module
[x-pack-security]" } {"type": "server", "timestamp":
"2019-09-07T12:43:19,733+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [x-pack-sql]" } {"type": "server",
"timestamp": "2019-09-07T12:43:19,734+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [x-pack-watcher]" } {"type": "server",
"timestamp": "2019-09-07T12:43:19,736+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "no plugins loaded" } {"type": "deprecation",
"timestamp": "2019-09-07T12:43:24,169+0000", "level": "WARN", "component":
"o.e.d.c.s.Settings", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "[discovery.zen.minimum_master_nodes] setting was
deprecated in Elasticsearch and will be removed in a future release! See
the breaking changes documentation for the next major version." } {"type":
"server", "timestamp": "2019-09-07T12:43:36,319+0000", "level": "WARN",
"component": "o.e.b.ElasticsearchUncaughtExceptionHandler", "cluster.name":
"helk-cluster", "node.name": "helk-1", "message": "uncaught exception in
thread [main]" , "stacktrace":
["org.elasticsearch.bootstrap.StartupException:
ElasticsearchException[Failed to create native process factories for
Machine Learning]; nested:
FileNotFoundException[/tmp/elasticsearch-2864629304196106528/controller_log_12
(No such file or directory)];", "at
org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124)
~[elasticsearch-cli-7.1.0.jar:7.1.0]", "at
org.elasticsearch.cli.Command.main(Command.java:90)
~[elasticsearch-cli-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92)
~[elasticsearch-7.1.0.jar:7.1.0]", "Caused by:
org.elasticsearch.ElasticsearchException: Failed to create native process
factories for Machine Learning", "at
org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:433)
~[?:?]", "at org.elasticsearch.node.Node.lambda$new$9(Node.java:440)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271)
~[?:?]", "at
java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654)
~[?:?]", "at
java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
~[?:?]", "at
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
~[?:?]", "at
java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
~[?:?]", "at
java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
~[?:?]", "at
java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
~[?:?]", "at org.elasticsearch.node.Node.(Node.java:443)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.node.Node.(Node.java:252)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:211)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:211)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:325)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159)
~[elasticsearch-7.1.0.jar:7.1.0]", "... 6 more", "Caused by:
java.io.FileNotFoundException:
/tmp/elasticsearch-2864629304196106528/controller_log_12 (No such file or
directory)", "at java.io.FileInputStream.open0(Native Method) ~[?:?]", "at
java.io.FileInputStream.open(FileInputStream.java:213) ~[?:?]", "at
java.io.FileInputStream.(FileInputStream.java:155) ~[?:?]", "at
java.io.FileInputStream.(FileInputStream.java:110) ~[?:?]", "at
org.elasticsearch.xpack.ml.utils.NamedPipeHelper$PrivilegedInputPipeOpener.run(NamedPipeHelper.java:288)
~[?:?]", "at
org.elasticsearch.xpack.ml.utils.NamedPipeHelper$PrivilegedInputPipeOpener.run(NamedPipeHelper.java:277)
~[?:?]", "at
java.security.AccessController.doPrivileged(AccessController.java:310)
~[?:?]", "at
org.elasticsearch.xpack.ml.utils.NamedPipeHelper.openNamedPipeInputStream(NamedPipeHelper.java:130)
~[?:?]", "at
org.elasticsearch.xpack.ml.utils.NamedPipeHelper.openNamedPipeInputStream(NamedPipeHelper.java:97)
~[?:?]", "at
org.elasticsearch.xpack.ml.process.ProcessPipes.connectStreams(ProcessPipes.java:131)
~[?:?]", "at
org.elasticsearch.xpack.ml.process.NativeController.(NativeController.java:61)
~[?:?]", "at
org.elasticsearch.xpack.ml.process.NativeControllerHolder.getNativeController(NativeControllerHolder.java:40)
~[?:?]", "at
org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:418)
~[?:?]", "at org.elasticsearch.node.Node.lambda$new$9(Node.java:440)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271)
~[?:?]", "at
java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654)
~[?:?]", "at
java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
~[?:?]", "at
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
~[?:?]", "at
java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
~[?:?]", "at
java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
~[?:?]", "at
java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
~[?:?]", "at org.elasticsearch.node.Node.(Node.java:443)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.node.Node.(Node.java:252)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:211)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:211)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:325)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159)
~[elasticsearch-7.1.0.jar:7.1.0]", "... 6 more"] }
[HELK-ES-DOCKER-INSTALLATION-INFO] Setting ES_JAVA_OPTS to -Xms3200m
-Xmx3200m -XX:-UseConcMarkSweepGC -XX:-UseCMSInitiatingOccupancyOnly
-XX:+UseG1GC [HELK-ES-DOCKER-INSTALLATION-INFO] Setting Elastic license to
basic [HELK-ES-DOCKER-INSTALLATION-INFO] Running docker-entrypoint script..
{"type": "server", "timestamp": "2019-09-07T12:43:46,183+0000", "level":
"INFO", "component": "o.e.e.NodeEnvironment", "cluster.name":
"helk-cluster", "node.name": "helk-1", "message": "using [1] data paths,
mounts [[/usr/share/elasticsearch/data (/dev/mapper/sentinel--vg-root)]],
net usable_space [860.6gb], net total_space [914.2gb], types [ext4]" }
{"type": "server", "timestamp": "2019-09-07T12:43:46,188+0000", "level":
"INFO", "component": "o.e.e.NodeEnvironment", "cluster.name":
"helk-cluster", "node.name": "helk-1", "message": "heap size [3.1gb],
compressed ordinary object pointers [true]" } {"type": "server",
"timestamp": "2019-09-07T12:43:46,193+0000", "level": "INFO", "component":
"o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1",
"message": "node name [helk-1], node ID [tQDXBakjTMir3sRmURfvFQ], cluster
name [helk-cluster]" } {"type": "server", "timestamp":
"2019-09-07T12:43:46,194+0000", "level": "INFO", "component": "o.e.n.Node",
"cluster.name": "helk-cluster", "node.name": "helk-1", "message":
"version[7.1.0], pid[12],
build[default/docker/606a173/2019-05-16T00:43:15.323135Z],
OS[Linux/4.15.0-60-generic/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit
Server VM/12.0.1/12.0.1+12]" } {"type": "server", "timestamp":
"2019-09-07T12:43:46,194+0000", "level": "INFO", "component": "o.e.n.Node",
"cluster.name": "helk-cluster", "node.name": "helk-1", "message": "JVM
home [/usr/share/elasticsearch/jdk]" } {"type": "server", "timestamp":
"2019-09-07T12:43:46,195+0000", "level": "INFO", "component": "o.e.n.Node",
"cluster.name": "helk-cluster", "node.name": "helk-1", "message": "JVM
arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC,
-XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly,
-Des.networkaddress.cache.ttl=60,
-Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m,
-Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true,
-XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true,
-Dio.netty.noKeySetOptimization=true,
-Dio.netty.recycler.maxCapacityPerThread=0,
-Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true,
-Djava.io.tmpdir=/tmp/elasticsearch-3670512058239285020,
-XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data,
-XX:ErrorFile=logs/hs_err_pid%p.log,
-Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m,
-Djava.locale.providers=COMPAT, -Dio.netty.allocator.type=unpooled,
-Des.cgroups.hierarchy.override=/, -Xms3200m, -Xmx3200m,
-XX:-UseConcMarkSweepGC, -XX:-UseCMSInitiatingOccupancyOnly, -XX:+UseG1GC,
-Des.path.home=/usr/share/elasticsearch,
-Des.path.conf=/usr/share/elasticsearch/config,
-Des.distribution.flavor=default, -Des.distribution.type=docker,
-Des.bundled_jdk=true]" } {"type": "server", "timestamp":
"2019-09-07T12:43:49,189+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [aggs-matrix-stats]" } {"type":
"server", "timestamp": "2019-09-07T12:43:49,191+0000", "level": "INFO",
"component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "
node.name": "helk-1", "message": "loaded module [analysis-common]" }
{"type": "server", "timestamp": "2019-09-07T12:43:49,192+0000", "level":
"INFO", "component": "o.e.p.PluginsService", "cluster.name":
"helk-cluster", "node.name": "helk-1", "message": "loaded module
[ingest-common]" } {"type": "server", "timestamp":
"2019-09-07T12:43:49,193+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [ingest-geoip]" } {"type": "server",
"timestamp": "2019-09-07T12:43:49,194+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [ingest-user-agent]" } {"type":
"server", "timestamp": "2019-09-07T12:43:49,198+0000", "level": "INFO",
"component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "
node.name": "helk-1", "message": "loaded module [lang-expression]" }
{"type": "server", "timestamp": "2019-09-07T12:43:49,201+0000", "level":
"INFO", "component": "o.e.p.PluginsService", "cluster.name":
"helk-cluster", "node.name": "helk-1", "message": "loaded module
[lang-mustache]" } {"type": "server", "timestamp":
"2019-09-07T12:43:49,206+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [lang-painless]" } {"type": "server",
"timestamp": "2019-09-07T12:43:49,209+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [mapper-extras]" } {"type": "server",
"timestamp": "2019-09-07T12:43:49,211+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [parent-join]" } {"type": "server",
"timestamp": "2019-09-07T12:43:49,211+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [percolator]" } {"type": "server",
"timestamp": "2019-09-07T12:43:49,212+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [rank-eval]" } {"type": "server",
"timestamp": "2019-09-07T12:43:49,212+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [reindex]" } {"type": "server",
"timestamp": "2019-09-07T12:43:49,213+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [repository-url]" } {"type": "server",
"timestamp": "2019-09-07T12:43:49,217+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [transport-netty4]" } {"type":
"server", "timestamp": "2019-09-07T12:43:49,218+0000", "level": "INFO",
"component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "
node.name": "helk-1", "message": "loaded module [x-pack-ccr]" } {"type":
"server", "timestamp": "2019-09-07T12:43:49,223+0000", "level": "INFO",
"component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "
node.name": "helk-1", "message": "loaded module [x-pack-core]" } {"type":
"server", "timestamp": "2019-09-07T12:43:49,224+0000", "level": "INFO",
"component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "
node.name": "helk-1", "message": "loaded module [x-pack-deprecation]" }
{"type": "server", "timestamp": "2019-09-07T12:43:49,225+0000", "level":
"INFO", "component": "o.e.p.PluginsService", "cluster.name":
"helk-cluster", "node.name": "helk-1", "message": "loaded module
[x-pack-graph]" } {"type": "server", "timestamp":
"2019-09-07T12:43:49,225+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [x-pack-ilm]" } {"type": "server",
"timestamp": "2019-09-07T12:43:49,225+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [x-pack-logstash]" } {"type": "server",
"timestamp": "2019-09-07T12:43:49,229+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [x-pack-ml]" } {"type": "server",
"timestamp": "2019-09-07T12:43:49,230+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [x-pack-monitoring]" } {"type":
"server", "timestamp": "2019-09-07T12:43:49,230+0000", "level": "INFO",
"component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "
node.name": "helk-1", "message": "loaded module [x-pack-rollup]" }
{"type": "server", "timestamp": "2019-09-07T12:43:49,231+0000", "level":
"INFO", "component": "o.e.p.PluginsService", "cluster.name":
"helk-cluster", "node.name": "helk-1", "message": "loaded module
[x-pack-security]" } {"type": "server", "timestamp":
"2019-09-07T12:43:49,231+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [x-pack-sql]" } {"type": "server",
"timestamp": "2019-09-07T12:43:49,231+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "loaded module [x-pack-watcher]" } {"type": "server",
"timestamp": "2019-09-07T12:43:49,233+0000", "level": "INFO", "component":
"o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "no plugins loaded" } {"type": "deprecation",
"timestamp": "2019-09-07T12:43:53,630+0000", "level": "WARN", "component":
"o.e.d.c.s.Settings", "cluster.name": "helk-cluster", "node.name":
"helk-1", "message": "[discovery.zen.minimum_master_nodes] setting was
deprecated in Elasticsearch and will be removed in a future release! See
the breaking changes documentation for the next major version." } {"type":
"server", "timestamp": "2019-09-07T12:44:05,915+0000", "level": "WARN",
"component": "o.e.b.ElasticsearchUncaughtExceptionHandler", "cluster.name":
"helk-cluster", "node.name": "helk-1", "message": "uncaught exception in
thread [main]" , "stacktrace":
["org.elasticsearch.bootstrap.StartupException:
ElasticsearchException[Failed to create native process factories for
Machine Learning]; nested:
FileNotFoundException[/tmp/elasticsearch-3670512058239285020/controller_log_12
(No such file or directory)];", "at
org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124)
~[elasticsearch-cli-7.1.0.jar:7.1.0]", "at
org.elasticsearch.cli.Command.main(Command.java:90)
~[elasticsearch-cli-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92)
~[elasticsearch-7.1.0.jar:7.1.0]", "Caused by:
org.elasticsearch.ElasticsearchException: Failed to create native process
factories for Machine Learning", "at
org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:433)
~[?:?]", "at org.elasticsearch.node.Node.lambda$new$9(Node.java:440)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271)
~[?:?]", "at
java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654)
~[?:?]", "at
java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
~[?:?]", "at
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
~[?:?]", "at
java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
~[?:?]", "at
java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
~[?:?]", "at
java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
~[?:?]", "at org.elasticsearch.node.Node.(Node.java:443)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.node.Node.(Node.java:252)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:211)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:211)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:325)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159)
~[elasticsearch-7.1.0.jar:7.1.0]", "... 6 more", "Caused by:
java.io.FileNotFoundException:
/tmp/elasticsearch-3670512058239285020/controller_log_12 (No such file or
directory)", "at java.io.FileInputStream.open0(Native Method) ~[?:?]", "at
java.io.FileInputStream.open(FileInputStream.java:213) ~[?:?]", "at
java.io.FileInputStream.(FileInputStream.java:155) ~[?:?]", "at
java.io.FileInputStream.(FileInputStream.java:110) ~[?:?]", "at
org.elasticsearch.xpack.ml.utils.NamedPipeHelper$PrivilegedInputPipeOpener.run(NamedPipeHelper.java:288)
~[?:?]", "at
org.elasticsearch.xpack.ml.utils.NamedPipeHelper$PrivilegedInputPipeOpener.run(NamedPipeHelper.java:277)
~[?:?]", "at
java.security.AccessController.doPrivileged(AccessController.java:310)
~[?:?]", "at
org.elasticsearch.xpack.ml.utils.NamedPipeHelper.openNamedPipeInputStream(NamedPipeHelper.java:130)
~[?:?]", "at
org.elasticsearch.xpack.ml.utils.NamedPipeHelper.openNamedPipeInputStream(NamedPipeHelper.java:97)
~[?:?]", "at
org.elasticsearch.xpack.ml.process.ProcessPipes.connectStreams(ProcessPipes.java:131)
~[?:?]", "at
org.elasticsearch.xpack.ml.process.NativeController.(NativeController.java:61)
~[?:?]", "at
org.elasticsearch.xpack.ml.process.NativeControllerHolder.getNativeController(NativeControllerHolder.java:40)
~[?:?]", "at
org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:418)
~[?:?]", "at org.elasticsearch.node.Node.lambda$new$9(Node.java:440)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271)
~[?:?]", "at
java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654)
~[?:?]", "at
java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
~[?:?]", "at
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
~[?:?]", "at
java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
~[?:?]", "at
java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
~[?:?]", "at
java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
~[?:?]", "at org.elasticsearch.node.Node.(Node.java:443)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.node.Node.(Node.java:252)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:211)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:211)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:325)
~[elasticsearch-7.1.0.jar:7.1.0]", "at
org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159)
~[elasticsearch-7.1.0.jar:7.1.0]", "... 6 more"] }
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#321?email_source=notifications&email_token=ABQOXYVKGF2KKIXUAE3BLC3QIOSFZA5CNFSM4ISSF3TKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD6EYR2I#issuecomment-529107177>,
or mute the thread
<https:/notifications/unsubscribe-auth/ABQOXYQDSVER4PNVUULE7STQIOSFZANCNFSM4ISSF3TA>
.
|
|
Thank you for quick response helk-install.logWARNING: apt does not have a stable CLI interface. Use with caution in scripts. Reading package lists... Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] Stop one or more running containers Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] Stop one or more running containers Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] Stop one or more running containers Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] Stop one or more running containers Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] Stop one or more running containers |
|
thanks for sending.
are you using docker images for anything else on this machine?
…On Sat, Sep 7, 2019 at 9:33 AM sugarp0pe ***@***.***> wrote:
Thank you for quick response
helk-install.log
WARNING: apt does not have a stable CLI interface. Use with caution in
scripts.
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
libapr1 libaprutil1
The following NEW packages will be installed:
apache2-utils libapr1 libaprutil1
0 upgraded, 3 newly installed, 0 to remove and 0 not upgraded.
Need to get 259 kB of archives.
After this operation, 865 kB of additional disk space will be used.
Get:1 http://us.archive.ubuntu.com/ubuntu bionic/main amd64 libapr1 amd64
1.6.3-2 [90.9 kB]
Get:2 http://us.archive.ubuntu.com/ubuntu bionic/main amd64 libaprutil1
amd64 1.6.1-2 [84.4 kB]
Get:3 http://us.archive.ubuntu.com/ubuntu bionic-updates/main amd64
apache2-utils amd64 2.4.29-1ubuntu4.10 [83.9 kB]
Fetched 259 kB in 3s (103 kB/s)
Selecting previously unselected package libapr1:amd64.
(Reading database ...
(Reading database ... 5%
(Reading database ... 10%
(Reading database ... 15%
(Reading database ... 20%
(Reading database ... 25%
(Reading database ... 30%
(Reading database ... 35%
(Reading database ... 40%
(Reading database ... 45%
(Reading database ... 50%
(Reading database ... 55%
(Reading database ... 60%
(Reading database ... 65%
(Reading database ... 70%
(Reading database ... 75%
(Reading database ... 80%
(Reading database ... 85%
(Reading database ... 90%
(Reading database ... 95%
(Reading database ... 100%
(Reading database ... 102895 files and directories currently installed.)
Preparing to unpack .../libapr1_1.6.3-2_amd64.deb ...
Unpacking libapr1:amd64 (1.6.3-2) ...
Selecting previously unselected package libaprutil1:amd64.
Preparing to unpack .../libaprutil1_1.6.1-2_amd64.deb ...
Unpacking libaprutil1:amd64 (1.6.1-2) ...
Selecting previously unselected package apache2-utils.
Preparing to unpack .../apache2-utils_2.4.29-1ubuntu4.10_amd64.deb ...
Unpacking apache2-utils (2.4.29-1ubuntu4.10) ...
Setting up libapr1:amd64 (1.6.3-2) ...
Setting up libaprutil1:amd64 (1.6.1-2) ...
Setting up apache2-utils (2.4.29-1ubuntu4.10) ...
Processing triggers for man-db (2.8.3-2ubuntu0.1) ...
Processing triggers for libc-bin (2.27-3ubuntu1) ...
Adding password for user helk
Creating network "docker_helk" with driver "bridge"
Creating volume "docker_esdata" with local driver
Pulling helk-elasticsearch (
docker.elastic.co/elasticsearch/elasticsearch:7.1.0)...
7.1.0: Pulling from elasticsearch/elasticsearch
Digest:
sha256:802b6a299260dbaf21a9c57e3a634491ff788a1ea13a51598d4cd105739509c4
Status: Downloaded newer image for
docker.elastic.co/elasticsearch/elasticsearch:7.1.0
Pulling helk-kibana (docker.elastic.co/kibana/kibana:7.1.0)...
7.1.0: Pulling from kibana/kibana
Digest:
sha256:0eb53e2eb9a8846a5a4e700115a4b6e207a8f298128a45cdd28a514f708ec0f3
Status: Downloaded newer image for docker.elastic.co/kibana/kibana:7.1.0
Pulling helk-logstash (docker.elastic.co/logstash/logstash:7.1.0)...
7.1.0: Pulling from logstash/logstash
Digest:
sha256:9258bd2ef10c084a267e470e4fac7b5144e2bd932d628deab4f2c8cc2ff47dd0
Status: Downloaded newer image for
docker.elastic.co/logstash/logstash:7.1.0
Pulling helk-nginx (cyb3rward0g/helk-nginx:0.0.7)...
0.0.7: Pulling from cyb3rward0g/helk-nginx
Digest:
sha256:8cdbbd5084f1b7b046af7080a6aea0bf6be0d0e623d990107b9932f7404384e0
Status: Downloaded newer image for cyb3rward0g/helk-nginx:0.0.7
Pulling helk-zookeeper (cyb3rward0g/helk-zookeeper:2.2.0)...
2.2.0: Pulling from cyb3rward0g/helk-zookeeper
Digest:
sha256:a4439c74957b0a6c479fe5257f7ce85d6b6ea88b1377323b81cd806cdf23501b
Status: Downloaded newer image for cyb3rward0g/helk-zookeeper:2.2.0
Pulling helk-kafka-broker (cyb3rward0g/helk-kafka-broker:2.2.0)...
2.2.0: Pulling from cyb3rward0g/helk-kafka-broker
Digest:
sha256:8f4caf2b2d7ac98b254e4c3d10d67434d55ee412900520581160b92269873903
Status: Downloaded newer image for cyb3rward0g/helk-kafka-broker:2.2.0
Pulling helk-ksql-server (confluentinc/cp-ksql-server:5.1.3)...
5.1.3: Pulling from confluentinc/cp-ksql-server
Digest:
sha256:063add111cc93b1a0118f88b577e31303045d4cc08eb1d21458429f05cba4b02
Status: Downloaded newer image for confluentinc/cp-ksql-server:5.1.3
Pulling helk-ksql-cli (confluentinc/cp-ksql-cli:5.1.3)...
5.1.3: Pulling from confluentinc/cp-ksql-cli
Digest:
sha256:18c0ccb00fbf87679e16e9e0da600548fcb236a2fd173263b09e89b2d3a42cc3
Status: Downloaded newer image for confluentinc/cp-ksql-cli:5.1.3
Pulling helk-elastalert (cyb3rward0g/helk-elastalert:0.2.4)...
0.2.4: Pulling from cyb3rward0g/helk-elastalert
Digest:
sha256:dc923170fceafc962129baa8cfc733d52c5d02bbb202357baf1b753f9aa6c64d
Status: Downloaded newer image for cyb3rward0g/helk-elastalert:0.2.4
Creating helk-elasticsearch ...
�[1A�[2K
Creating helk-elasticsearch ... �[32mdone�[0m
�[1BCreating helk-kibana ...
�[1A�[2K
Creating helk-kibana ... �[32mdone�[0m
�[1BCreating helk-logstash ...
Creating helk-nginx ...
�[2A�[2K
Creating helk-logstash ... �[32mdone�[0m
�[2BCreating helk-elastalert ...
Creating helk-zookeeper ...
�[3A�[2K
Creating helk-nginx ... �[32mdone�[0m
�[3B�[2A�[2K
Creating helk-elastalert ... �[32mdone�[0m
�[2B�[1A�[2K
Creating helk-zookeeper ... �[32mdone�[0m
�[1BCreating helk-kafka-broker ...
�[1A�[2K
Creating helk-kafka-broker ... �[32mdone�[0m
�[1BCreating helk-ksql-server ...
�[1A�[2K
Creating helk-ksql-server ... �[32mdone�[0m
�[1BCreating helk-ksql-cli ...
�[1A�[2K
Creating helk-ksql-cli ... �[32mdone�[0m
�[1BAdding password for user helk
helk-elasticsearch is up-to-date
helk-kibana is up-to-date
helk-logstash is up-to-date
helk-nginx is up-to-date
helk-elastalert is up-to-date
helk-zookeeper is up-to-date
helk-kafka-broker is up-to-date
helk-ksql-server is up-to-date
helk-ksql-cli is up-to-date
885d61b0f8a5
5b868662e349
a29fd6d11d79
a45a104eca2b
885d61b0f8a5
5b868662e349
a29fd6d11d79
a45a104eca2b
Untagged: cyb3rward0g/helk-elastalert:0.2.4
Untagged: ***@***.***
:dc923170fceafc962129baa8cfc733d52c5d02bbb202357baf1b753f9aa6c64d
Deleted:
sha256:c7d5d7eed99cce73b7073770dc3c6ecc56a0a447305027ece73e4fabfa0ca51c
Deleted:
sha256:7ddfedd66acd6b1603c988457aa5cd33417affc4fd9d2e3d768e7ef327bd87e5
Deleted:
sha256:19f62ea43ccbd84698f2a9375d08a20d52a02e7f4788843a4d5390cabd3c2472
Deleted:
sha256:255396df8ad9053ed73d5a95c12d855e52ad967cd9054676efcfcd85310a1882
Deleted:
sha256:df064f144aab0c435fcb883babd6597b724d8f2b73373976f4d3ed964fbbdcee
Deleted:
sha256:91fe17dde3260a0caf19608ce8e57a69ca0b16ac42e16d489cd08ddb48cb53e9
Deleted:
sha256:6872aedee364733b71cd03b5e315ac483f9e6a0bfd61e9a15ca8c3fe7e539936
Untagged: cyb3rward0g/helk-kafka-broker:2.2.0
Untagged: ***@***.***
:8f4caf2b2d7ac98b254e4c3d10d67434d55ee412900520581160b92269873903
Deleted:
sha256:c2f7cd82ae1da69dd48c2fc2c26ae855fc8c05efb9e7a8f5d985ebd6c99fddd7
Deleted:
sha256:b9059b735d4f7ab0ab47f76fceee5c10d6674739f7d3b2cb89c6cf5db0f92293
Deleted:
sha256:52b06347f9930845994d3a549cc9ff99524b3a6ce63ed35b85fa67aa7955ecf8
Deleted:
sha256:9b055ea9f21d74cb168ef0277f39de00d15dab2a9af0e7b4c98da0c5c0516c14
Deleted:
sha256:7a3378ae3958bfa7bd8bac75f11995dfbb3c277a735e650a621714603a47a7fa
Untagged: cyb3rward0g/helk-zookeeper:2.2.0
Untagged: ***@***.***
:a4439c74957b0a6c479fe5257f7ce85d6b6ea88b1377323b81cd806cdf23501b
Deleted:
sha256:fa0e4ceb4a83035bd5d80d84cd8827f468821a4178b19df675c135a382c98357
Deleted:
sha256:b98cfe820a642bfb0eaaf25bd78f374dc387f78bc19dbdcef67f687d05294c99
Deleted:
sha256:abaec1e946404eda0c521c8eb4183450cb341d1098ec3799a5718961dbcd52c5
Deleted:
sha256:3a77b7249027c7f216acaaecefcd8241836f172c695cbdf4230491d870153478
Deleted:
sha256:a7a618294575059f3ec2fb28a2773cc519e2060479f8af32a78cdbc8e5e2283c
Deleted:
sha256:f6ea8491f794f0200308a11942febda354d3ccb7dbd8b959e56b8a57c45d8953
Untagged: cyb3rward0g/helk-nginx:0.0.7
Untagged: ***@***.***
:8cdbbd5084f1b7b046af7080a6aea0bf6be0d0e623d990107b9932f7404384e0
Deleted:
sha256:280d044b6719787259c29053d92815e5e11fed4b946d227f84d71ac3c0ec228c
Deleted:
sha256:90e53da57e1792c0f049cfea1d38f4ac3df3529eefab24ac7e0bea54acbdb426
Deleted:
sha256:717f3f4f791b01b6d2926fbb62fe3d5925b31350326ddb68c9f5f636a9c0f64d
Deleted:
sha256:5d772798c7e2b92a62cf7f07687b67748e277f50e3f313ed0490bfd176408e6b
Deleted:
sha256:02aaf8287515441c0bfd148e86821a2dc3f711a296044265e42011022ff2664c
Deleted:
sha256:9a5c1086828b3777b6c1fff86e3437f563be17695ad421397c0a7a0e5a5783b3
Deleted:
sha256:762bd884fbde30e58308cd8a21aa2e59dfef049e756015366ca808e5da1a6a59
Deleted:
sha256:8961c31eff48193478910b31c7710b7ee57c41e4f12491b6088140cfc119be26
Deleted:
sha256:e8b40fc220ff63ad06c8fc48a97bcc06a6e6e344141ca3f5eb0023a01ccfc070
Deleted:
sha256:4f0db2f651828b41116784d7299fa130c817808867c092c74de1bd63861fd564
Deleted:
sha256:d03c684c7dd711982dddd1ab0e622440c45d27b5d015020e0aef65be0c2e7c9b
Deleted:
sha256:63eed5473967cb9a5a4c98a5b1d2b6013d368bf88836aab99b5c5178c8f2f51f
Deleted:
sha256:86267d11f0c14fca869691b9b32bdd610b6ab8d9033d59ee64bdcc2cf0219bce
Deleted:
sha256:d9a8b3f912eee0b322b86fa0f6888558a468c384611c71178987b20e3a0ebafc
Deleted:
sha256:4e627d1476f22151f05e5214147d6cc6e03ad79a082f01aca6560aa75c7ade3a
Deleted:
sha256:757b76a12baba45fcbe76abbdd99723be9d94c12a2ad40354dc49ff5fbe1f5c1
Deleted:
sha256:f49017d4d5ce9c0f544c82ed5cbc0672fbcb593be77f954891b22b4d0d4c0a84
Error response from daemon: conflict: unable to delete 785f91d9f484
(cannot be forced) - image is being used by running container c3ac42108fd1
Error response from daemon: conflict: unable to delete 5901cec02503
(cannot be forced) - image is being used by running container 61a8d043c4f6
Error response from daemon: conflict: unable to delete 93ae8cd11560
(cannot be forced) - image is being used by running container f7313ed22d31
Error response from daemon: conflict: unable to delete 714b175e84e8
(cannot be forced) - image is being used by running container 22e7070b53f9
Error response from daemon: conflict: unable to delete 12ad640a1ec0
(cannot be forced) - image is being used by running container 7ee92ef1d188
"docker stop" requires at least 1 argument.
See 'docker stop --help'.
Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...]
Stop one or more running containers
"docker stop" requires at least 1 argument.
See 'docker stop --help'.
Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...]
Stop one or more running containers
"docker stop" requires at least 1 argument.
See 'docker stop --help'.
Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...]
Stop one or more running containers
Adding password for user helk
Pulling helk-nginx (cyb3rward0g/helk-nginx:0.0.7)...
0.0.7: Pulling from cyb3rward0g/helk-nginx
Digest:
sha256:8cdbbd5084f1b7b046af7080a6aea0bf6be0d0e623d990107b9932f7404384e0
Status: Downloaded newer image for cyb3rward0g/helk-nginx:0.0.7
Pulling helk-zookeeper (cyb3rward0g/helk-zookeeper:2.2.0)...
2.2.0: Pulling from cyb3rward0g/helk-zookeeper
Digest:
sha256:a4439c74957b0a6c479fe5257f7ce85d6b6ea88b1377323b81cd806cdf23501b
Status: Downloaded newer image for cyb3rward0g/helk-zookeeper:2.2.0
Pulling helk-kafka-broker (cyb3rward0g/helk-kafka-broker:2.2.0)...
2.2.0: Pulling from cyb3rward0g/helk-kafka-broker
Digest:
sha256:8f4caf2b2d7ac98b254e4c3d10d67434d55ee412900520581160b92269873903
Status: Downloaded newer image for cyb3rward0g/helk-kafka-broker:2.2.0
Pulling helk-elastalert (cyb3rward0g/helk-elastalert:0.2.4)...
0.2.4: Pulling from cyb3rward0g/helk-elastalert
Digest:
sha256:dc923170fceafc962129baa8cfc733d52c5d02bbb202357baf1b753f9aa6c64d
Status: Downloaded newer image for cyb3rward0g/helk-elastalert:0.2.4
Starting helk-elasticsearch ...
�[1A�[2K
Starting helk-elasticsearch ... �[32mdone�[0m
�[1BStarting helk-kibana ...
�[1A�[2K
Starting helk-kibana ... �[32mdone�[0m
�[1BStarting helk-logstash ...
Creating helk-nginx ...
�[2A�[2K
Starting helk-logstash ... �[32mdone�[0m
�[2BCreating helk-zookeeper ...
Creating helk-elastalert ...
�[3A�[2K
Creating helk-nginx ... �[32mdone�[0m
�[3B�[2A�[2K
Creating helk-zookeeper ... �[32mdone�[0m
�[2BCreating helk-kafka-broker ...
�[2A�[2K
Creating helk-elastalert ... �[32mdone�[0m
�[2B�[1A�[2K
Creating helk-kafka-broker ... �[32mdone�[0m
�[1BRecreating helk-ksql-server ...
�[1A�[2K
Recreating helk-ksql-server ... �[32mdone�[0m
�[1BRecreating helk-ksql-cli ...
�[1A�[2K
Recreating helk-ksql-cli ... �[32mdone�[0m
�[1B33deda66e73a
a91e80d0da9d
f7bb556d86b4
9632209fe79b
33deda66e73a
a91e80d0da9d
f7bb556d86b4
9632209fe79b
Untagged: cyb3rward0g/helk-elastalert:0.2.4
Untagged: ***@***.***
:dc923170fceafc962129baa8cfc733d52c5d02bbb202357baf1b753f9aa6c64d
Deleted:
sha256:c7d5d7eed99cce73b7073770dc3c6ecc56a0a447305027ece73e4fabfa0ca51c
Deleted:
sha256:7ddfedd66acd6b1603c988457aa5cd33417affc4fd9d2e3d768e7ef327bd87e5
Deleted:
sha256:19f62ea43ccbd84698f2a9375d08a20d52a02e7f4788843a4d5390cabd3c2472
Deleted:
sha256:255396df8ad9053ed73d5a95c12d855e52ad967cd9054676efcfcd85310a1882
Deleted:
sha256:df064f144aab0c435fcb883babd6597b724d8f2b73373976f4d3ed964fbbdcee
Deleted:
sha256:91fe17dde3260a0caf19608ce8e57a69ca0b16ac42e16d489cd08ddb48cb53e9
Deleted:
sha256:6872aedee364733b71cd03b5e315ac483f9e6a0bfd61e9a15ca8c3fe7e539936
Untagged: cyb3rward0g/helk-kafka-broker:2.2.0
Untagged: ***@***.***
:8f4caf2b2d7ac98b254e4c3d10d67434d55ee412900520581160b92269873903
Deleted:
sha256:c2f7cd82ae1da69dd48c2fc2c26ae855fc8c05efb9e7a8f5d985ebd6c99fddd7
Deleted:
sha256:b9059b735d4f7ab0ab47f76fceee5c10d6674739f7d3b2cb89c6cf5db0f92293
Deleted:
sha256:52b06347f9930845994d3a549cc9ff99524b3a6ce63ed35b85fa67aa7955ecf8
Deleted:
sha256:9b055ea9f21d74cb168ef0277f39de00d15dab2a9af0e7b4c98da0c5c0516c14
Deleted:
sha256:7a3378ae3958bfa7bd8bac75f11995dfbb3c277a735e650a621714603a47a7fa
Untagged: cyb3rward0g/helk-zookeeper:2.2.0
Untagged: ***@***.***
:a4439c74957b0a6c479fe5257f7ce85d6b6ea88b1377323b81cd806cdf23501b
Deleted:
sha256:fa0e4ceb4a83035bd5d80d84cd8827f468821a4178b19df675c135a382c98357
Deleted:
sha256:b98cfe820a642bfb0eaaf25bd78f374dc387f78bc19dbdcef67f687d05294c99
Deleted:
sha256:abaec1e946404eda0c521c8eb4183450cb341d1098ec3799a5718961dbcd52c5
Deleted:
sha256:3a77b7249027c7f216acaaecefcd8241836f172c695cbdf4230491d870153478
Deleted:
sha256:a7a618294575059f3ec2fb28a2773cc519e2060479f8af32a78cdbc8e5e2283c
Deleted:
sha256:f6ea8491f794f0200308a11942febda354d3ccb7dbd8b959e56b8a57c45d8953
Untagged: cyb3rward0g/helk-nginx:0.0.7
Untagged: ***@***.***
:8cdbbd5084f1b7b046af7080a6aea0bf6be0d0e623d990107b9932f7404384e0
Deleted:
sha256:280d044b6719787259c29053d92815e5e11fed4b946d227f84d71ac3c0ec228c
Deleted:
sha256:90e53da57e1792c0f049cfea1d38f4ac3df3529eefab24ac7e0bea54acbdb426
Deleted:
sha256:717f3f4f791b01b6d2926fbb62fe3d5925b31350326ddb68c9f5f636a9c0f64d
Deleted:
sha256:5d772798c7e2b92a62cf7f07687b67748e277f50e3f313ed0490bfd176408e6b
Deleted:
sha256:02aaf8287515441c0bfd148e86821a2dc3f711a296044265e42011022ff2664c
Deleted:
sha256:9a5c1086828b3777b6c1fff86e3437f563be17695ad421397c0a7a0e5a5783b3
Deleted:
sha256:762bd884fbde30e58308cd8a21aa2e59dfef049e756015366ca808e5da1a6a59
Deleted:
sha256:8961c31eff48193478910b31c7710b7ee57c41e4f12491b6088140cfc119be26
Deleted:
sha256:e8b40fc220ff63ad06c8fc48a97bcc06a6e6e344141ca3f5eb0023a01ccfc070
Deleted:
sha256:4f0db2f651828b41116784d7299fa130c817808867c092c74de1bd63861fd564
Deleted:
sha256:d03c684c7dd711982dddd1ab0e622440c45d27b5d015020e0aef65be0c2e7c9b
Deleted:
sha256:63eed5473967cb9a5a4c98a5b1d2b6013d368bf88836aab99b5c5178c8f2f51f
Deleted:
sha256:86267d11f0c14fca869691b9b32bdd610b6ab8d9033d59ee64bdcc2cf0219bce
Deleted:
sha256:d9a8b3f912eee0b322b86fa0f6888558a468c384611c71178987b20e3a0ebafc
Deleted:
sha256:4e627d1476f22151f05e5214147d6cc6e03ad79a082f01aca6560aa75c7ade3a
Deleted:
sha256:757b76a12baba45fcbe76abbdd99723be9d94c12a2ad40354dc49ff5fbe1f5c1
Deleted:
sha256:f49017d4d5ce9c0f544c82ed5cbc0672fbcb593be77f954891b22b4d0d4c0a84
Error response from daemon: conflict: unable to delete 785f91d9f484
(cannot be forced) - image is being used by running container b148a7e28118
Error response from daemon: conflict: unable to delete 5901cec02503
(cannot be forced) - image is being used by running container 03a56527b683
Error response from daemon: conflict: unable to delete 93ae8cd11560
(cannot be forced) - image is being used by running container f7313ed22d31
Error response from daemon: conflict: unable to delete 714b175e84e8
(cannot be forced) - image is being used by running container 22e7070b53f9
Error response from daemon: conflict: unable to delete 12ad640a1ec0
(cannot be forced) - image is being used by running container 7ee92ef1d188
Adding password for user helk
Pulling helk-elasticsearch (
docker.elastic.co/elasticsearch/elasticsearch:7.1.0)...
7.1.0: Pulling from elasticsearch/elasticsearch
Digest:
sha256:802b6a299260dbaf21a9c57e3a634491ff788a1ea13a51598d4cd105739509c4
Status: Downloaded newer image for
docker.elastic.co/elasticsearch/elasticsearch:7.1.0
Pulling helk-kibana (docker.elastic.co/kibana/kibana:7.1.0)...
7.1.0: Pulling from kibana/kibana
Digest:
sha256:0eb53e2eb9a8846a5a4e700115a4b6e207a8f298128a45cdd28a514f708ec0f3
Status: Downloaded newer image for docker.elastic.co/kibana/kibana:7.1.0
Pulling helk-logstash (docker.elastic.co/logstash/logstash:7.1.0)...
7.1.0: Pulling from logstash/logstash
Digest:
sha256:9258bd2ef10c084a267e470e4fac7b5144e2bd932d628deab4f2c8cc2ff47dd0
Status: Downloaded newer image for
docker.elastic.co/logstash/logstash:7.1.0
Pulling helk-nginx (cyb3rward0g/helk-nginx:0.0.7)...
0.0.7: Pulling from cyb3rward0g/helk-nginx
Digest:
sha256:8cdbbd5084f1b7b046af7080a6aea0bf6be0d0e623d990107b9932f7404384e0
Status: Downloaded newer image for cyb3rward0g/helk-nginx:0.0.7
Pulling helk-zookeeper (cyb3rward0g/helk-zookeeper:2.2.0)...
2.2.0: Pulling from cyb3rward0g/helk-zookeeper
Digest:
sha256:a4439c74957b0a6c479fe5257f7ce85d6b6ea88b1377323b81cd806cdf23501b
Status: Downloaded newer image for cyb3rward0g/helk-zookeeper:2.2.0
Pulling helk-kafka-broker (cyb3rward0g/helk-kafka-broker:2.2.0)...
2.2.0: Pulling from cyb3rward0g/helk-kafka-broker
Digest:
sha256:8f4caf2b2d7ac98b254e4c3d10d67434d55ee412900520581160b92269873903
Status: Downloaded newer image for cyb3rward0g/helk-kafka-broker:2.2.0
Pulling helk-ksql-server (confluentinc/cp-ksql-server:5.1.3)...
5.1.3: Pulling from confluentinc/cp-ksql-server
Digest:
sha256:063add111cc93b1a0118f88b577e31303045d4cc08eb1d21458429f05cba4b02
Status: Downloaded newer image for confluentinc/cp-ksql-server:5.1.3
Pulling helk-ksql-cli (confluentinc/cp-ksql-cli:5.1.3)...
5.1.3: Pulling from confluentinc/cp-ksql-cli
Digest:
sha256:18c0ccb00fbf87679e16e9e0da600548fcb236a2fd173263b09e89b2d3a42cc3
Status: Downloaded newer image for confluentinc/cp-ksql-cli:5.1.3
Pulling helk-elastalert (cyb3rward0g/helk-elastalert:0.2.4)...
0.2.4: Pulling from cyb3rward0g/helk-elastalert
Digest:
sha256:dc923170fceafc962129baa8cfc733d52c5d02bbb202357baf1b753f9aa6c64d
Status: Downloaded newer image for cyb3rward0g/helk-elastalert:0.2.4
Creating helk-elasticsearch ...
�[1A�[2K
Creating helk-elasticsearch ... �[32mdone�[0m
�[1BCreating helk-kibana ...
�[1A�[2K
Creating helk-kibana ... �[32mdone�[0m
�[1BCreating helk-nginx ...
Creating helk-logstash ...
�[2A�[2K
Creating helk-nginx ... �[32mdone�[0m
�[2B�[1A�[2K
Creating helk-logstash ... �[32mdone�[0m
�[1BCreating helk-elastalert ...
Creating helk-zookeeper ...
�[2A�[2K
Creating helk-elastalert ... �[32mdone�[0m
�[2B�[1A�[2K
Creating helk-zookeeper ... �[32mdone�[0m
�[1BCreating helk-kafka-broker ...
�[1A�[2K
Creating helk-kafka-broker ... �[32mdone�[0m
�[1BCreating helk-ksql-server ...
�[1A�[2K
Creating helk-ksql-server ... �[32mdone�[0m
�[1BCreating helk-ksql-cli ...
�[1A�[2K
Creating helk-ksql-cli ... �[32mdone�[0m
�[1Ba268fb4c59d6
d2a8409ecc99
a02a2e4226e7
d87ccecfa214
a268fb4c59d6
d2a8409ecc99
a02a2e4226e7
d87ccecfa214
Untagged: cyb3rward0g/helk-elastalert:0.2.4
Untagged: ***@***.***
:dc923170fceafc962129baa8cfc733d52c5d02bbb202357baf1b753f9aa6c64d
Deleted:
sha256:c7d5d7eed99cce73b7073770dc3c6ecc56a0a447305027ece73e4fabfa0ca51c
Deleted:
sha256:7ddfedd66acd6b1603c988457aa5cd33417affc4fd9d2e3d768e7ef327bd87e5
Deleted:
sha256:19f62ea43ccbd84698f2a9375d08a20d52a02e7f4788843a4d5390cabd3c2472
Deleted:
sha256:255396df8ad9053ed73d5a95c12d855e52ad967cd9054676efcfcd85310a1882
Deleted:
sha256:df064f144aab0c435fcb883babd6597b724d8f2b73373976f4d3ed964fbbdcee
Deleted:
sha256:91fe17dde3260a0caf19608ce8e57a69ca0b16ac42e16d489cd08ddb48cb53e9
Deleted:
sha256:6872aedee364733b71cd03b5e315ac483f9e6a0bfd61e9a15ca8c3fe7e539936
Untagged: cyb3rward0g/helk-kafka-broker:2.2.0
Untagged: ***@***.***
:8f4caf2b2d7ac98b254e4c3d10d67434d55ee412900520581160b92269873903
Deleted:
sha256:c2f7cd82ae1da69dd48c2fc2c26ae855fc8c05efb9e7a8f5d985ebd6c99fddd7
Deleted:
sha256:b9059b735d4f7ab0ab47f76fceee5c10d6674739f7d3b2cb89c6cf5db0f92293
Deleted:
sha256:52b06347f9930845994d3a549cc9ff99524b3a6ce63ed35b85fa67aa7955ecf8
Deleted:
sha256:9b055ea9f21d74cb168ef0277f39de00d15dab2a9af0e7b4c98da0c5c0516c14
Deleted:
sha256:7a3378ae3958bfa7bd8bac75f11995dfbb3c277a735e650a621714603a47a7fa
Untagged: cyb3rward0g/helk-zookeeper:2.2.0
Untagged: ***@***.***
:a4439c74957b0a6c479fe5257f7ce85d6b6ea88b1377323b81cd806cdf23501b
Deleted:
sha256:fa0e4ceb4a83035bd5d80d84cd8827f468821a4178b19df675c135a382c98357
Deleted:
sha256:b98cfe820a642bfb0eaaf25bd78f374dc387f78bc19dbdcef67f687d05294c99
Deleted:
sha256:abaec1e946404eda0c521c8eb4183450cb341d1098ec3799a5718961dbcd52c5
Deleted:
sha256:3a77b7249027c7f216acaaecefcd8241836f172c695cbdf4230491d870153478
Deleted:
sha256:a7a618294575059f3ec2fb28a2773cc519e2060479f8af32a78cdbc8e5e2283c
Deleted:
sha256:f6ea8491f794f0200308a11942febda354d3ccb7dbd8b959e56b8a57c45d8953
Untagged: cyb3rward0g/helk-nginx:0.0.7
Untagged: ***@***.***
:8cdbbd5084f1b7b046af7080a6aea0bf6be0d0e623d990107b9932f7404384e0
Deleted:
sha256:280d044b6719787259c29053d92815e5e11fed4b946d227f84d71ac3c0ec228c
Deleted:
sha256:90e53da57e1792c0f049cfea1d38f4ac3df3529eefab24ac7e0bea54acbdb426
Deleted:
sha256:717f3f4f791b01b6d2926fbb62fe3d5925b31350326ddb68c9f5f636a9c0f64d
Deleted:
sha256:5d772798c7e2b92a62cf7f07687b67748e277f50e3f313ed0490bfd176408e6b
Deleted:
sha256:02aaf8287515441c0bfd148e86821a2dc3f711a296044265e42011022ff2664c
Deleted:
sha256:9a5c1086828b3777b6c1fff86e3437f563be17695ad421397c0a7a0e5a5783b3
Deleted:
sha256:762bd884fbde30e58308cd8a21aa2e59dfef049e756015366ca808e5da1a6a59
Deleted:
sha256:8961c31eff48193478910b31c7710b7ee57c41e4f12491b6088140cfc119be26
Deleted:
sha256:e8b40fc220ff63ad06c8fc48a97bcc06a6e6e344141ca3f5eb0023a01ccfc070
Deleted:
sha256:4f0db2f651828b41116784d7299fa130c817808867c092c74de1bd63861fd564
Deleted:
sha256:d03c684c7dd711982dddd1ab0e622440c45d27b5d015020e0aef65be0c2e7c9b
Deleted:
sha256:63eed5473967cb9a5a4c98a5b1d2b6013d368bf88836aab99b5c5178c8f2f51f
Deleted:
sha256:86267d11f0c14fca869691b9b32bdd610b6ab8d9033d59ee64bdcc2cf0219bce
Deleted:
sha256:d9a8b3f912eee0b322b86fa0f6888558a468c384611c71178987b20e3a0ebafc
Deleted:
sha256:4e627d1476f22151f05e5214147d6cc6e03ad79a082f01aca6560aa75c7ade3a
Deleted:
sha256:757b76a12baba45fcbe76abbdd99723be9d94c12a2ad40354dc49ff5fbe1f5c1
Deleted:
sha256:f49017d4d5ce9c0f544c82ed5cbc0672fbcb593be77f954891b22b4d0d4c0a84
Error response from daemon: conflict: unable to delete 785f91d9f484
(cannot be forced) - image is being used by running container 3b8f4b16ee07
Error response from daemon: conflict: unable to delete 5901cec02503
(cannot be forced) - image is being used by running container 26ff8fb43241
Error response from daemon: conflict: unable to delete 93ae8cd11560
(cannot be forced) - image is being used by running container 6e8dd919f3ed
Error response from daemon: conflict: unable to delete 714b175e84e8
(cannot be forced) - image is being used by running container 7290a5cd257d
Error response from daemon: conflict: unable to delete 12ad640a1ec0
(cannot be forced) - image is being used by running container 3083419626d2
"docker stop" requires at least 1 argument.
See 'docker stop --help'.
Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...]
Stop one or more running containers
"docker stop" requires at least 1 argument.
See 'docker stop --help'.
Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...]
Stop one or more running containers
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#321?email_source=notifications&email_token=ABQOXYU3R334ROOJX6RV6CLQIOUTLA5CNFSM4ISSF3TKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD6EY5WA#issuecomment-529108696>,
or mute the thread
<https:/notifications/unsubscribe-auth/ABQOXYWDAG5XXEGOQGLEYV3QIOUTLANCNFSM4ISSF3TA>
.
|
|
No, only trying HELK here, it is fresh install fully updated today |
|
which option during install are you using?
Just a note, in the logs you sent it seems the remove script was ran? Thats
Ok if it is, I just want to make note of that for troubleshooting later on.
…On Sat, Sep 7, 2019 at 10:51 AM sugarp0pe ***@***.***> wrote:
No, only trying HELK here, it is fresh install fully updated today
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#321?email_source=notifications&email_token=ABQOXYTLJK3X23XU5KUNUWLQIO5WDA5CNFSM4ISSF3TKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD6E2OQY#issuecomment-529114947>,
or mute the thread
<https:/notifications/unsubscribe-auth/ABQOXYW7NFU2XKY3QU34L63QIO5WDANCNFSM4ISSF3TA>
.
|
|
Running option 2 during helk_install.sh |
|
lets try to tail the install log the same time the installer is running. then open another terminal/ssh session and run the installer with the same options as before (remove all the images beforehand as you had too) please note and reply where the install script stalls/pauses on a single line for longer than a couple minutes or if it errors out completely. Or just send the entire output of the tail log - once the install script is finished or has has taken too long to complete/finish. i think there may be some network latency issues either locally or upstream on docker repo side, either way going to work on some more output information for the script and test the same issues again tonight. |
|
If you get a chance, please follow the notes/instructions in my last comment. Just an update on my side (none of this will prevent you from progressing forward): I am still testing adding (more) verbose information for the install process and tweaking the HELK remove script. However, I have not merged/added the changes yet. I have a few more regression tests todo - later on today. |
|
Hello, docker logs elasticsearch:7.1.0[HELK-ES-DOCKER-INSTALLATION-INFO] Setting ES_JAVA_OPTS to -Xms3200m -Xmx3200m -XX:-UseConcMarkSweepGC -XX:-UseCMSInitiatingOccupancyOnly -XX:+UseG1GC [HELK-ES-DOCKER-INSTALLATION-INFO] Setting Elastic license to basic [HELK-ES-DOCKER-INSTALLATION-INFO] Running docker-entrypoint script.. {"type": "server", "timestamp": "2019-09-07T12:42:20,336+0000", "level": "INFO", "component": "o.e.e.NodeEnvironment", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/mapper/sever--vg-root)]], net usable_space [860.6gb], net total_space [914.2gb], types [ext4]" } {"type": "server", "timestamp": "2019-09-07T12:42:20,346+0000", "level": "INFO", "component": "o.e.e.NodeEnvironment", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "heap size [3.1gb], compressed ordinary object pointers [true]" } {"type": "server", "timestamp": "2019-09-07T12:42:20,351+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "node name [helk-1], node ID [tQDXBakjTMir3sRmURfvFQ], cluster name [helk-cluster]" } {"type": "server", "timestamp": "2019-09-07T12:42:20,352+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "version[7.1.0], pid[12], build[default/docker/606a173/2019-05-16T00:43:15.323135Z], OS[Linux/4.15.0-60-generic/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/12.0.1/12.0.1+12]" } {"type": "server", "timestamp": "2019-09-07T12:42:20,353+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "JVM home [/usr/share/elasticsearch/jdk]" } {"type": "server", "timestamp": "2019-09-07T12:42:20,353+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch-1373145707971171539, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Djava.locale.providers=COMPAT, -Dio.netty.allocator.type=unpooled, -Des.cgroups.hierarchy.override=/, -Xms3200m, -Xmx3200m, -XX:-UseConcMarkSweepGC, -XX:-UseCMSInitiatingOccupancyOnly, -XX:+UseG1GC, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=docker, -Des.bundled_jdk=true]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,501+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [aggs-matrix-stats]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,505+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [analysis-common]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,512+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [ingest-common]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,514+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [ingest-geoip]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,514+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [ingest-user-agent]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,515+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [lang-expression]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,515+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [lang-mustache]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,516+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [lang-painless]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,516+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [mapper-extras]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,517+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [parent-join]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,521+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [percolator]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,522+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [rank-eval]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,522+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [reindex]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,525+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [repository-url]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,526+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [transport-netty4]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,533+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-ccr]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,534+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-core]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,534+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-deprecation]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,535+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-graph]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,535+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-ilm]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,535+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-logstash]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,537+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-ml]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,545+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-monitoring]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,549+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-rollup]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,551+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-security]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,553+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-sql]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,554+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-watcher]" } {"type": "server", "timestamp": "2019-09-07T12:42:34,555+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "no plugins loaded" } {"type": "deprecation", "timestamp": "2019-09-07T12:42:48,258+0000", "level": "WARN", "component": "o.e.d.c.s.Settings", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "[discovery.zen.minimum_master_nodes] setting was deprecated in Elasticsearch and will be removed in a future release! See the breaking changes documentation for the next major version." } {"type": "server", "timestamp": "2019-09-07T12:43:05,175+0000", "level": "WARN", "component": "o.e.b.ElasticsearchUncaughtExceptionHandler", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "uncaught exception in thread [main]" , "stacktrace": ["org.elasticsearch.bootstrap.StartupException: ElasticsearchException[Failed to create native process factories for Machine Learning]; nested: FileNotFoundException[/tmp/elasticsearch-1373145707971171539/controller_log_12 (No such file or directory)];", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124) ~[elasticsearch-cli-7.1.0.jar:7.1.0]", "at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-7.1.0.jar:7.1.0]", "Caused by: org.elasticsearch.ElasticsearchException: Failed to create native process factories for Machine Learning", "at org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:433) ~[?:?]", "at org.elasticsearch.node.Node.lambda$new$9(Node.java:440) ~[elasticsearch-7.1.0.jar:7.1.0]", "at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]", "at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654) ~[?:?]", "at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]", "at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]", "at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]", "at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]", "at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]", "at org.elasticsearch.node.Node.(Node.java:443) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.node.Node.(Node.java:252) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:325) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.1.0.jar:7.1.0]", "... 6 more", "Caused by: java.io.FileNotFoundException: /tmp/elasticsearch-1373145707971171539/controller_log_12 (No such file or directory)", "at java.io.FileInputStream.open0(Native Method) ~[?:?]", "at java.io.FileInputStream.open(FileInputStream.java:213) ~[?:?]", "at java.io.FileInputStream.(FileInputStream.java:155) ~[?:?]", "at java.io.FileInputStream.(FileInputStream.java:110) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper$PrivilegedInputPipeOpener.run(NamedPipeHelper.java:288) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper$PrivilegedInputPipeOpener.run(NamedPipeHelper.java:277) ~[?:?]", "at java.security.AccessController.doPrivileged(AccessController.java:310) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper.openNamedPipeInputStream(NamedPipeHelper.java:130) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper.openNamedPipeInputStream(NamedPipeHelper.java:97) ~[?:?]", "at org.elasticsearch.xpack.ml.process.ProcessPipes.connectStreams(ProcessPipes.java:131) ~[?:?]", "at org.elasticsearch.xpack.ml.process.NativeController.(NativeController.java:61) ~[?:?]", "at org.elasticsearch.xpack.ml.process.NativeControllerHolder.getNativeController(NativeControllerHolder.java:40) ~[?:?]", "at org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:418) ~[?:?]", "at org.elasticsearch.node.Node.lambda$new$9(Node.java:440) ~[elasticsearch-7.1.0.jar:7.1.0]", "at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]", "at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654) ~[?:?]", "at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]", "at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]", "at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]", "at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]", "at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]", "at org.elasticsearch.node.Node.(Node.java:443) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.node.Node.(Node.java:252) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:325) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.1.0.jar:7.1.0]", "... 6 more"] } [HELK-ES-DOCKER-INSTALLATION-INFO] Setting ES_JAVA_OPTS to -Xms3200m -Xmx3200m -XX:-UseConcMarkSweepGC -XX:-UseCMSInitiatingOccupancyOnly -XX:+UseG1GC [HELK-ES-DOCKER-INSTALLATION-INFO] Setting Elastic license to basic [HELK-ES-DOCKER-INSTALLATION-INFO] Running docker-entrypoint script.. {"type": "server", "timestamp": "2019-09-07T12:43:16,586+0000", "level": "INFO", "component": "o.e.e.NodeEnvironment", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/mapper/sever--vg-root)]], net usable_space [860.6gb], net total_space [914.2gb], types [ext4]" } {"type": "server", "timestamp": "2019-09-07T12:43:16,597+0000", "level": "INFO", "component": "o.e.e.NodeEnvironment", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "heap size [3.1gb], compressed ordinary object pointers [true]" } {"type": "server", "timestamp": "2019-09-07T12:43:16,601+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "node name [helk-1], node ID [tQDXBakjTMir3sRmURfvFQ], cluster name [helk-cluster]" } {"type": "server", "timestamp": "2019-09-07T12:43:16,602+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "version[7.1.0], pid[12], build[default/docker/606a173/2019-05-16T00:43:15.323135Z], OS[Linux/4.15.0-60-generic/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/12.0.1/12.0.1+12]" } {"type": "server", "timestamp": "2019-09-07T12:43:16,603+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "JVM home [/usr/share/elasticsearch/jdk]" } {"type": "server", "timestamp": "2019-09-07T12:43:16,604+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch-2864629304196106528, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Djava.locale.providers=COMPAT, -Dio.netty.allocator.type=unpooled, -Des.cgroups.hierarchy.override=/, -Xms3200m, -Xmx3200m, -XX:-UseConcMarkSweepGC, -XX:-UseCMSInitiatingOccupancyOnly, -XX:+UseG1GC, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=docker, -Des.bundled_jdk=true]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,701+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [aggs-matrix-stats]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,701+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [analysis-common]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,702+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [ingest-common]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,703+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [ingest-geoip]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,704+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [ingest-user-agent]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,705+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [lang-expression]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,706+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [lang-mustache]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,708+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [lang-painless]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,708+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [mapper-extras]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,710+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [parent-join]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,710+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [percolator]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,710+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [rank-eval]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,711+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [reindex]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,711+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [repository-url]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,714+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [transport-netty4]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,715+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-ccr]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,726+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-core]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,726+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-deprecation]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,727+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-graph]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,727+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-ilm]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,729+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-logstash]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,730+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-ml]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,730+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-monitoring]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,731+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-rollup]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,732+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-security]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,733+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-sql]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,734+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-watcher]" } {"type": "server", "timestamp": "2019-09-07T12:43:19,736+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "no plugins loaded" } {"type": "deprecation", "timestamp": "2019-09-07T12:43:24,169+0000", "level": "WARN", "component": "o.e.d.c.s.Settings", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "[discovery.zen.minimum_master_nodes] setting was deprecated in Elasticsearch and will be removed in a future release! See the breaking changes documentation for the next major version." } {"type": "server", "timestamp": "2019-09-07T12:43:36,319+0000", "level": "WARN", "component": "o.e.b.ElasticsearchUncaughtExceptionHandler", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "uncaught exception in thread [main]" , "stacktrace": ["org.elasticsearch.bootstrap.StartupException: ElasticsearchException[Failed to create native process factories for Machine Learning]; nested: FileNotFoundException[/tmp/elasticsearch-2864629304196106528/controller_log_12 (No such file or directory)];", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124) ~[elasticsearch-cli-7.1.0.jar:7.1.0]", "at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-7.1.0.jar:7.1.0]", "Caused by: org.elasticsearch.ElasticsearchException: Failed to create native process factories for Machine Learning", "at org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:433) ~[?:?]", "at org.elasticsearch.node.Node.lambda$new$9(Node.java:440) ~[elasticsearch-7.1.0.jar:7.1.0]", "at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]", "at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654) ~[?:?]", "at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]", "at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]", "at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]", "at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]", "at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]", "at org.elasticsearch.node.Node.(Node.java:443) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.node.Node.(Node.java:252) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:325) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.1.0.jar:7.1.0]", "... 6 more", "Caused by: java.io.FileNotFoundException: /tmp/elasticsearch-2864629304196106528/controller_log_12 (No such file or directory)", "at java.io.FileInputStream.open0(Native Method) ~[?:?]", "at java.io.FileInputStream.open(FileInputStream.java:213) ~[?:?]", "at java.io.FileInputStream.(FileInputStream.java:155) ~[?:?]", "at java.io.FileInputStream.(FileInputStream.java:110) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper$PrivilegedInputPipeOpener.run(NamedPipeHelper.java:288) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper$PrivilegedInputPipeOpener.run(NamedPipeHelper.java:277) ~[?:?]", "at java.security.AccessController.doPrivileged(AccessController.java:310) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper.openNamedPipeInputStream(NamedPipeHelper.java:130) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper.openNamedPipeInputStream(NamedPipeHelper.java:97) ~[?:?]", "at org.elasticsearch.xpack.ml.process.ProcessPipes.connectStreams(ProcessPipes.java:131) ~[?:?]", "at org.elasticsearch.xpack.ml.process.NativeController.(NativeController.java:61) ~[?:?]", "at org.elasticsearch.xpack.ml.process.NativeControllerHolder.getNativeController(NativeControllerHolder.java:40) ~[?:?]", "at org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:418) ~[?:?]", "at org.elasticsearch.node.Node.lambda$new$9(Node.java:440) ~[elasticsearch-7.1.0.jar:7.1.0]", "at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]", "at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654) ~[?:?]", "at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]", "at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]", "at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]", "at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]", "at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]", "at org.elasticsearch.node.Node.(Node.java:443) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.node.Node.(Node.java:252) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:325) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.1.0.jar:7.1.0]", "... 6 more"] } [HELK-ES-DOCKER-INSTALLATION-INFO] Setting ES_JAVA_OPTS to -Xms3200m -Xmx3200m -XX:-UseConcMarkSweepGC -XX:-UseCMSInitiatingOccupancyOnly -XX:+UseG1GC [HELK-ES-DOCKER-INSTALLATION-INFO] Setting Elastic license to basic [HELK-ES-DOCKER-INSTALLATION-INFO] Running docker-entrypoint script.. {"type": "server", "timestamp": "2019-09-07T12:43:46,183+0000", "level": "INFO", "component": "o.e.e.NodeEnvironment", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/mapper/sever--vg-root)]], net usable_space [860.6gb], net total_space [914.2gb], types [ext4]" } {"type": "server", "timestamp": "2019-09-07T12:43:46,188+0000", "level": "INFO", "component": "o.e.e.NodeEnvironment", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "heap size [3.1gb], compressed ordinary object pointers [true]" } {"type": "server", "timestamp": "2019-09-07T12:43:46,193+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "node name [helk-1], node ID [tQDXBakjTMir3sRmURfvFQ], cluster name [helk-cluster]" } {"type": "server", "timestamp": "2019-09-07T12:43:46,194+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "version[7.1.0], pid[12], build[default/docker/606a173/2019-05-16T00:43:15.323135Z], OS[Linux/4.15.0-60-generic/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/12.0.1/12.0.1+12]" } {"type": "server", "timestamp": "2019-09-07T12:43:46,194+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "JVM home [/usr/share/elasticsearch/jdk]" } {"type": "server", "timestamp": "2019-09-07T12:43:46,195+0000", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch-3670512058239285020, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Djava.locale.providers=COMPAT, -Dio.netty.allocator.type=unpooled, -Des.cgroups.hierarchy.override=/, -Xms3200m, -Xmx3200m, -XX:-UseConcMarkSweepGC, -XX:-UseCMSInitiatingOccupancyOnly, -XX:+UseG1GC, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=docker, -Des.bundled_jdk=true]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,189+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [aggs-matrix-stats]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,191+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [analysis-common]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,192+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [ingest-common]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,193+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [ingest-geoip]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,194+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [ingest-user-agent]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,198+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [lang-expression]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,201+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [lang-mustache]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,206+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [lang-painless]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,209+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [mapper-extras]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,211+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [parent-join]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,211+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [percolator]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,212+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [rank-eval]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,212+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [reindex]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,213+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [repository-url]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,217+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [transport-netty4]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,218+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-ccr]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,223+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-core]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,224+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-deprecation]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,225+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-graph]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,225+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-ilm]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,225+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-logstash]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,229+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-ml]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,230+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-monitoring]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,230+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-rollup]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,231+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-security]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,231+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-sql]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,231+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "loaded module [x-pack-watcher]" } {"type": "server", "timestamp": "2019-09-07T12:43:49,233+0000", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "no plugins loaded" } {"type": "deprecation", "timestamp": "2019-09-07T12:43:53,630+0000", "level": "WARN", "component": "o.e.d.c.s.Settings", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "[discovery.zen.minimum_master_nodes] setting was deprecated in Elasticsearch and will be removed in a future release! See the breaking changes documentation for the next major version." } {"type": "server", "timestamp": "2019-09-07T12:44:05,915+0000", "level": "WARN", "component": "o.e.b.ElasticsearchUncaughtExceptionHandler", "cluster.name": "helk-cluster", "node.name": "helk-1", "message": "uncaught exception in thread [main]" , "stacktrace": ["org.elasticsearch.bootstrap.StartupException: ElasticsearchException[Failed to create native process factories for Machine Learning]; nested: FileNotFoundException[/tmp/elasticsearch-3670512058239285020/controller_log_12 (No such file or directory)];", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124) ~[elasticsearch-cli-7.1.0.jar:7.1.0]", "at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-7.1.0.jar:7.1.0]", "Caused by: org.elasticsearch.ElasticsearchException: Failed to create native process factories for Machine Learning", "at org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:433) ~[?:?]", "at org.elasticsearch.node.Node.lambda$new$9(Node.java:440) ~[elasticsearch-7.1.0.jar:7.1.0]", "at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]", "at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654) ~[?:?]", "at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]", "at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]", "at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]", "at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]", "at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]", "at org.elasticsearch.node.Node.(Node.java:443) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.node.Node.(Node.java:252) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:325) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.1.0.jar:7.1.0]", "... 6 more", "Caused by: java.io.FileNotFoundException: /tmp/elasticsearch-3670512058239285020/controller_log_12 (No such file or directory)", "at java.io.FileInputStream.open0(Native Method) ~[?:?]", "at java.io.FileInputStream.open(FileInputStream.java:213) ~[?:?]", "at java.io.FileInputStream.(FileInputStream.java:155) ~[?:?]", "at java.io.FileInputStream.(FileInputStream.java:110) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper$PrivilegedInputPipeOpener.run(NamedPipeHelper.java:288) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper$PrivilegedInputPipeOpener.run(NamedPipeHelper.java:277) ~[?:?]", "at java.security.AccessController.doPrivileged(AccessController.java:310) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper.openNamedPipeInputStream(NamedPipeHelper.java:130) ~[?:?]", "at org.elasticsearch.xpack.ml.utils.NamedPipeHelper.openNamedPipeInputStream(NamedPipeHelper.java:97) ~[?:?]", "at org.elasticsearch.xpack.ml.process.ProcessPipes.connectStreams(ProcessPipes.java:131) ~[?:?]", "at org.elasticsearch.xpack.ml.process.NativeController.(NativeController.java:61) ~[?:?]", "at org.elasticsearch.xpack.ml.process.NativeControllerHolder.getNativeController(NativeControllerHolder.java:40) ~[?:?]", "at org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:418) ~[?:?]", "at org.elasticsearch.node.Node.lambda$new$9(Node.java:440) ~[elasticsearch-7.1.0.jar:7.1.0]", "at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]", "at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654) ~[?:?]", "at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]", "at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]", "at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]", "at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]", "at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]", "at org.elasticsearch.node.Node.(Node.java:443) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.node.Node.(Node.java:252) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:211) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:325) ~[elasticsearch-7.1.0.jar:7.1.0]", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.1.0.jar:7.1.0]", "... 6 more"] } |
|
Nice catch. Yup that makes sense; and another thing on the radar for the remove script, we need to remove the es_data docker volume (if you dont have any data you need to keep in elasticsearch) - otherwise the trial passwords and such for elasticsearch and kibana need to be identical as last install. First, run the old remove script (only if you do not have any other docker images/things than HELK stuff) - this is a temporary fix until we can get to “perfecting” the remove script without affecting anybody's existing docker images: Then run : it may also be called “docker_esdata” but im pretty sure it should be “esdata” Then run the install script again while simultaneously running the tail command in /var/log/helk-install.log as previously mentioned Sorry for all of this hassle |
|
Hello, Output from helk-install.logAdding password for user helk Creating network "docker_helk" with driver "bridge" Creating volume "docker_esdata" with local driver Pulling helk-elasticsearch (docker.elastic.co/elasticsearch/elasticsearch:7.1.0)... 7.1.0: Pulling from elasticsearch/elasticsearch Digest: sha256:802b6a299260dbaf21a9c57e3a634491ff788a1ea13a51598d4cd105739509c4 Status: Downloaded newer image for docker.elastic.co/elasticsearch/elasticsearch:7.1.0 Pulling helk-kibana (docker.elastic.co/kibana/kibana:7.1.0)... 7.1.0: Pulling from kibana/kibana Digest: sha256:0eb53e2eb9a8846a5a4e700115a4b6e207a8f298128a45cdd28a514f708ec0f3 Status: Downloaded newer image for docker.elastic.co/kibana/kibana:7.1.0 Pulling helk-logstash (docker.elastic.co/logstash/logstash:7.1.0)... 7.1.0: Pulling from logstash/logstash Digest: sha256:9258bd2ef10c084a267e470e4fac7b5144e2bd932d628deab4f2c8cc2ff47dd0 Status: Downloaded newer image for docker.elastic.co/logstash/logstash:7.1.0 Pulling helk-nginx (cyb3rward0g/helk-nginx:0.0.7)... 0.0.7: Pulling from cyb3rward0g/helk-nginx Digest: sha256:8cdbbd5084f1b7b046af7080a6aea0bf6be0d0e623d990107b9932f7404384e0 Status: Downloaded newer image for cyb3rward0g/helk-nginx:0.0.7 Pulling helk-zookeeper (cyb3rward0g/helk-zookeeper:2.2.0)... 2.2.0: Pulling from cyb3rward0g/helk-zookeeper Digest: sha256:a4439c74957b0a6c479fe5257f7ce85d6b6ea88b1377323b81cd806cdf23501b Status: Downloaded newer image for cyb3rward0g/helk-zookeeper:2.2.0 Pulling helk-kafka-broker (cyb3rward0g/helk-kafka-broker:2.2.0)... 2.2.0: Pulling from cyb3rward0g/helk-kafka-broker Digest: sha256:8f4caf2b2d7ac98b254e4c3d10d67434d55ee412900520581160b92269873903 Status: Downloaded newer image for cyb3rward0g/helk-kafka-broker:2.2.0 Pulling helk-ksql-server (confluentinc/cp-ksql-server:5.1.3)... 5.1.3: Pulling from confluentinc/cp-ksql-server Digest: sha256:063add111cc93b1a0118f88b577e31303045d4cc08eb1d21458429f05cba4b02 Status: Downloaded newer image for confluentinc/cp-ksql-server:5.1.3 Pulling helk-ksql-cli (confluentinc/cp-ksql-cli:5.1.3)... 5.1.3: Pulling from confluentinc/cp-ksql-cli Digest: sha256:18c0ccb00fbf87679e16e9e0da600548fcb236a2fd173263b09e89b2d3a42cc3 Status: Downloaded newer image for confluentinc/cp-ksql-cli:5.1.3 Pulling helk-elastalert (cyb3rward0g/helk-elastalert:0.2.4)... 0.2.4: Pulling from cyb3rward0g/helk-elastalert Digest: sha256:dc923170fceafc962129baa8cfc733d52c5d02bbb202357baf1b753f9aa6c64d Status: Downloaded newer image for cyb3rward0g/helk-elastalert:0.2.4 Creating helk-elasticsearch ... done Creating helk-elasticsearch ... done Creating helk-kibana ... done Creating helk-kibana ... done Creating helk-nginx ... done Creating helk-logstash ... done Creating helk-nginx ... done Creating helk-logstash ... done Creating helk-elastalert ... done Creating helk-zookeeper ... done Creating helk-zookeeper ... done Creating helk-kafka-broker ... done Creating helk-elastalert ... done Creating helk-kafka-broker ... done Creating helk-ksql-server ... done Creating helk-ksql-server ... done Creating helk-ksql-cli ... done Creating helk-ksql-cli ... doneRelatively remove script I think it would be appropriate to use |
|
@sugarp0pe. regarding the consistent install issues, we honestly can not replicate this.. and apologize for the issues. Lets see if a few other things help us troubleshoot this. Can you provide the last 500 lines of the elasticsearch container: Also, how much RAM and cpu cores does the OS have? during the install can you run the following command and let me know if all the RAM gets used ? |
|
lastly... lets try option 1 for the install. |
|
Thank you for your patience @sugarp0pe . I found this related to the https://discuss.elastic.co/t/failed-to-start-machine-learning-on-elasticsearch-7-0-0/178216/7 I wonder if it is related to the hardware used to host the build? maybe? Trying to look into all the error messages showing in the Elasticsearch logs. |
|
@neu5ron, @Cyb3rWard0g great thanks for your help and awesome project! |
|
Thank you very much @sugarp0pe for your patience and details you provided for us to be able to help too. Thank you @neu5ron for all the help as well. I appreciate all you are doing for the project too and Im so looking forward to the next release 😉 @sugarp0pe please keep us posted with any issues that you have or questions that you might have about the build. The project is being prepared for a big update soon and we are hoping to get it to BETA by the end of the year, so any feedback is appreciated! ❤️ . I am adding |
|
Added details to WIKI: https:/Cyb3rWard0g/HELK/wiki/Installation |
|
After wasting more time than I would like to admit trying to understand why my very old VM server couldn't seem install HELK, I would like to share the workaround I found. I found out that by adding the line According to this site it should be possible to add it to the |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Ubuntu 18
Latest pull
The HELK gets to here and just hangs, been there for a couple hours:
I cannot hit the webpage and I get prompted for a username and password and then bad gateway.
The text was updated successfully, but these errors were encountered: