Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Influx Panic #6428

Closed
nitzan-tz opened this issue Apr 19, 2016 · 3 comments
Closed

Influx Panic #6428

nitzan-tz opened this issue Apr 19, 2016 · 3 comments
Labels
area/queries panic

Comments

@nitzan-tz
Copy link

nitzan-tz commented Apr 19, 2016 •
edited by jwilder
Loading

When try to run the following query (I am trying to create 95 percentile line from a counter ) Influx crash

SELECT percentile(non_negative_derivative(mean("ifHCOutOctets"),1m), 95) FROM "ifHCOutOctets" WHERE "instance" =~ /^$interface$/ AND $timeFilter GROUP BY time($interval) fill(null)

This is influx log

[query] 2016/04/20 00:59:13 SHOW DATABASES
[http] 2016/04/20 00:59:13 10.0.2.2 - - [20/Apr/2016:00:59:13 +0300] GET /query?q=SHOW+DATABASES&db= HTTP/1.1 200 106 http://localhost:8083/ Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.112 Safari/537.36 f3d362c3-0679-11e6-8005-000000000000 11.064605ms
[http] 2016/04/20 00:59:16 ::1 - - [20/Apr/2016:00:59:16 +0300] POST /write?consistency=&db=telegraf&precision=s&rp=default HTTP/1.1 204 0 - InfluxDBClient f5f91d80-0679-11e6-8006-000000000000 18.741894ms
[http] 2016/04/20 00:59:26 ::1 - - [20/Apr/2016:00:59:26 +0300] POST /write?consistency=&db=telegraf&precision=s&rp=default HTTP/1.1 204 0 - InfluxDBClient fbef0d67-0679-11e6-8007-000000000000 9.185044ms
[query] 2016/04/20 00:59:29 SELECT non_negative_derivative(mean(ifHCInOctets), 1m) FROM telegraf."default".ifHCInOctets WHERE instance =~ /^br-lan$/ AND time > now() - 1h GROUP BY time(1m)
[query] 2016/04/20 00:59:29 SELECT non_negative_derivative(percentile(ifHCInOctets, 95), 10s) FROM telegraf."default".ifHCInOctets WHERE instance =~ /^br-lan$/ AND time > now() - 1h GROUP BY time(1m)
[query] 2016/04/20 00:59:29 SELECT non_negative_derivative(mean(ifHCOutOctets), 1m) FROM telegraf."default".ifHCOutOctets WHERE instance =~ /^br-lan$/ AND time > now() - 1h GROUP BY time(1m)
[query] 2016/04/20 00:59:29 SELECT non_negative_derivative(percentile(ifHCOutOctets, 95), 1m) FROM telegraf."default".ifHCOutOctets WHERE instance =~ /^br-lan$/ AND time > now() - 1h GROUP BY time(1m)
[query] 2016/04/20 00:59:29 SELECT percentile(non_negative_derivative(mean(ifHCOutOctets), 1m), 95) FROM telegraf."default".ifHCOutOctets WHERE instance =~ /^br-lan$/ AND time > now() - 1h GROUP BY time(1m)
panic: interface conversion: influxql.Expr is *influxql.Call, not *influxql.VarRef

goroutine 125 [running]:
github.com/influxdata/influxdb/influxql.func·077(0x0, 0x0, 0x0, 0x0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/influxql/select.go:336 +0x1206
github.com/influxdata/influxdb/influxql.buildExprIterator(0x7fabd506b4c8, 0xc208237ec0, 0x7fabd506bbb0, 0xc208554240, 0x7fabd506b4c8, 0xc208237ec0, 0xf3ad88, 0x0, 0x0, 0xc208553e20, ...)
        /tmp/influxdb/src/github.com/influxdata/influxdb/influxql/select.go:351 +0x140e
github.com/influxdata/influxdb/influxql.func·076(0x0, 0x0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/influxql/select.go:161 +0x64c
github.com/influxdata/influxdb/influxql.buildFieldIterators(0xc20802b380, 0x1, 0x1, 0x7fabd506bbb0, 0xc208554240, 0x0, 0x0, 0xf3ad88, 0x0, 0x0, ...)
        /tmp/influxdb/src/github.com/influxdata/influxdb/influxql/select.go:197 +0x103
github.com/influxdata/influxdb/influxql.Select(0xc20826a410, 0x7fabd506bbb0, 0xc208554240, 0xc20826d300, 0x0, 0x0, 0x0, 0x0, 0x0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/influxql/select.go:81 +0xd7a
github.com/influxdata/influxdb/cluster.(*QueryExecutor).executeSelectStatement(0xc208072120, 0xc20826a410, 0x2710, 0x4, 0x3, 0xc208605f20, 0xc208605f80, 0x0, 0x0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/cluster/query_executor.go:500 +0x9c5
github.com/influxdata/influxdb/cluster.(*QueryExecutor).executeQuery(0xc208072120, 0xc208b20f40, 0xc208501b0e, 0x8, 0x2710, 0xc208605f80, 0xc208605f20)
        /tmp/influxdb/src/github.com/influxdata/influxdb/cluster/query_executor.go:146 +0x9c0
created by github.com/influxdata/influxdb/cluster.(*QueryExecutor).ExecuteQuery
        /tmp/influxdb/src/github.com/influxdata/influxdb/cluster/query_executor.go:80 +0x8c

goroutine 1 [chan receive]:
main.(*Main).Run(0xc208038340, 0xc20800a010, 0x4, 0x4, 0x0, 0x0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/cmd/influxd/main.go:94 +0x765
main.main()
        /tmp/influxdb/src/github.com/influxdata/influxdb/cmd/influxd/main.go:45 +0xdc

goroutine 7 [IO wait]:
net.(*pollDesc).Wait(0xc20800cd10, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20800cd10, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).accept(0xc20800ccb0, 0x0, 0x7fabd504f0c8, 0xc2080f0928)
        /usr/local/go/src/net/fd_unix.go:419 +0x40b
net.(*TCPListener).AcceptTCP(0xc20802a0b0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/tcpsock_posix.go:234 +0x4e
net.(*TCPListener).Accept(0xc20802a0b0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/tcpsock_posix.go:244 +0x4c
github.com/influxdata/influxdb/tcp.(*Mux).Serve(0xc20805c840, 0x7fabd5050a48, 0xc20802a0b0, 0x0, 0x0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tcp/mux.go:52 +0xc7
created by github.com/influxdata/influxdb/cmd/influxd/run.(*Server).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/cmd/influxd/run/server.go:232 +0x25e

goroutine 6 [syscall]:
os/signal.loop()
        /usr/local/go/src/os/signal/signal_unix.go:21 +0x1f
created by os/signal.init·1
        /usr/local/go/src/os/signal/signal_unix.go:27 +0x35

goroutine 26 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactCache(0xc2080316b0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:522 +0x20c
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:164 +0x251

goroutine 46 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactCache(0xc208255b80)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:522 +0x20c
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:164 +0x251

goroutine 63 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMFull(0xc208255c30)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:615 +0x16d
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:165 +0x26e

goroutine 52 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactCache(0xc208255ce0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:522 +0x20c
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:164 +0x251

goroutine 54 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc208255ce0, 0x1, 0x1)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:166 +0x299

goroutine 67 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactCache(0xc2082ce420)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:522 +0x20c
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:164 +0x251

goroutine 57 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactCache(0xc208255d90)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:522 +0x20c
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:164 +0x251

goroutine 62 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactCache(0xc208255c30)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:522 +0x20c
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:164 +0x251

goroutine 72 [chan receive]:
github.com/influxdata/influxdb/services/subscriber.(*Service).writePoints(0xc20800cc40)
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/subscriber/service.go:225 +0x99
created by github.com/influxdata/influxdb/services/subscriber.(*Service).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/subscriber/service.go:85 +0x167

goroutine 24 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc2080306e0, 0x1, 0x2)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:167 +0x2c4

goroutine 23 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc2080306e0, 0x1, 0x1)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:166 +0x299

goroutine 22 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMFull(0xc2080306e0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:615 +0x16d
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:165 +0x26e

goroutine 21 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactCache(0xc2080306e0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:522 +0x20c
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:164 +0x251

goroutine 25 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc2080306e0, 0x0, 0x3)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:168 +0x2ef

goroutine 27 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMFull(0xc2080316b0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:615 +0x16d
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:165 +0x26e

goroutine 28 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc2080316b0, 0x1, 0x1)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:166 +0x299

goroutine 29 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc2080316b0, 0x1, 0x2)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:167 +0x2c4

goroutine 30 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc2080316b0, 0x0, 0x3)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:168 +0x2ef

goroutine 31 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactCache(0xc208031760)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:522 +0x20c
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:164 +0x251

goroutine 32 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMFull(0xc208031760)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:615 +0x16d
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:165 +0x26e

goroutine 33 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc208031760, 0x1, 0x1)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:166 +0x299

goroutine 34 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc208031760, 0x1, 0x2)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:167 +0x2c4

goroutine 35 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc208031760, 0x0, 0x3)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:168 +0x2ef

goroutine 36 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactCache(0xc208031810)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:522 +0x20c
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:164 +0x251

goroutine 37 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMFull(0xc208031810)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:615 +0x16d
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:165 +0x26e

goroutine 38 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc208031810, 0x1, 0x1)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:166 +0x299

goroutine 39 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc208031810, 0x1, 0x2)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:167 +0x2c4

goroutine 40 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc208031810, 0x0, 0x3)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:168 +0x2ef

goroutine 53 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMFull(0xc208255ce0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:615 +0x16d
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:165 +0x26e

goroutine 47 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMFull(0xc208255b80)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:615 +0x16d
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:165 +0x26e

goroutine 48 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc208255b80, 0x1, 0x1)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:166 +0x299

goroutine 49 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc208255b80, 0x1, 0x2)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:167 +0x2c4

goroutine 50 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc208255b80, 0x0, 0x3)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:168 +0x2ef

goroutine 55 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc208255ce0, 0x1, 0x2)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:167 +0x2c4

goroutine 56 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc208255ce0, 0x0, 0x3)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:168 +0x2ef

goroutine 58 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMFull(0xc208255d90)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:615 +0x16d
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:165 +0x26e

goroutine 59 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc208255d90, 0x1, 0x1)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:166 +0x299

goroutine 60 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc208255d90, 0x1, 0x2)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:167 +0x2c4

goroutine 61 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc208255d90, 0x0, 0x3)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:168 +0x2ef

goroutine 64 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc208255c30, 0x1, 0x1)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:166 +0x299

goroutine 65 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc208255c30, 0x1, 0x2)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:167 +0x2c4

goroutine 66 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc208255c30, 0x0, 0x3)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:168 +0x2ef

goroutine 68 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMFull(0xc2082ce420)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:615 +0x16d
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:165 +0x26e

goroutine 69 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc2082ce420, 0x1, 0x1)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:166 +0x299

goroutine 70 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc2082ce420, 0x1, 0x2)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:167 +0x2c4

goroutine 71 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactTSMLevel(0xc2082ce420, 0x0, 0x3)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:168 +0x2ef

goroutine 73 [select]:
github.com/influxdata/influxdb/services/subscriber.(*Service).waitForMetaUpdates(0xc20800cc40)
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/subscriber/service.go:119 +0x2ad
created by github.com/influxdata/influxdb/services/subscriber.(*Service).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/subscriber/service.go:87 +0x181

goroutine 74 [select]:
github.com/influxdata/influxdb/monitor.(*Monitor).storeStatistics(0xc2080f2000)
        /tmp/influxdb/src/github.com/influxdata/influxdb/monitor/service.go:324 +0xec2
created by github.com/influxdata/influxdb/monitor.(*Monitor).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/monitor/service.go:105 +0x33c

goroutine 75 [chan receive]:
github.com/influxdata/influxdb/tcp.(*listener).Accept(0xc2080f0800, 0x0, 0x0, 0x0, 0x0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tcp/mux.go:144 +0x80
github.com/influxdata/influxdb/cluster.(*Service).serve(0xc20800cd20)
        /tmp/influxdb/src/github.com/influxdata/influxdb/cluster/service.go:112 +0x102
created by github.com/influxdata/influxdb/cluster.(*Service).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/cluster/service.go:89 +0x138

goroutine 76 [select]:
github.com/influxdata/influxdb/services/precreator.(*Service).runPrecreation(0xc20800ad70)
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/precreator/service.go:75 +0x3b7
created by github.com/influxdata/influxdb/services/precreator.(*Service).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/precreator/service.go:53 +0x20a

goroutine 77 [chan receive]:
github.com/influxdata/influxdb/tcp.(*listener).Accept(0xc2080f0810, 0x0, 0x0, 0x0, 0x0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tcp/mux.go:144 +0x80
github.com/influxdata/influxdb/services/snapshotter.(*Service).serve(0xc20805c960)
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/snapshotter/service.go:88 +0xad
created by github.com/influxdata/influxdb/services/snapshotter.(*Service).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/snapshotter/service.go:61 +0x133

goroutine 78 [chan receive]:
github.com/influxdata/influxdb/tcp.(*listener).Accept(0xc2080f0820, 0x0, 0x0, 0x0, 0x0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/tcp/mux.go:144 +0x80
github.com/influxdata/influxdb/services/copier.(*Service).serve(0xc20800aeb0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/copier/service.go:78 +0xad
created by github.com/influxdata/influxdb/services/copier.(*Service).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/copier/service.go:51 +0x133

goroutine 79 [IO wait]:
net.(*pollDesc).Wait(0xc20800d1e0, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20800d1e0, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).accept(0xc20800d180, 0x0, 0x7fabd504f0c8, 0xc208b874c0)
        /usr/local/go/src/net/fd_unix.go:419 +0x40b
net.(*TCPListener).AcceptTCP(0xc20802a318, 0xc208929d60, 0x0, 0x0)
        /usr/local/go/src/net/tcpsock_posix.go:234 +0x4e
net.(*TCPListener).Accept(0xc20802a318, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/tcpsock_posix.go:244 +0x4c
net/http.(*Server).Serve(0xc208260900, 0x7fabd5050a48, 0xc20802a318, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:1728 +0x92
net/http.Serve(0x7fabd5050a48, 0xc20802a318, 0x7fabd504f2c0, 0xc20822fa60, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:1606 +0xa1
github.com/influxdata/influxdb/services/admin.(*Service).serve(0xc20805ca80)
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/admin/service.go:116 +0x216
created by github.com/influxdata/influxdb/services/admin.(*Service).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/admin/service.go:72 +0x472

goroutine 80 [select]:
github.com/influxdata/influxdb/services/continuous_querier.(*Service).backgroundLoop(0xc20807e280)
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/continuous_querier/service.go:184 +0x5a9
created by github.com/influxdata/influxdb/services/continuous_querier.(*Service).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/continuous_querier/service.go:114 +0x291

goroutine 81 [IO wait]:
net.(*pollDesc).Wait(0xc20800d4f0, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20800d4f0, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).accept(0xc20800d490, 0x0, 0x7fabd504f0c8, 0xc208552500)
        /usr/local/go/src/net/fd_unix.go:419 +0x40b
net.(*TCPListener).AcceptTCP(0xc20802a320, 0xc20892adc8, 0x0, 0x0)
        /usr/local/go/src/net/tcpsock_posix.go:234 +0x4e
net.(*TCPListener).Accept(0xc20802a320, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/tcpsock_posix.go:244 +0x4c
net/http.(*Server).Serve(0xc2082609c0, 0x7fabd5050a48, 0xc20802a320, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:1728 +0x92
net/http.Serve(0x7fabd5050a48, 0xc20802a320, 0x7fabd5063748, 0xc2080721b0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:1606 +0xa1
github.com/influxdata/influxdb/services/httpd.(*Service).serve(0xc20805cba0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/service.go:153 +0x79
created by github.com/influxdata/influxdb/services/httpd.(*Service).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/service.go:121 +0x73b

goroutine 82 [select]:
github.com/influxdata/influxdb/services/retention.(*Service).deleteShardGroups(0xc20805cc60)
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/retention/service.go:68 +0xa08
created by github.com/influxdata/influxdb/services/retention.(*Service).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/retention/service.go:44 +0x19b

goroutine 83 [select]:
github.com/influxdata/influxdb/services/retention.(*Service).deleteShards(0xc20805cc60)
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/retention/service.go:102 +0xd03
created by github.com/influxdata/influxdb/services/retention.(*Service).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/retention/service.go:45 +0x1b8

goroutine 84 [chan receive]:
github.com/influxdata/influxdb/cmd/influxd/run.(*Server).startServerReporting(0xc2080743c0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/cmd/influxd/run/server.go:352 +0x94
created by github.com/influxdata/influxdb/cmd/influxd/run.(*Server).Open
        /tmp/influxdb/src/github.com/influxdata/influxdb/cmd/influxd/run/server.go:293 +0x1033

goroutine 85 [select]:
github.com/influxdata/influxdb/cmd/influxd/run.(*Command).monitorServerErrors(0xc208072090)
        /tmp/influxdb/src/github.com/influxdata/influxdb/cmd/influxd/run/command.go:146 +0x2dd
created by github.com/influxdata/influxdb/cmd/influxd/run.(*Command).Run
        /tmp/influxdb/src/github.com/influxdata/influxdb/cmd/influxd/run/command.go:128 +0xea2

goroutine 102 [IO wait]:
net.(*pollDesc).Wait(0xc2084921b0, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc2084921b0, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc208492150, 0xc20800f000, 0x1000, 0x1000, 0x0, 0x7fabd504f0c8, 0xc2089ab210)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc20802aad0, 0xc20800f000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc208932688, 0xc20800f000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc2085b8b40, 0xc20800f000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc208b40240)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc208b40240, 0xaffc0a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc208b40240, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc208b79a70, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc208b79a70, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc208b40240, 0xc20826a680, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc208932640, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc208932640)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 126 [runnable]:
github.com/influxdata/influxdb/influxql.(*defaultQueryManager).waitForQuery(0xc2080ec330, 0x3, 0xc208605f80, 0x0, 0xc208605ec0, 0xc2082cc120)
        /tmp/influxdb/src/github.com/influxdata/influxdb/influxql/query_manager.go:233 +0x2c3
created by github.com/influxdata/influxdb/influxql.(*defaultQueryManager).AttachQuery
        /tmp/influxdb/src/github.com/influxdata/influxdb/influxql/query_manager.go:213 +0x402

goroutine 98 [IO wait]:
net.(*pollDesc).Wait(0xc20800d8e0, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20800d8e0, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc20800d880, 0xc2084f2c00, 0x400, 0x400, 0x0, 0x7fabd504f0c8, 0xc208503640)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc20802a7e0, 0xc2084f2c00, 0x400, 0x400, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
crypto/tls.(*block).readFromUntil(0xc208477530, 0x7fabd50639c8, 0xc20802a7e0, 0x5, 0x0, 0x0)
        /usr/local/go/src/crypto/tls/conn.go:454 +0xe6
crypto/tls.(*Conn).readRecord(0xc208b4e000, 0x17, 0x0, 0x0)
        /usr/local/go/src/crypto/tls/conn.go:539 +0x2da
crypto/tls.(*Conn).Read(0xc208b4e000, 0xc20861a000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/crypto/tls/conn.go:904 +0x166
net/http.noteEOFReader.Read(0x7fabd506a4b0, 0xc208b4e000, 0xc208ba4b58, 0xc20861a000, 0x1000, 0x1000, 0xc2084e3980, 0x0, 0x0)
        /usr/local/go/src/net/http/transport.go:1270 +0x6e
net/http.(*noteEOFReader).Read(0xc208ffaf60, 0xc20861a000, 0x1000, 0x1000, 0xc208010000, 0x0, 0x0)
        <autogenerated>:125 +0xd4
bufio.(*Reader).fill(0xc208605500)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).Peek(0xc208605500, 0x1, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:132 +0xf0
net/http.(*persistConn).readLoop(0xc208ba4b00)
        /usr/local/go/src/net/http/transport.go:842 +0xa4
created by net/http.(*Transport).dialConn
        /usr/local/go/src/net/http/transport.go:660 +0xc9f

goroutine 97 [syscall, locked to thread]:
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:2232 +0x1

goroutine 108 [IO wait]:
net.(*pollDesc).Wait(0xc208a3b020, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc208a3b020, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc208a3afc0, 0xc208267000, 0x1000, 0x1000, 0x0, 0x7fabd504f0c8, 0xc208b872d8)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc20802bb20, 0xc208267000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc20852cb88, 0xc208267000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc208461500, 0xc208267000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc20808e4e0)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc20808e4e0, 0xa, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc20808e4e0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc2082526f0, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc2082526f0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc20808e4e0, 0xc2082775f0, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc20852cb40, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc20852cb40)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 109 [IO wait]:
net.(*pollDesc).Wait(0xc208a3b100, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc208a3b100, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc208a3b0a0, 0xc20854d000, 0x1000, 0x1000, 0x0, 0x7fabd504f0c8, 0xc208b86fe8)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc20802bb28, 0xc20854d000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc20852cc28, 0xc20854d000, 0x1000, 0x1000, 0xc20854205c, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc208461520, 0xc20854d000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc20808e540)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc20808e540, 0x7fabd506420a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc20808e540, 0x0, 0x0, 0x0, 0xc2082af500, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc208252720, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc208252720, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc20808e540, 0xc2082761a0, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc20852cbe0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc20852cbe0)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 107 [IO wait]:
net.(*pollDesc).Wait(0xc208a3aca0, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc208a3aca0, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc208a3ac40, 0xc2089b5000, 0x1000, 0x1000, 0x0, 0x7fabd504f0c8, 0xc208b870f8)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc20802bb18, 0xc2089b5000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc20852ca48, 0xc2089b5000, 0x1000, 0x1000, 0xc20844c05c, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc208461240, 0xc2089b5000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc2080c9c80)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc2080c9c80, 0x7fabd506420a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc2080c9c80, 0x0, 0x0, 0x0, 0xc2082af500, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc208252300, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc208252300, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc2080c9c80, 0xc208276270, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc20852ca00, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc20852ca00)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 99 [select]:
net/http.(*persistConn).writeLoop(0xc208ba4b00)
        /usr/local/go/src/net/http/transport.go:945 +0x41d
created by net/http.(*Transport).dialConn
        /usr/local/go/src/net/http/transport.go:661 +0xcbc

goroutine 94 [IO wait]:
net.(*pollDesc).Wait(0xc208492c30, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc208492c30, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc208492bd0, 0xc20861b000, 0x1000, 0x1000, 0x0, 0x7fabd504f0c8, 0xc20843fdd8)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc20802aa88, 0xc20861b000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
net/http.(*liveSwitchReader).Read(0xc208211808, 0xc20861b000, 0x1000, 0x1000, 0xc2085fa0a4, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc20891cf20, 0xc20861b000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc208b40420)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc208b40420, 0x7fabd506420a, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc208b40420, 0x0, 0x0, 0x0, 0xc2080eeb00, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc208b9c0c0, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc208b9c0c0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc208b40420, 0xc208276dd0, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc2082117c0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc2082117c0)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 124 [chan receive]:
github.com/influxdata/influxdb/services/httpd.func·002()
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:298 +0x48
created by github.com/influxdata/influxdb/services/httpd.(*Handler).serveQuery
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:300 +0xd53

goroutine 123 [IO wait]:
net.(*pollDesc).Wait(0xc208493720, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc208493720, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc2084936c0, 0xc208afe000, 0x8000, 0x8000, 0x0, 0x7fabd504f0c8, 0xc2089e2098)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc20802b1c8, 0xc208afe000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
io.Copy(0x7fabd5063da0, 0xc20802b3f0, 0x7fabd50639c8, 0xc20802b1c8, 0x0, 0x0, 0x0)
        /usr/local/go/src/io/io.go:362 +0x1f6
net/http.func·008()
        /usr/local/go/src/net/http/server.go:171 +0x7d
created by net/http.(*conn).closeNotify
        /usr/local/go/src/net/http/server.go:177 +0x2e2

goroutine 113 [semacquire]:
sync.(*Cond).Wait(0xc208a246f0)
        /usr/local/go/src/sync/cond.go:62 +0x9e
io.(*pipe).read(0xc208a246c0, 0xc208468000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/io/pipe.go:52 +0x303
io.(*PipeReader).Read(0xc20802bc20, 0xc208468000, 0x1000, 0x1000, 0xc2082466f0, 0x0, 0x0)
        /usr/local/go/src/io/pipe.go:134 +0x5b
net/http.(*liveSwitchReader).Read(0xc20852d588, 0xc208468000, 0x1000, 0x1000, 0xc00000000000000, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc208ba3440, 0xc208468000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc20808f140)
        /usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc20808f140, 0xa, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc20808f140, 0x0, 0x0, 0x0, 0xc207fdb900, 0x0, 0x0)
        /usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc208246060, 0x0, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc208246060, 0x0, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc20808f140, 0xc2082760d0, 0x0, 0x0)
        /usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc20852d540, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc20852d540)
        /usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 114 [IO wait]:
net.(*pollDesc).Wait(0xc208a3bcd0, 0x72, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc208a3bcd0, 0x0, 0x0)
        /usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc208a3bc70, 0xc2081bc000, 0x8000, 0x8000, 0x0, 0x7fabd504f0c8, 0xc208b87930)
        /usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc20802bbe8, 0xc2081bc000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:121 +0xdc
io.Copy(0x7fabd5063da0, 0xc20802bc28, 0x7fabd50639c8, 0xc20802bbe8, 0x0, 0x0, 0x0)
        /usr/local/go/src/io/io.go:362 +0x1f6
net/http.func·008()
        /usr/local/go/src/net/http/server.go:171 +0x7d
created by net/http.(*conn).closeNotify
        /usr/local/go/src/net/http/server.go:177 +0x2e2

goroutine 115 [chan receive]:
github.com/influxdata/influxdb/services/httpd.func·002()
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:298 +0x48
created by github.com/influxdata/influxdb/services/httpd.(*Handler).serveQuery
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:300 +0xd53

goroutine 122 [runnable]:
github.com/influxdata/influxdb/services/httpd.(*Handler).serveQuery(0xc2080721b0, 0x7fabd5063bd0, 0xc208b207e0, 0xc208277ba0, 0x0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:317 +0xf55
github.com/influxdata/influxdb/services/httpd.*Handler.(github.com/influxdata/influxdb/services/httpd.serveQuery)·fm(0x7fabd5063bd0, 0xc208b207e0, 0xc208277ba0, 0x0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:100 +0x4f
github.com/influxdata/influxdb/services/httpd.func·005(0x7fabd5063bd0, 0xc208b207e0, 0xc208277ba0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:630 +0x78
net/http.HandlerFunc.ServeHTTP(0xc2080eea00, 0x7fabd5063bd0, 0xc208b207e0, 0xc208277ba0)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdata/influxdb/services/httpd.func·006(0x7fabd5063af8, 0xc208b20780, 0xc208277ba0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:691 +0x288
net/http.HandlerFunc.ServeHTTP(0xc2080f0360, 0x7fabd5063af8, 0xc208b20780, 0xc208277ba0)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdata/influxdb/services/httpd.func·007(0x7fabd5063af8, 0xc208b20780, 0xc208277ba0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:700 +0xba
net/http.HandlerFunc.ServeHTTP(0xc2080eea20, 0x7fabd5063af8, 0xc208b20780, 0xc208277ba0)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdata/influxdb/services/httpd.func·008(0x7fabd5063af8, 0xc208b20780, 0xc208277ba0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:738 +0x3f4
net/http.HandlerFunc.ServeHTTP(0xc2080f0390, 0x7fabd5063af8, 0xc208b20780, 0xc208277ba0)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdata/influxdb/services/httpd.func·009(0x7fabd5063af8, 0xc208b20780, 0xc208277ba0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:748 +0x179
net/http.HandlerFunc.ServeHTTP(0xc2080f03b0, 0x7fabd5063af8, 0xc208b20780, 0xc208277ba0)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdata/influxdb/services/httpd.func·010(0x7fabd5063af8, 0xc208b20760, 0xc208277ba0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:756 +0x123
net/http.HandlerFunc.ServeHTTP(0xc2080eea40, 0x7fabd5063af8, 0xc208b20760, 0xc208277ba0)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdata/influxdb/services/httpd.func·012(0x7fabd5063ac0, 0xc208933a40, 0xc208277ba0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:775 +0x197
net/http.HandlerFunc.ServeHTTP(0xc2080eea60, 0x7fabd5063ac0, 0xc208933a40, 0xc208277ba0)
        /usr/local/go/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc20802a0b8, 0x7fabd5063ac0, 0xc208933a40, 0xc208277ba0)
        /tmp/influxdb/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdata/influxdb/services/httpd.(*Handler).ServeHTTP(0xc2080721b0, 0x7fabd5063ac0, 0xc208933a40, 0xc208277ba0)
        /tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:187 +0x467
net/http.serverHandler.ServeHTTP(0xc2082609c0, 0x7fabd5063ac0, 0xc208933a40, 0xc208277ba0)
        /usr/local/go/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc2089339a0)
        /usr/local/go/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
        /usr/local/go/src/net/http/server.go:1751 +0x35e
@jwilder
Copy link
Contributor

jwilder commented Apr 19, 2016

@nitzan-tz Can you update this issue with the items listed in our issue template?

@nitzan-tz
Copy link
Author

System info: [InfluxDB version:0.12, Ubuntu 14.464bit, and other relevant details]

Steps to reproduce:

[First Step]
Run the following query from Grafana or from Influx web

SELECT percentile(non_negative_derivative(mean("ifHCOutOctets"),1m), 95) FROM "ifHCOutOctets" WHERE "instance" =~ /^$interface$/ AND $timeFilter GROUP BY time($interval) fill(null)

Expected behavior:
Not sure if this is the way but I would like to have line of 95 percentile for SNMP counter (Interface traffic )

Actual behavior: [What actually happened]
Influx crash

Additional info: [Include gist of relevant config, logs, etc.]

[query] 2016/04/20 00:59:13 SHOW DATABASES
[http] 2016/04/20 00:59:13 10.0.2.2 - - [20/Apr/2016:00:59:13 +0300] GET /query?q=SHOW+DATABASES&db= HTTP/1.1 200 106 http://localhost:8083/ Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.112 Safari/537.36 f3d362c3-0679-11e6-8005-000000000000 11.064605ms
[http] 2016/04/20 00:59:16 ::1 - - [20/Apr/2016:00:59:16 +0300] POST /write?consistency=&db=telegraf&precision=s&rp=default HTTP/1.1 204 0 - InfluxDBClient f5f91d80-0679-11e6-8006-000000000000 18.741894ms
[http] 2016/04/20 00:59:26 ::1 - - [20/Apr/2016:00:59:26 +0300] POST /write?consistency=&db=telegraf&precision=s&rp=default HTTP/1.1 204 0 - InfluxDBClient fbef0d67-0679-11e6-8007-000000000000 9.185044ms
[query] 2016/04/20 00:59:29 SELECT non_negative_derivative(mean(ifHCInOctets), 1m) FROM telegraf."default".ifHCInOctets WHERE instance =~ /^br-lan$/ AND time > now() - 1h GROUP BY time(1m)
[query] 2016/04/20 00:59:29 SELECT non_negative_derivative(percentile(ifHCInOctets, 95), 10s) FROM telegraf."default".ifHCInOctets WHERE instance =~ /^br-lan$/ AND time > now() - 1h GROUP BY time(1m)
[query] 2016/04/20 00:59:29 SELECT non_negative_derivative(mean(ifHCOutOctets), 1m) FROM telegraf."default".ifHCOutOctets WHERE instance =~ /^br-lan$/ AND time > now() - 1h GROUP BY time(1m)
[query] 2016/04/20 00:59:29 SELECT non_negative_derivative(percentile(ifHCOutOctets, 95), 1m) FROM telegraf."default".ifHCOutOctets WHERE instance =~ /^br-lan$/ AND time > now() - 1h GROUP BY time(1m)
[query] 2016/04/20 00:59:29 SELECT percentile(non_negative_derivative(mean(ifHCOutOctets), 1m), 95) FROM telegraf."default".ifHCOutOctets WHERE instance =~ /^br-lan$/ AND time > now() - 1h GROUP BY time(1m)
panic: interface conversion: influxql.Expr is *influxql.Call, not *influxql.VarRef

goroutine 125 [running]:
github.com/influxdata/influxdb/influxql.func·077(0x0, 0x0, 0x0, 0x0)
/tmp/influxdb/src/github.com/influxdata/influxdb/influxql/select.go:336 +0x1206
github.com/influxdata/influxdb/influxql.buildExprIterator(0x7fabd506b4c8, 0xc208237ec0, 0x7fabd506bbb0, 0xc208554240, 0x7fabd506b4c8, 0xc208237ec0, 0xf3ad88, 0x0, 0x0, 0xc208553e20, ...)
/tmp/influxdb/src/github.com/influxdata/influxdb/influxql/select.go:351 +0x140e
github.com/influxdata/influxdb/influxql.func·076(0x0, 0x0)
/tmp/influxdb/src/github.com/influxdata/influxdb/influxql/select.go:161 +0x64c
github.com/influxdata/influxdb/influxql.buildFieldIterators(0xc20802b380, 0x1, 0x1, 0x7fabd506bbb0, 0xc208554240, 0x0, 0x0, 0xf3ad88, 0x0, 0x0, ...)
/tmp/influxdb/src/github.com/influxdata/influxdb/influxql/select.go:197 +0x103
github.com/influxdata/influxdb/influxql.Select(0xc20826a410, 0x7fabd506bbb0, 0xc208554240, 0xc20826d300, 0x0, 0x0, 0x0, 0x0, 0x0)
/tmp/influxdb/src/github.com/influxdata/influxdb/influxql/select.go:81 +0xd7a
github.com/influxdata/influxdb/cluster.(QueryExecutor).executeSelectStatement(0xc208072120, 0xc20826a410, 0x2710, 0x4, 0x3, 0xc208605f20, 0xc208605f80, 0x0, 0x0)
/tmp/influxdb/src/github.com/influxdata/influxdb/cluster/query_executor.go:500 +0x9c5
github.com/influxdata/influxdb/cluster.(QueryExecutor).executeQuery(0xc208072120, 0xc208b20f40, 0xc208501b0e, 0x8, 0x2710, 0xc208605f80, 0xc208605f20)
/tmp/influxdb/src/github.com/influxdata/influxdb/cluster/query_executor.go:146 +0x9c0
created by github.com/influxdata/influxdb/cluster.(*QueryExecutor).ExecuteQuery
/tmp/influxdb/src/github.com/influxdata/influxdb/cluster/query_executor.go:80 +0x8c

goroutine 1 [chan receive]:
main.(*Main).Run(0xc208038340, 0xc20800a010, 0x4, 0x4, 0x0, 0x0)
/tmp/influxdb/src/github.com/influxdata/influxdb/cmd/influxd/main.go:94 +0x765
main.main()
/tmp/influxdb/src/github.com/influxdata/influxdb/cmd/influxd/main.go:45 +0xdc

goroutine 7 [IO wait]:
net.(pollDesc).Wait(0xc20800cd10, 0x72, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(pollDesc).WaitRead(0xc20800cd10, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(netFD).accept(0xc20800ccb0, 0x0, 0x7fabd504f0c8, 0xc2080f0928)
/usr/local/go/src/net/fd_unix.go:419 +0x40b
net.(TCPListener).AcceptTCP(0xc20802a0b0, 0x0, 0x0, 0x0)
/usr/local/go/src/net/tcpsock_posix.go:234 +0x4e
net.(TCPListener).Accept(0xc20802a0b0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/net/tcpsock_posix.go:244 +0x4c
github.com/influxdata/influxdb/tcp.(Mux).Serve(0xc20805c840, 0x7fabd5050a48, 0xc20802a0b0, 0x0, 0x0)
/tmp/influxdb/src/github.com/influxdata/influxdb/tcp/mux.go:52 +0xc7
created by github.com/influxdata/influxdb/cmd/influxd/run.(*Server).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/cmd/influxd/run/server.go:232 +0x25e

goroutine 6 [syscall]:
os/signal.loop()
/usr/local/go/src/os/signal/signal_unix.go:21 +0x1f
created by os/signal.init·1
/usr/local/go/src/os/signal/signal_unix.go:27 +0x35

goroutine 26 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactCache(0xc2080316b0)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:522 +0x20c
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:164 +0x251

goroutine 46 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactCache(0xc208255b80)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:522 +0x20c
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:164 +0x251

goroutine 63 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMFull(0xc208255c30)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:615 +0x16d
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:165 +0x26e

goroutine 52 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactCache(0xc208255ce0)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:522 +0x20c
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:164 +0x251

goroutine 54 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc208255ce0, 0x1, 0x1)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:166 +0x299

goroutine 67 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactCache(0xc2082ce420)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:522 +0x20c
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:164 +0x251

goroutine 57 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactCache(0xc208255d90)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:522 +0x20c
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:164 +0x251

goroutine 62 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactCache(0xc208255c30)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:522 +0x20c
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:164 +0x251

goroutine 72 [chan receive]:
github.com/influxdata/influxdb/services/subscriber.(Service).writePoints(0xc20800cc40)
/tmp/influxdb/src/github.com/influxdata/influxdb/services/subscriber/service.go:225 +0x99
created by github.com/influxdata/influxdb/services/subscriber.(Service).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/services/subscriber/service.go:85 +0x167

goroutine 24 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc2080306e0, 0x1, 0x2)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:167 +0x2c4

goroutine 23 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc2080306e0, 0x1, 0x1)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:166 +0x299

goroutine 22 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMFull(0xc2080306e0)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:615 +0x16d
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:165 +0x26e

goroutine 21 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactCache(0xc2080306e0)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:522 +0x20c
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:164 +0x251

goroutine 25 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc2080306e0, 0x0, 0x3)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:168 +0x2ef

goroutine 27 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMFull(0xc2080316b0)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:615 +0x16d
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:165 +0x26e

goroutine 28 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc2080316b0, 0x1, 0x1)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:166 +0x299

goroutine 29 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc2080316b0, 0x1, 0x2)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:167 +0x2c4

goroutine 30 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc2080316b0, 0x0, 0x3)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:168 +0x2ef

goroutine 31 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactCache(0xc208031760)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:522 +0x20c
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:164 +0x251

goroutine 32 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMFull(0xc208031760)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:615 +0x16d
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:165 +0x26e

goroutine 33 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc208031760, 0x1, 0x1)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:166 +0x299

goroutine 34 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc208031760, 0x1, 0x2)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:167 +0x2c4

goroutine 35 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc208031760, 0x0, 0x3)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:168 +0x2ef

goroutine 36 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactCache(0xc208031810)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:522 +0x20c
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:164 +0x251

goroutine 37 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMFull(0xc208031810)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:615 +0x16d
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:165 +0x26e

goroutine 38 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc208031810, 0x1, 0x1)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:166 +0x299

goroutine 39 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc208031810, 0x1, 0x2)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:167 +0x2c4

goroutine 40 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc208031810, 0x0, 0x3)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:168 +0x2ef

goroutine 53 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMFull(0xc208255ce0)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:615 +0x16d
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:165 +0x26e

goroutine 47 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMFull(0xc208255b80)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:615 +0x16d
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:165 +0x26e

goroutine 48 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc208255b80, 0x1, 0x1)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:166 +0x299

goroutine 49 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc208255b80, 0x1, 0x2)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:167 +0x2c4

goroutine 50 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc208255b80, 0x0, 0x3)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:168 +0x2ef

goroutine 55 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc208255ce0, 0x1, 0x2)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:167 +0x2c4

goroutine 56 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc208255ce0, 0x0, 0x3)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:168 +0x2ef

goroutine 58 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMFull(0xc208255d90)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:615 +0x16d
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:165 +0x26e

goroutine 59 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc208255d90, 0x1, 0x1)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:166 +0x299

goroutine 60 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc208255d90, 0x1, 0x2)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:167 +0x2c4

goroutine 61 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc208255d90, 0x0, 0x3)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:168 +0x2ef

goroutine 64 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc208255c30, 0x1, 0x1)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:166 +0x299

goroutine 65 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc208255c30, 0x1, 0x2)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:167 +0x2c4

goroutine 66 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc208255c30, 0x0, 0x3)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:168 +0x2ef

goroutine 68 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMFull(0xc2082ce420)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:615 +0x16d
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:165 +0x26e

goroutine 69 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc2082ce420, 0x1, 0x1)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:166 +0x299

goroutine 70 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc2082ce420, 0x1, 0x2)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:167 +0x2c4

goroutine 71 [sleep]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).compactTSMLevel(0xc2082ce420, 0x0, 0x3)
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:551 +0x181
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(Engine).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:168 +0x2ef

goroutine 73 [select]:
github.com/influxdata/influxdb/services/subscriber.(Service).waitForMetaUpdates(0xc20800cc40)
/tmp/influxdb/src/github.com/influxdata/influxdb/services/subscriber/service.go:119 +0x2ad
created by github.com/influxdata/influxdb/services/subscriber.(Service).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/services/subscriber/service.go:87 +0x181

goroutine 74 [select]:
github.com/influxdata/influxdb/monitor.(Monitor).storeStatistics(0xc2080f2000)
/tmp/influxdb/src/github.com/influxdata/influxdb/monitor/service.go:324 +0xec2
created by github.com/influxdata/influxdb/monitor.(Monitor).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/monitor/service.go:105 +0x33c

goroutine 75 [chan receive]:
github.com/influxdata/influxdb/tcp.(listener).Accept(0xc2080f0800, 0x0, 0x0, 0x0, 0x0)
/tmp/influxdb/src/github.com/influxdata/influxdb/tcp/mux.go:144 +0x80
github.com/influxdata/influxdb/cluster.(Service).serve(0xc20800cd20)
/tmp/influxdb/src/github.com/influxdata/influxdb/cluster/service.go:112 +0x102
created by github.com/influxdata/influxdb/cluster.(*Service).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/cluster/service.go:89 +0x138

goroutine 76 [select]:
github.com/influxdata/influxdb/services/precreator.(Service).runPrecreation(0xc20800ad70)
/tmp/influxdb/src/github.com/influxdata/influxdb/services/precreator/service.go:75 +0x3b7
created by github.com/influxdata/influxdb/services/precreator.(Service).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/services/precreator/service.go:53 +0x20a

goroutine 77 [chan receive]:
github.com/influxdata/influxdb/tcp.(listener).Accept(0xc2080f0810, 0x0, 0x0, 0x0, 0x0)
/tmp/influxdb/src/github.com/influxdata/influxdb/tcp/mux.go:144 +0x80
github.com/influxdata/influxdb/services/snapshotter.(Service).serve(0xc20805c960)
/tmp/influxdb/src/github.com/influxdata/influxdb/services/snapshotter/service.go:88 +0xad
created by github.com/influxdata/influxdb/services/snapshotter.(*Service).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/services/snapshotter/service.go:61 +0x133

goroutine 78 [chan receive]:
github.com/influxdata/influxdb/tcp.(listener).Accept(0xc2080f0820, 0x0, 0x0, 0x0, 0x0)
/tmp/influxdb/src/github.com/influxdata/influxdb/tcp/mux.go:144 +0x80
github.com/influxdata/influxdb/services/copier.(Service).serve(0xc20800aeb0)
/tmp/influxdb/src/github.com/influxdata/influxdb/services/copier/service.go:78 +0xad
created by github.com/influxdata/influxdb/services/copier.(*Service).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/services/copier/service.go:51 +0x133

goroutine 79 [IO wait]:
net.(pollDesc).Wait(0xc20800d1e0, 0x72, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(pollDesc).WaitRead(0xc20800d1e0, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(netFD).accept(0xc20800d180, 0x0, 0x7fabd504f0c8, 0xc208b874c0)
/usr/local/go/src/net/fd_unix.go:419 +0x40b
net.(TCPListener).AcceptTCP(0xc20802a318, 0xc208929d60, 0x0, 0x0)
/usr/local/go/src/net/tcpsock_posix.go:234 +0x4e
net.(TCPListener).Accept(0xc20802a318, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/net/tcpsock_posix.go:244 +0x4c
net/http.(Server).Serve(0xc208260900, 0x7fabd5050a48, 0xc20802a318, 0x0, 0x0)
/usr/local/go/src/net/http/server.go:1728 +0x92
net/http.Serve(0x7fabd5050a48, 0xc20802a318, 0x7fabd504f2c0, 0xc20822fa60, 0x0, 0x0)
/usr/local/go/src/net/http/server.go:1606 +0xa1
github.com/influxdata/influxdb/services/admin.(Service).serve(0xc20805ca80)
/tmp/influxdb/src/github.com/influxdata/influxdb/services/admin/service.go:116 +0x216
created by github.com/influxdata/influxdb/services/admin.(Service).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/services/admin/service.go:72 +0x472

goroutine 80 [select]:
github.com/influxdata/influxdb/services/continuous_querier.(Service).backgroundLoop(0xc20807e280)
/tmp/influxdb/src/github.com/influxdata/influxdb/services/continuous_querier/service.go:184 +0x5a9
created by github.com/influxdata/influxdb/services/continuous_querier.(Service).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/services/continuous_querier/service.go:114 +0x291

goroutine 81 [IO wait]:
net.(pollDesc).Wait(0xc20800d4f0, 0x72, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(pollDesc).WaitRead(0xc20800d4f0, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(netFD).accept(0xc20800d490, 0x0, 0x7fabd504f0c8, 0xc208552500)
/usr/local/go/src/net/fd_unix.go:419 +0x40b
net.(TCPListener).AcceptTCP(0xc20802a320, 0xc20892adc8, 0x0, 0x0)
/usr/local/go/src/net/tcpsock_posix.go:234 +0x4e
net.(TCPListener).Accept(0xc20802a320, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/net/tcpsock_posix.go:244 +0x4c
net/http.(Server).Serve(0xc2082609c0, 0x7fabd5050a48, 0xc20802a320, 0x0, 0x0)
/usr/local/go/src/net/http/server.go:1728 +0x92
net/http.Serve(0x7fabd5050a48, 0xc20802a320, 0x7fabd5063748, 0xc2080721b0, 0x0, 0x0)
/usr/local/go/src/net/http/server.go:1606 +0xa1
github.com/influxdata/influxdb/services/httpd.(Service).serve(0xc20805cba0)
/tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/service.go:153 +0x79
created by github.com/influxdata/influxdb/services/httpd.(Service).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/service.go:121 +0x73b

goroutine 82 [select]:
github.com/influxdata/influxdb/services/retention.(Service).deleteShardGroups(0xc20805cc60)
/tmp/influxdb/src/github.com/influxdata/influxdb/services/retention/service.go:68 +0xa08
created by github.com/influxdata/influxdb/services/retention.(Service).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/services/retention/service.go:44 +0x19b

goroutine 83 [select]:
github.com/influxdata/influxdb/services/retention.(Service).deleteShards(0xc20805cc60)
/tmp/influxdb/src/github.com/influxdata/influxdb/services/retention/service.go:102 +0xd03
created by github.com/influxdata/influxdb/services/retention.(Service).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/services/retention/service.go:45 +0x1b8

goroutine 84 [chan receive]:
github.com/influxdata/influxdb/cmd/influxd/run.(Server).startServerReporting(0xc2080743c0)
/tmp/influxdb/src/github.com/influxdata/influxdb/cmd/influxd/run/server.go:352 +0x94
created by github.com/influxdata/influxdb/cmd/influxd/run.(Server).Open
/tmp/influxdb/src/github.com/influxdata/influxdb/cmd/influxd/run/server.go:293 +0x1033

goroutine 85 [select]:
github.com/influxdata/influxdb/cmd/influxd/run.(Command).monitorServerErrors(0xc208072090)
/tmp/influxdb/src/github.com/influxdata/influxdb/cmd/influxd/run/command.go:146 +0x2dd
created by github.com/influxdata/influxdb/cmd/influxd/run.(Command).Run
/tmp/influxdb/src/github.com/influxdata/influxdb/cmd/influxd/run/command.go:128 +0xea2

goroutine 102 [IO wait]:
net.(pollDesc).Wait(0xc2084921b0, 0x72, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(pollDesc).WaitRead(0xc2084921b0, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(netFD).Read(0xc208492150, 0xc20800f000, 0x1000, 0x1000, 0x0, 0x7fabd504f0c8, 0xc2089ab210)
/usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(conn).Read(0xc20802aad0, 0xc20800f000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:121 +0xdc
net/http.(liveSwitchReader).Read(0xc208932688, 0xc20800f000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/http/server.go:214 +0xab
io.(LimitedReader).Read(0xc2085b8b40, 0xc20800f000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/io/io.go:408 +0xce
bufio.(Reader).fill(0xc208b40240)
/usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(Reader).ReadSlice(0xc208b40240, 0xaffc0a, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(Reader).ReadLine(0xc208b40240, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(Reader).readLineSlice(0xc208b79a70, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(Reader).ReadLine(0xc208b79a70, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc208b40240, 0xc20826a680, 0x0, 0x0)
/usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(conn).readRequest(0xc208932640, 0x0, 0x0, 0x0)
/usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(conn).serve(0xc208932640)
/usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(Server).Serve
/usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 126 [runnable]:
github.com/influxdata/influxdb/influxql.(defaultQueryManager).waitForQuery(0xc2080ec330, 0x3, 0xc208605f80, 0x0, 0xc208605ec0, 0xc2082cc120)
/tmp/influxdb/src/github.com/influxdata/influxdb/influxql/query_manager.go:233 +0x2c3
created by github.com/influxdata/influxdb/influxql.(defaultQueryManager).AttachQuery
/tmp/influxdb/src/github.com/influxdata/influxdb/influxql/query_manager.go:213 +0x402

goroutine 98 [IO wait]:
net.(pollDesc).Wait(0xc20800d8e0, 0x72, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(pollDesc).WaitRead(0xc20800d8e0, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(netFD).Read(0xc20800d880, 0xc2084f2c00, 0x400, 0x400, 0x0, 0x7fabd504f0c8, 0xc208503640)
/usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(conn).Read(0xc20802a7e0, 0xc2084f2c00, 0x400, 0x400, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:121 +0xdc
crypto/tls.(block).readFromUntil(0xc208477530, 0x7fabd50639c8, 0xc20802a7e0, 0x5, 0x0, 0x0)
/usr/local/go/src/crypto/tls/conn.go:454 +0xe6
crypto/tls.(Conn).readRecord(0xc208b4e000, 0x17, 0x0, 0x0)
/usr/local/go/src/crypto/tls/conn.go:539 +0x2da
crypto/tls.(Conn).Read(0xc208b4e000, 0xc20861a000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/crypto/tls/conn.go:904 +0x166
net/http.noteEOFReader.Read(0x7fabd506a4b0, 0xc208b4e000, 0xc208ba4b58, 0xc20861a000, 0x1000, 0x1000, 0xc2084e3980, 0x0, 0x0)
/usr/local/go/src/net/http/transport.go:1270 +0x6e
net/http.(noteEOFReader).Read(0xc208ffaf60, 0xc20861a000, 0x1000, 0x1000, 0xc208010000, 0x0, 0x0)
:125 +0xd4
bufio.(Reader).fill(0xc208605500)
/usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(Reader).Peek(0xc208605500, 0x1, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/bufio/bufio.go:132 +0xf0
net/http.(persistConn).readLoop(0xc208ba4b00)
/usr/local/go/src/net/http/transport.go:842 +0xa4
created by net/http.(Transport).dialConn
/usr/local/go/src/net/http/transport.go:660 +0xc9f

goroutine 97 [syscall, locked to thread]:
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:2232 +0x1

goroutine 108 [IO wait]:
net.(pollDesc).Wait(0xc208a3b020, 0x72, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(pollDesc).WaitRead(0xc208a3b020, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(netFD).Read(0xc208a3afc0, 0xc208267000, 0x1000, 0x1000, 0x0, 0x7fabd504f0c8, 0xc208b872d8)
/usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(conn).Read(0xc20802bb20, 0xc208267000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:121 +0xdc
net/http.(liveSwitchReader).Read(0xc20852cb88, 0xc208267000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/http/server.go:214 +0xab
io.(LimitedReader).Read(0xc208461500, 0xc208267000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/io/io.go:408 +0xce
bufio.(Reader).fill(0xc20808e4e0)
/usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(Reader).ReadSlice(0xc20808e4e0, 0xa, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(Reader).ReadLine(0xc20808e4e0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(Reader).readLineSlice(0xc2082526f0, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(Reader).ReadLine(0xc2082526f0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc20808e4e0, 0xc2082775f0, 0x0, 0x0)
/usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(conn).readRequest(0xc20852cb40, 0x0, 0x0, 0x0)
/usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(conn).serve(0xc20852cb40)
/usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(Server).Serve
/usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 109 [IO wait]:
net.(pollDesc).Wait(0xc208a3b100, 0x72, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(pollDesc).WaitRead(0xc208a3b100, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(netFD).Read(0xc208a3b0a0, 0xc20854d000, 0x1000, 0x1000, 0x0, 0x7fabd504f0c8, 0xc208b86fe8)
/usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(conn).Read(0xc20802bb28, 0xc20854d000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:121 +0xdc
net/http.(liveSwitchReader).Read(0xc20852cc28, 0xc20854d000, 0x1000, 0x1000, 0xc20854205c, 0x0, 0x0)
/usr/local/go/src/net/http/server.go:214 +0xab
io.(LimitedReader).Read(0xc208461520, 0xc20854d000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/io/io.go:408 +0xce
bufio.(Reader).fill(0xc20808e540)
/usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(Reader).ReadSlice(0xc20808e540, 0x7fabd506420a, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(Reader).ReadLine(0xc20808e540, 0x0, 0x0, 0x0, 0xc2082af500, 0x0, 0x0)
/usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(Reader).readLineSlice(0xc208252720, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(Reader).ReadLine(0xc208252720, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc20808e540, 0xc2082761a0, 0x0, 0x0)
/usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(conn).readRequest(0xc20852cbe0, 0x0, 0x0, 0x0)
/usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(conn).serve(0xc20852cbe0)
/usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(Server).Serve
/usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 107 [IO wait]:
net.(pollDesc).Wait(0xc208a3aca0, 0x72, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(pollDesc).WaitRead(0xc208a3aca0, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(netFD).Read(0xc208a3ac40, 0xc2089b5000, 0x1000, 0x1000, 0x0, 0x7fabd504f0c8, 0xc208b870f8)
/usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(conn).Read(0xc20802bb18, 0xc2089b5000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:121 +0xdc
net/http.(liveSwitchReader).Read(0xc20852ca48, 0xc2089b5000, 0x1000, 0x1000, 0xc20844c05c, 0x0, 0x0)
/usr/local/go/src/net/http/server.go:214 +0xab
io.(LimitedReader).Read(0xc208461240, 0xc2089b5000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/io/io.go:408 +0xce
bufio.(Reader).fill(0xc2080c9c80)
/usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(Reader).ReadSlice(0xc2080c9c80, 0x7fabd506420a, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(Reader).ReadLine(0xc2080c9c80, 0x0, 0x0, 0x0, 0xc2082af500, 0x0, 0x0)
/usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(Reader).readLineSlice(0xc208252300, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(Reader).ReadLine(0xc208252300, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc2080c9c80, 0xc208276270, 0x0, 0x0)
/usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(conn).readRequest(0xc20852ca00, 0x0, 0x0, 0x0)
/usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(conn).serve(0xc20852ca00)
/usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(Server).Serve
/usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 99 [select]:
net/http.(persistConn).writeLoop(0xc208ba4b00)
/usr/local/go/src/net/http/transport.go:945 +0x41d
created by net/http.(Transport).dialConn
/usr/local/go/src/net/http/transport.go:661 +0xcbc

goroutine 94 [IO wait]:
net.(pollDesc).Wait(0xc208492c30, 0x72, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(pollDesc).WaitRead(0xc208492c30, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(netFD).Read(0xc208492bd0, 0xc20861b000, 0x1000, 0x1000, 0x0, 0x7fabd504f0c8, 0xc20843fdd8)
/usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(conn).Read(0xc20802aa88, 0xc20861b000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:121 +0xdc
net/http.(liveSwitchReader).Read(0xc208211808, 0xc20861b000, 0x1000, 0x1000, 0xc2085fa0a4, 0x0, 0x0)
/usr/local/go/src/net/http/server.go:214 +0xab
io.(LimitedReader).Read(0xc20891cf20, 0xc20861b000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/io/io.go:408 +0xce
bufio.(Reader).fill(0xc208b40420)
/usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(Reader).ReadSlice(0xc208b40420, 0x7fabd506420a, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(Reader).ReadLine(0xc208b40420, 0x0, 0x0, 0x0, 0xc2080eeb00, 0x0, 0x0)
/usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(Reader).readLineSlice(0xc208b9c0c0, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(Reader).ReadLine(0xc208b9c0c0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc208b40420, 0xc208276dd0, 0x0, 0x0)
/usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(conn).readRequest(0xc2082117c0, 0x0, 0x0, 0x0)
/usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(conn).serve(0xc2082117c0)
/usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(Server).Serve
/usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 124 [chan receive]:
github.com/influxdata/influxdb/services/httpd.func·002()
/tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:298 +0x48
created by github.com/influxdata/influxdb/services/httpd.(*Handler).serveQuery
/tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:300 +0xd53

goroutine 123 [IO wait]:
net.(pollDesc).Wait(0xc208493720, 0x72, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(pollDesc).WaitRead(0xc208493720, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(netFD).Read(0xc2084936c0, 0xc208afe000, 0x8000, 0x8000, 0x0, 0x7fabd504f0c8, 0xc2089e2098)
/usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(conn).Read(0xc20802b1c8, 0xc208afe000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:121 +0xdc
io.Copy(0x7fabd5063da0, 0xc20802b3f0, 0x7fabd50639c8, 0xc20802b1c8, 0x0, 0x0, 0x0)
/usr/local/go/src/io/io.go:362 +0x1f6
net/http.func·008()
/usr/local/go/src/net/http/server.go:171 +0x7d
created by net/http.(*conn).closeNotify
/usr/local/go/src/net/http/server.go:177 +0x2e2

goroutine 113 [semacquire]:
sync.(Cond).Wait(0xc208a246f0)
/usr/local/go/src/sync/cond.go:62 +0x9e
io.(pipe).read(0xc208a246c0, 0xc208468000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/io/pipe.go:52 +0x303
io.(PipeReader).Read(0xc20802bc20, 0xc208468000, 0x1000, 0x1000, 0xc2082466f0, 0x0, 0x0)
/usr/local/go/src/io/pipe.go:134 +0x5b
net/http.(liveSwitchReader).Read(0xc20852d588, 0xc208468000, 0x1000, 0x1000, 0xc00000000000000, 0x0, 0x0)
/usr/local/go/src/net/http/server.go:214 +0xab
io.(LimitedReader).Read(0xc208ba3440, 0xc208468000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/io/io.go:408 +0xce
bufio.(Reader).fill(0xc20808f140)
/usr/local/go/src/bufio/bufio.go:97 +0x1ce
bufio.(Reader).ReadSlice(0xc20808f140, 0xa, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/bufio/bufio.go:295 +0x257
bufio.(Reader).ReadLine(0xc20808f140, 0x0, 0x0, 0x0, 0xc207fdb900, 0x0, 0x0)
/usr/local/go/src/bufio/bufio.go:324 +0x62
net/textproto.(Reader).readLineSlice(0xc208246060, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(Reader).ReadLine(0xc208246060, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc20808f140, 0xc2082760d0, 0x0, 0x0)
/usr/local/go/src/net/http/request.go:598 +0xcb
net/http.(conn).readRequest(0xc20852d540, 0x0, 0x0, 0x0)
/usr/local/go/src/net/http/server.go:586 +0x26f
net/http.(conn).serve(0xc20852d540)
/usr/local/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
/usr/local/go/src/net/http/server.go:1751 +0x35e

goroutine 114 [IO wait]:
net.(pollDesc).Wait(0xc208a3bcd0, 0x72, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:84 +0x47
net.(pollDesc).WaitRead(0xc208a3bcd0, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:89 +0x43
net.(netFD).Read(0xc208a3bc70, 0xc2081bc000, 0x8000, 0x8000, 0x0, 0x7fabd504f0c8, 0xc208b87930)
/usr/local/go/src/net/fd_unix.go:242 +0x40f
net.(conn).Read(0xc20802bbe8, 0xc2081bc000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:121 +0xdc
io.Copy(0x7fabd5063da0, 0xc20802bc28, 0x7fabd50639c8, 0xc20802bbe8, 0x0, 0x0, 0x0)
/usr/local/go/src/io/io.go:362 +0x1f6
net/http.func·008()
/usr/local/go/src/net/http/server.go:171 +0x7d
created by net/http.(*conn).closeNotify
/usr/local/go/src/net/http/server.go:177 +0x2e2

goroutine 115 [chan receive]:
github.com/influxdata/influxdb/services/httpd.func·002()
/tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:298 +0x48
created by github.com/influxdata/influxdb/services/httpd.(*Handler).serveQuery
/tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:300 +0xd53

goroutine 122 [runnable]:
github.com/influxdata/influxdb/services/httpd.(Handler).serveQuery(0xc2080721b0, 0x7fabd5063bd0, 0xc208b207e0, 0xc208277ba0, 0x0)
/tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:317 +0xf55
github.com/influxdata/influxdb/services/httpd.Handler.(github.com/influxdata/influxdb/services/httpd.serveQuery)·fm(0x7fabd5063bd0, 0xc208b207e0, 0xc208277ba0, 0x0)
/tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:100 +0x4f
github.com/influxdata/influxdb/services/httpd.func·005(0x7fabd5063bd0, 0xc208b207e0, 0xc208277ba0)
/tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:630 +0x78
net/http.HandlerFunc.ServeHTTP(0xc2080eea00, 0x7fabd5063bd0, 0xc208b207e0, 0xc208277ba0)
/usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdata/influxdb/services/httpd.func·006(0x7fabd5063af8, 0xc208b20780, 0xc208277ba0)
/tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:691 +0x288
net/http.HandlerFunc.ServeHTTP(0xc2080f0360, 0x7fabd5063af8, 0xc208b20780, 0xc208277ba0)
/usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdata/influxdb/services/httpd.func·007(0x7fabd5063af8, 0xc208b20780, 0xc208277ba0)
/tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:700 +0xba
net/http.HandlerFunc.ServeHTTP(0xc2080eea20, 0x7fabd5063af8, 0xc208b20780, 0xc208277ba0)
/usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdata/influxdb/services/httpd.func·008(0x7fabd5063af8, 0xc208b20780, 0xc208277ba0)
/tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:738 +0x3f4
net/http.HandlerFunc.ServeHTTP(0xc2080f0390, 0x7fabd5063af8, 0xc208b20780, 0xc208277ba0)
/usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdata/influxdb/services/httpd.func·009(0x7fabd5063af8, 0xc208b20780, 0xc208277ba0)
/tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:748 +0x179
net/http.HandlerFunc.ServeHTTP(0xc2080f03b0, 0x7fabd5063af8, 0xc208b20780, 0xc208277ba0)
/usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdata/influxdb/services/httpd.func·010(0x7fabd5063af8, 0xc208b20760, 0xc208277ba0)
/tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:756 +0x123
net/http.HandlerFunc.ServeHTTP(0xc2080eea40, 0x7fabd5063af8, 0xc208b20760, 0xc208277ba0)
/usr/local/go/src/net/http/server.go:1265 +0x41
github.com/influxdata/influxdb/services/httpd.func·012(0x7fabd5063ac0, 0xc208933a40, 0xc208277ba0)
/tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:775 +0x197
net/http.HandlerFunc.ServeHTTP(0xc2080eea60, 0x7fabd5063ac0, 0xc208933a40, 0xc208277ba0)
/usr/local/go/src/net/http/server.go:1265 +0x41
github.com/bmizerany/pat.(PatternServeMux).ServeHTTP(0xc20802a0b8, 0x7fabd5063ac0, 0xc208933a40, 0xc208277ba0)
/tmp/influxdb/src/github.com/bmizerany/pat/mux.go:109 +0x21c
github.com/influxdata/influxdb/services/httpd.(Handler).ServeHTTP(0xc2080721b0, 0x7fabd5063ac0, 0xc208933a40, 0xc208277ba0)
/tmp/influxdb/src/github.com/influxdata/influxdb/services/httpd/handler.go:187 +0x467
net/http.serverHandler.ServeHTTP(0xc2082609c0, 0x7fabd5063ac0, 0xc208933a40, 0xc208277ba0)
/usr/local/go/src/net/http/server.go:1703 +0x19a
net/http.(conn).serve(0xc2089339a0)
/usr/local/go/src/net/http/server.go:1204 +0xb57
created by net/http.(Server).Serve
/usr/local/go/src/net/http/server.go:1751 +0x35e

@jwilder
Copy link
Contributor

jwilder commented Apr 19, 2016

Dup of #6379 and fixed via #6380

@jwilder jwilder closed this as completed Apr 19, 2016
@mrmike1 mrmike1 mentioned this issue Oct 14, 2016
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area/queries panic
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jwilder @nitzan-tz