By type
+ CONSUL_BIND=
+ [ -n ]
+ CONSUL_CLIENT=
+ [ -n ]
+ CONSUL_DATA_DIR=/consul/data
+ CONSUL_CONFIG_DIR=/consul/config
+ [ -n ]
+ [ a = - ]
+ [ agent = agent ]
+ shift
+ set -- consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui
+ [ consul = consul ]
+ stat -c %u /consul/data
+ id -u consul
+ [ 100 != 100 ]
+ stat -c %u /consul/config
+ id -u consul
+ [ 100 != 100 ]
+ [ ! -z ]
+ exec consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui
bootstrap_expect > 0: expecting 3 servers
==> Starting Consul agent...
==> Consul agent running!
Version: 'v1.0.6'
Node ID: '625429b0-2c33-6d50-2432-70aefdff073d'
Node name: 'dev-consul-server-0'
Datacenter: 'dc1' (Segment: '')
Server: true (Bootstrap: false)
Client Addr: [0.0.0.0] (HTTP: 8500, HTTPS: -1, DNS: 8600)
Cluster Addr: 10.242.162.71 (LAN: 8301, WAN: 8302)
Encrypt: Gossip: false, TLS-Outgoing: false, TLS-Incoming: false
==> Log data will now stream in as it occurs:
2021/06/17 22:38:55 [INFO] raft: Initial configuration (index=0): []
2021/06/17 22:38:55 [INFO] raft: Node at 10.242.162.71:8300 [Follower] entering Follower state (Leader: "")
2021/06/17 22:38:55 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.162.71
2021/06/17 22:38:55 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.162.71
2021/06/17 22:38:55 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.162.71:8300) (DC: dc1)
2021/06/17 22:38:55 [INFO] agent: Started DNS server 0.0.0.0:8600 (udp)
2021/06/17 22:38:55 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/06/17 22:38:55 [INFO] agent: Started DNS server 0.0.0.0:8600 (tcp)
2021/06/17 22:38:55 [INFO] agent: Started HTTP server on [::]:8500 (tcp)
2021/06/17 22:38:55 [INFO] agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce os scaleway softlayer
2021/06/17 22:38:55 [INFO] agent: Joining LAN cluster...
2021/06/17 22:38:55 [INFO] agent: (LAN) joining: [dev-consul-server-0.consul-server dev-consul-server-1.consul-server dev-consul-server-2.consul-server]
2021/06/17 22:38:55 [INFO] agent: started state syncer
2021/06/17 22:38:55 [WARN] memberlist: Failed to resolve dev-consul-server-0.consul-server: lookup dev-consul-server-0.consul-server on 10.96.0.10:53: no such host
2021/06/17 22:38:56 [WARN] memberlist: Failed to resolve dev-consul-server-1.consul-server: lookup dev-consul-server-1.consul-server on 10.96.0.10:53: no such host
2021/06/17 22:38:56 [WARN] memberlist: Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host
2021/06/17 22:38:56 [INFO] agent: (LAN) joined: 0 Err: 3 error(s) occurred:
* Failed to resolve dev-consul-server-0.consul-server: lookup dev-consul-server-0.consul-server on 10.96.0.10:53: no such host
* Failed to resolve dev-consul-server-1.consul-server: lookup dev-consul-server-1.consul-server on 10.96.0.10:53: no such host
* Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host
2021/06/17 22:38:56 [WARN] agent: Join LAN failed: , retrying in 30s
2021/06/17 22:39:02 [ERR] agent: failed to sync remote state: No cluster leader
2021/06/17 22:39:04 [WARN] raft: no known peers, aborting election
==> Failed to check for updates: Get https://checkpoint-api.hashicorp.com/v1/check/consul?arch=amd64&os=linux&signature=45b73f44-4bf8-5efe-0604-692cc3cdef82&version=1.0.6: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/06/17 22:39:25 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 22:39:25 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.13.79
2021/06/17 22:39:25 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/17 22:39:25 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.13.79
2021/06/17 22:39:25 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.13.79:8300) (DC: dc1)
2021/06/17 22:39:26 [INFO] agent: (LAN) joining: [dev-consul-server-0.consul-server dev-consul-server-1.consul-server dev-consul-server-2.consul-server]
2021/06/17 22:39:26 [WARN] memberlist: Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host
2021/06/17 22:39:26 [INFO] agent: (LAN) joined: 2 Err:
2021/06/17 22:39:26 [INFO] agent: Join LAN completed. Synced with 2 initial agents
2021/06/17 22:39:27 [ERR] agent: Coordinate update error: No cluster leader
2021/06/17 22:39:38 [ERR] agent: failed to sync remote state: No cluster leader
2021/06/17 22:39:53 [ERR] agent: Coordinate update error: No cluster leader
2021/06/17 22:40:07 [ERR] agent: failed to sync remote state: No cluster leader
2021/06/17 22:40:08 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.117.136
2021/06/17 22:40:08 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.117.136:8300) (DC: dc1)
2021/06/17 22:40:08 [INFO] consul: Existing Raft peers reported by dev-consul-server-2, disabling bootstrap mode
2021/06/17 22:40:08 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.117.136
2021/06/17 22:40:08 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/06/17 22:40:13 [DEBUG] raft-net: 10.242.162.71:8300 accepted connection from: 10.242.117.136:42086
2021/06/17 22:40:13 [WARN] raft: Failed to get previous log: 1 log not found (last: 0)
2021/06/17 22:40:13 [INFO] consul: New leader elected: dev-consul-server-2
2021/06/17 22:40:14 [DEBUG] raft-net: 10.242.162.71:8300 accepted connection from: 10.242.117.136:42092
2021/06/17 22:40:15 [INFO] agent: Synced node info
2021/06/17 22:58:16 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:52206->10.242.13.79:8301: i/o timeout
2021/06/17 22:58:16 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 22:58:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:52236->10.242.13.79:8301: i/o timeout
2021/06/17 22:58:19 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 22:58:22 [WARN] memberlist: Was able to connect to dev-consul-7467bf7b46-rx74l but other probes failed, network may be misconfigured
2021/06/17 22:58:23 [WARN] memberlist: Refuting a suspect message (from: dev-consul-7467bf7b46-rx74l)
2021/06/17 22:58:24 [WARN] memberlist: Was able to connect to dev-consul-7467bf7b46-rx74l but other probes failed, network may be misconfigured
2021/06/17 22:58:28 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:56520->10.242.13.74:8301: i/o timeout
2021/06/17 22:58:28 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 22:58:32 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:56544->10.242.13.74:8301: i/o timeout
2021/06/17 22:58:32 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 22:58:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:56582->10.242.13.74:8301: i/o timeout
2021/06/17 22:58:34 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 22:58:35 [INFO] memberlist: Marking dev-consul-7467bf7b46-rx74l as failed, suspect timeout reached (2 peer confirmations)
2021/06/17 22:58:35 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 22:58:35 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 22:58:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:52546->10.242.13.79:8301: i/o timeout
2021/06/17 22:58:39 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 22:58:41 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:56710->10.242.13.74:8301: i/o timeout
2021/06/17 22:58:41 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 22:58:43 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:52580->10.242.13.79:8301: i/o timeout
2021/06/17 22:58:43 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 22:58:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:50100->10.242.13.79:8302: i/o timeout
2021/06/17 22:58:45 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 22:58:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:52638->10.242.13.79:8301: i/o timeout
2021/06/17 22:58:45 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 22:58:47 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:56808->10.242.13.74:8301: i/o timeout
2021/06/17 22:58:47 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 22:58:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:52700->10.242.13.79:8301: i/o timeout
2021/06/17 22:58:49 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 22:58:51 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (1 peer confirmations)
2021/06/17 22:58:51 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.13.79
2021/06/17 22:58:51 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.13.79:8300) (DC: dc1)
2021/06/17 22:58:51 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:56866->10.242.13.74:8301: i/o timeout
2021/06/17 22:58:51 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 22:58:53 [INFO] memberlist: Marking dev-consul-7467bf7b46-rx74l as failed, suspect timeout reached (1 peer confirmations)
2021/06/17 22:58:53 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 22:58:55 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:50262->10.242.13.79:8302: i/o timeout
2021/06/17 22:58:55 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 22:58:55 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 22:59:04 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/17 22:59:04 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.13.74:59406
2021/06/17 22:59:05 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:50334->10.242.13.79:8302: i/o timeout
2021/06/17 22:59:05 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 22:59:15 [INFO] memberlist: Marking dev-consul-server-1.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/17 22:59:15 [INFO] serf: EventMemberFailed: dev-consul-server-1.dc1 10.242.13.79
2021/06/17 22:59:15 [INFO] consul: Handled member-failed event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/17 22:59:20 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:50518->10.242.13.79:8302: i/o timeout
2021/06/17 22:59:20 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 22:59:23 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/17 22:59:35 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 22:59:55 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:00:15 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 23:00:40 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.13.79
2021/06/17 23:00:40 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.13.79:8300) (DC: dc1)
2021/06/17 23:00:40 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 23:00:40 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.13.79
2021/06/17 23:00:40 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/17 23:00:41 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 23:00:41 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:57948->10.242.13.74:8301: i/o timeout
2021/06/17 23:00:41 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:00:42 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 23:00:43 [DEBUG] raft-net: 10.242.162.71:8300 accepted connection from: 10.242.13.79:46156
2021/06/17 23:00:43 [WARN] raft: Rejecting vote request from 10.242.13.79:8300 since we have a leader: 10.242.117.136:8300
2021/06/17 23:02:05 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:54482->10.242.13.79:8301: i/o timeout
2021/06/17 23:02:05 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:02:08 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:58656->10.242.13.74:8301: i/o timeout
2021/06/17 23:02:08 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:02:11 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:54522->10.242.13.79:8301: i/o timeout
2021/06/17 23:02:11 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:02:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:58678->10.242.13.74:8301: i/o timeout
2021/06/17 23:02:14 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:02:17 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:54568->10.242.13.79:8301: i/o timeout
2021/06/17 23:02:17 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:02:19 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.13.79
2021/06/17 23:02:19 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.13.79:8300) (DC: dc1)
2021/06/17 23:02:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:58730->10.242.13.74:8301: i/o timeout
2021/06/17 23:02:19 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:02:20 [INFO] memberlist: Marking dev-consul-7467bf7b46-rx74l as failed, suspect timeout reached (1 peer confirmations)
2021/06/17 23:02:20 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 23:02:21 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/17 23:02:21 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.13.74:60186
2021/06/17 23:02:21 [ERR] yamux: keepalive failed: session shutdown
2021/06/17 23:02:25 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:52118->10.242.13.79:8302: i/o timeout
2021/06/17 23:02:25 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:02:25 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:02:35 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:52166->10.242.13.79:8302: i/o timeout
2021/06/17 23:02:35 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:02:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:52260->10.242.13.79:8302: i/o timeout
2021/06/17 23:02:45 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:02:48 [INFO] serf: EventMemberFailed: dev-consul-server-1.dc1 10.242.13.79
2021/06/17 23:02:48 [INFO] consul: Handled member-failed event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/17 23:02:51 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/17 23:02:51 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.13.79:45960
2021/06/17 23:03:05 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:03:25 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:03:45 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:04:25 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:04:39 [ERR] memberlist: failed to receive: read tcp 10.242.162.71:8302->10.242.13.79:51096: i/o timeout from=10.242.13.79:51096
2021/06/17 23:04:39 [ERR] memberlist: Failed to send error: write tcp 10.242.162.71:8302->10.242.13.79:51096: i/o timeout from=10.242.13.79:51096
2021/06/17 23:04:55 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:05:05 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:05:45 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 23:06:25 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:06:25 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 23:07:05 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 23:07:25 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:07:27 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.13.79
2021/06/17 23:07:27 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/17 23:07:27 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.13.79
2021/06/17 23:07:27 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.13.79:8300) (DC: dc1)
2021/06/17 23:07:27 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 23:07:33 [WARN] raft: Rejecting vote request from 10.242.13.79:8300 since we have a leader: 10.242.117.136:8300
2021/06/17 23:07:40 [WARN] raft: Rejecting vote request from 10.242.13.79:8300 since we have a leader: 10.242.117.136:8300
2021/06/17 23:07:46 [INFO] consul: New leader elected: dev-consul-server-2
2021/06/17 23:07:46 [DEBUG] raft-net: 10.242.162.71:8300 accepted connection from: 10.242.117.136:49068
2021/06/17 23:08:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:33360->10.242.13.74:8301: i/o timeout
2021/06/17 23:08:45 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:08:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:33402->10.242.13.74:8301: i/o timeout
2021/06/17 23:08:49 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:08:52 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:57496->10.242.13.79:8301: i/o timeout
2021/06/17 23:08:52 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:08:55 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:55022->10.242.13.79:8302: i/o timeout
2021/06/17 23:08:55 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:08:55 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:57512->10.242.13.79:8301: i/o timeout
2021/06/17 23:08:55 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:08:57 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 23:08:58 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:33448->10.242.13.74:8301: i/o timeout
2021/06/17 23:08:58 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:09:01 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:57574->10.242.13.79:8301: i/o timeout
2021/06/17 23:09:01 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:09:03 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:57588->10.242.13.79:8301: i/o timeout
2021/06/17 23:09:03 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:09:04 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (1 peer confirmations)
2021/06/17 23:09:04 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.13.79
2021/06/17 23:09:04 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.13.79:8300) (DC: dc1)
2021/06/17 23:09:05 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:55098->10.242.13.79:8302: i/o timeout
2021/06/17 23:09:05 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:09:05 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:57614->10.242.13.79:8301: i/o timeout
2021/06/17 23:09:05 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:09:15 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 23:09:20 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:55184->10.242.13.79:8302: i/o timeout
2021/06/17 23:09:20 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:09:22 [INFO] memberlist: Marking dev-consul-server-1.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/17 23:09:22 [INFO] serf: EventMemberFailed: dev-consul-server-1.dc1 10.242.13.79
2021/06/17 23:09:22 [INFO] consul: Handled member-failed event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/17 23:09:24 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/17 23:09:24 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.13.74:35714
2021/06/17 23:09:35 [ERR] memberlist: failed to receive: read tcp 10.242.162.71:8301->10.242.13.79:39740: i/o timeout from=10.242.13.79:39740
2021/06/17 23:09:35 [ERR] memberlist: Failed to send error: write tcp 10.242.162.71:8301->10.242.13.79:39740: i/o timeout from=10.242.13.79:39740
2021/06/17 23:09:55 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:10:27 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:10:35 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:11:15 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:11:27 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:11:55 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 23:12:27 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:12:35 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:13:15 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 23:13:27 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:13:55 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 23:14:13 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.13.79
2021/06/17 23:14:13 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/17 23:14:13 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.13.79
2021/06/17 23:14:13 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.13.79:8300) (DC: dc1)
2021/06/17 23:14:14 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 23:15:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:36434->10.242.13.74:8301: i/o timeout
2021/06/17 23:15:22 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:15:25 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:36460->10.242.13.74:8301: i/o timeout
2021/06/17 23:15:25 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:15:28 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:60572->10.242.13.79:8301: i/o timeout
2021/06/17 23:15:28 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:15:30 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:58094->10.242.13.79:8302: i/o timeout
2021/06/17 23:15:30 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:15:30 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:36504->10.242.13.74:8301: i/o timeout
2021/06/17 23:15:30 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:15:32 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:60600->10.242.13.79:8301: i/o timeout
2021/06/17 23:15:32 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:15:35 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:60630->10.242.13.79:8301: i/o timeout
2021/06/17 23:15:35 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:15:37 [INFO] memberlist: Marking dev-consul-7467bf7b46-rx74l as failed, suspect timeout reached (1 peer confirmations)
2021/06/17 23:15:37 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 23:15:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:36554->10.242.13.74:8301: i/o timeout
2021/06/17 23:15:37 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:15:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:60664->10.242.13.79:8301: i/o timeout
2021/06/17 23:15:39 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:15:40 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.13.79
2021/06/17 23:15:40 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.13.79:8300) (DC: dc1)
2021/06/17 23:15:40 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:58122->10.242.13.79:8302: i/o timeout
2021/06/17 23:15:40 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:15:52 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/17 23:15:52 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.13.79:52098
2021/06/17 23:15:53 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/17 23:15:53 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.13.74:38402
2021/06/17 23:15:55 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:58270->10.242.13.79:8302: i/o timeout
2021/06/17 23:15:55 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:16:00 [INFO] memberlist: Marking dev-consul-server-1.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/17 23:16:00 [INFO] serf: EventMemberFailed: dev-consul-server-1.dc1 10.242.13.79
2021/06/17 23:16:00 [INFO] consul: Handled member-failed event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/17 23:16:05 [WARN] memberlist: Was able to connect to dev-consul-server-1.dc1 but other probes failed, network may be misconfigured
2021/06/17 23:16:05 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:16:27 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:16:45 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 23:17:25 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:17:57 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:18:05 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:18:45 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:19:25 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 23:19:54 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.13.79
2021/06/17 23:19:54 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/17 23:19:55 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.13.79
2021/06/17 23:19:55 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.13.79:8300) (DC: dc1)
2021/06/17 23:19:57 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 23:21:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:39048->10.242.13.74:8301: i/o timeout
2021/06/17 23:21:04 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:21:07 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:39068->10.242.13.74:8301: i/o timeout
2021/06/17 23:21:07 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:21:10 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:39100->10.242.13.74:8301: i/o timeout
2021/06/17 23:21:10 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:21:12 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:34962->10.242.13.79:8301: i/o timeout
2021/06/17 23:21:12 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:21:15 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:34988->10.242.13.79:8301: i/o timeout
2021/06/17 23:21:15 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:21:16 [INFO] memberlist: Marking dev-consul-7467bf7b46-rx74l as failed, suspect timeout reached (1 peer confirmations)
2021/06/17 23:21:16 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 23:21:17 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.13.79
2021/06/17 23:21:17 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.13.79:8300) (DC: dc1)
2021/06/17 23:21:17 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.13.79
2021/06/17 23:21:17 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.13.79:8300) (DC: dc1)
2021/06/17 23:21:17 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:39146->10.242.13.74:8301: i/o timeout
2021/06/17 23:21:17 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:21:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:35024->10.242.13.79:8301: i/o timeout
2021/06/17 23:21:19 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:21:20 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:60766->10.242.13.79:8302: i/o timeout
2021/06/17 23:21:20 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:21:21 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:35038->10.242.13.79:8301: i/o timeout
2021/06/17 23:21:21 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:21:23 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:35056->10.242.13.79:8301: i/o timeout
2021/06/17 23:21:23 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:21:25 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:35076->10.242.13.79:8301: i/o timeout
2021/06/17 23:21:25 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:21:28 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:35110->10.242.13.79:8301: i/o timeout
2021/06/17 23:21:28 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:21:30 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (1 peer confirmations)
2021/06/17 23:21:30 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.13.79
2021/06/17 23:21:30 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.13.79:8300) (DC: dc1)
2021/06/17 23:21:30 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:60798->10.242.13.79:8302: i/o timeout
2021/06/17 23:21:30 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:21:30 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:35122->10.242.13.79:8301: i/o timeout
2021/06/17 23:21:30 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:21:35 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 23:21:36 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/17 23:21:37 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/17 23:21:37 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.13.74:41728
2021/06/17 23:21:40 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:60924->10.242.13.79:8302: i/o timeout
2021/06/17 23:21:40 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:21:42 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 23:21:44 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:39364->10.242.13.74:8301: i/o timeout
2021/06/17 23:21:44 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:21:47 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:39394->10.242.13.74:8301: i/o timeout
2021/06/17 23:21:47 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:21:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:39414->10.242.13.74:8301: i/o timeout
2021/06/17 23:21:49 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:21:50 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:32772->10.242.13.79:8302: i/o timeout
2021/06/17 23:21:50 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:21:50 [INFO] memberlist: Marking dev-consul-server-1.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/17 23:21:50 [INFO] serf: EventMemberFailed: dev-consul-server-1.dc1 10.242.13.79
2021/06/17 23:21:50 [INFO] consul: Handled member-failed event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/17 23:21:52 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:39428->10.242.13.74:8301: i/o timeout
2021/06/17 23:21:52 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:21:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:39438->10.242.13.74:8301: i/o timeout
2021/06/17 23:21:54 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:21:55 [INFO] memberlist: Marking dev-consul-7467bf7b46-rx74l as failed, suspect timeout reached (1 peer confirmations)
2021/06/17 23:21:55 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 23:21:56 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:39446->10.242.13.74:8301: i/o timeout
2021/06/17 23:21:56 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:22:15 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 23:22:27 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:22:37 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.13.79
2021/06/17 23:22:37 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.13.79:8300) (DC: dc1)
2021/06/17 23:22:38 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:35652->10.242.13.79:8301: i/o timeout
2021/06/17 23:22:38 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:22:40 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:35666->10.242.13.79:8301: i/o timeout
2021/06/17 23:22:40 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:22:42 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/17 23:22:42 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.13.79
2021/06/17 23:22:42 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.13.79:8300) (DC: dc1)
2021/06/17 23:22:43 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:35684->10.242.13.79:8301: i/o timeout
2021/06/17 23:22:43 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:22:44 [ERR] memberlist: failed to receive: read tcp 10.242.162.71:8301->10.242.13.79:45822: i/o timeout from=10.242.13.79:45822
2021/06/17 23:22:44 [ERR] memberlist: Failed to send error: write tcp 10.242.162.71:8301->10.242.13.79:45822: i/o timeout from=10.242.13.79:45822
2021/06/17 23:22:55 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 23:23:04 [ERR] memberlist: failed to receive: read tcp 10.242.162.71:8302->10.242.13.79:60730: i/o timeout from=10.242.13.79:60730
2021/06/17 23:23:04 [ERR] memberlist: Failed to send error: write tcp 10.242.162.71:8302->10.242.13.79:60730: i/o timeout from=10.242.13.79:60730
2021/06/17 23:23:17 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/17 23:23:17 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.13.74:44070
2021/06/17 23:23:35 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:23:57 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:24:15 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:24:55 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:25:27 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:25:35 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:25:55 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 23:25:56 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.13.79
2021/06/17 23:25:56 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.13.79:8300) (DC: dc1)
2021/06/17 23:25:56 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.13.79
2021/06/17 23:25:56 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/17 23:25:56 [WARN] raft: Rejecting vote request from 10.242.13.79:8300 since we have a leader: 10.242.117.136:8300
2021/06/17 23:25:56 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1.dc1)
2021/06/17 23:26:04 [WARN] raft: Rejecting vote request from 10.242.13.79:8300 since we have a leader: 10.242.117.136:8300
2021/06/17 23:26:07 [WARN] raft: Heartbeat timeout from "10.242.117.136:8300" reached, starting election
2021/06/17 23:26:07 [INFO] raft: Node at 10.242.162.71:8300 [Candidate] entering Candidate state in term 6
2021/06/17 23:26:07 [INFO] raft: Node at 10.242.162.71:8300 [Follower] entering Follower state (Leader: "")
2021/06/17 23:26:07 [INFO] consul: New leader elected: dev-consul-server-2
2021/06/17 23:26:08 [DEBUG] raft-net: 10.242.162.71:8300 accepted connection from: 10.242.117.136:48132
2021/06/17 23:26:59 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:41804->10.242.13.74:8301: i/o timeout
2021/06/17 23:26:59 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:27:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:37974->10.242.13.79:8301: i/o timeout
2021/06/17 23:27:42 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:27:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:42124->10.242.13.74:8301: i/o timeout
2021/06/17 23:27:45 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:27:48 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:42154->10.242.13.74:8301: i/o timeout
2021/06/17 23:27:48 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:27:52 [WARN] memberlist: Was able to connect to dev-consul-server-1 but other probes failed, network may be misconfigured
2021/06/17 23:27:55 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:35564->10.242.13.79:8302: i/o timeout
2021/06/17 23:27:55 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:27:55 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:42204->10.242.13.74:8301: i/o timeout
2021/06/17 23:27:55 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:27:57 [INFO] memberlist: Marking dev-consul-7467bf7b46-rx74l as failed, suspect timeout reached (1 peer confirmations)
2021/06/17 23:27:57 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 23:27:57 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:38090->10.242.13.79:8301: i/o timeout
2021/06/17 23:27:57 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:27:59 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:38112->10.242.13.79:8301: i/o timeout
2021/06/17 23:27:59 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:28:00 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.13.79
2021/06/17 23:28:00 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.13.79:8300) (DC: dc1)
2021/06/17 23:28:10 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:35698->10.242.13.79:8302: i/o timeout
2021/06/17 23:28:10 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:28:15 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/17 23:28:15 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:28:20 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:35784->10.242.13.79:8302: i/o timeout
2021/06/17 23:28:20 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:28:25 [INFO] memberlist: Marking dev-consul-server-1.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/17 23:28:25 [INFO] serf: EventMemberFailed: dev-consul-server-1.dc1 10.242.13.79
2021/06/17 23:28:25 [INFO] consul: Handled member-failed event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/17 23:28:30 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:35814->10.242.13.79:8302: i/o timeout
2021/06/17 23:28:30 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:28:56 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 23:28:56 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:29:16 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.13.79
2021/06/17 23:29:16 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/17 23:29:16 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.13.79
2021/06/17 23:29:16 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.13.79:8300) (DC: dc1)
2021/06/17 23:29:20 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:38726->10.242.13.79:8301: i/o timeout
2021/06/17 23:29:20 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:29:22 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/17 23:29:22 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.13.79
2021/06/17 23:29:22 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.13.79:8300) (DC: dc1)
2021/06/17 23:29:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:38740->10.242.13.79:8301: i/o timeout
2021/06/17 23:29:22 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:29:30 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:36304->10.242.13.79:8302: i/o timeout
2021/06/17 23:29:30 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:29:36 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:29:40 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:36330->10.242.13.79:8302: i/o timeout
2021/06/17 23:29:40 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:29:46 [ERR] memberlist: failed to receive: read tcp 10.242.162.71:8302->10.242.13.79:36662: i/o timeout from=10.242.13.79:36662
2021/06/17 23:29:46 [ERR] memberlist: Failed to send error: write tcp 10.242.162.71:8302->10.242.13.79:36662: i/o timeout from=10.242.13.79:36662
2021/06/17 23:29:58 [INFO] memberlist: Marking dev-consul-server-1.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/17 23:29:58 [INFO] serf: EventMemberFailed: dev-consul-server-1.dc1 10.242.13.79
2021/06/17 23:29:58 [INFO] consul: Handled member-failed event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/17 23:30:00 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:36536->10.242.13.79:8302: i/o timeout
2021/06/17 23:30:00 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:30:16 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:30:26 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:30:45 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/17 23:30:45 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.13.79:34208
2021/06/17 23:30:50 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/17 23:30:56 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 23:31:26 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:31:36 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 23:32:16 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:32:45 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 23:32:46 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.13.79
2021/06/17 23:32:46 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.13.79:8300) (DC: dc1)
2021/06/17 23:32:47 [WARN] raft: Rejecting vote request from 10.242.13.79:8300 since we have a leader: 10.242.117.136:8300
2021/06/17 23:32:47 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.13.79
2021/06/17 23:32:47 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/17 23:32:47 [WARN] memberlist: Was able to connect to dev-consul-server-1 but other probes failed, network may be misconfigured
2021/06/17 23:32:53 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:32:56 [INFO] serf: EventMemberUpdate: dev-consul-server-1.dc1
2021/06/17 23:32:56 [INFO] serf: EventMemberUpdate: dev-consul-server-1
2021/06/17 23:33:46 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:40806->10.242.13.79:8301: i/o timeout
2021/06/17 23:33:46 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:33:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:40834->10.242.13.79:8301: i/o timeout
2021/06/17 23:33:49 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:33:52 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:44982->10.242.13.74:8301: i/o timeout
2021/06/17 23:33:52 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:33:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:40860->10.242.13.79:8301: i/o timeout
2021/06/17 23:33:54 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:33:55 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:38362->10.242.13.79:8302: i/o timeout
2021/06/17 23:33:55 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:33:56 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:45010->10.242.13.74:8301: i/o timeout
2021/06/17 23:33:56 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:33:59 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:40892->10.242.13.79:8301: i/o timeout
2021/06/17 23:33:59 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:34:01 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (1 peer confirmations)
2021/06/17 23:34:01 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.13.79
2021/06/17 23:34:01 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.13.79:8300) (DC: dc1)
2021/06/17 23:34:02 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:45062->10.242.13.74:8301: i/o timeout
2021/06/17 23:34:02 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:34:04 [INFO] memberlist: Marking dev-consul-7467bf7b46-rx74l as failed, suspect timeout reached (1 peer confirmations)
2021/06/17 23:34:04 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 23:34:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:45102->10.242.13.74:8301: i/o timeout
2021/06/17 23:34:04 [INFO] memberlist: Suspect dev-consul-7467bf7b46-rx74l has failed, no acks received
2021/06/17 23:34:05 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:38414->10.242.13.79:8302: i/o timeout
2021/06/17 23:34:05 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:34:25 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:38604->10.242.13.79:8302: i/o timeout
2021/06/17 23:34:25 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:34:25 [INFO] memberlist: Marking dev-consul-server-1.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/17 23:34:25 [INFO] serf: EventMemberFailed: dev-consul-server-1.dc1 10.242.13.79
2021/06/17 23:34:25 [INFO] consul: Handled member-failed event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/17 23:34:26 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:34:26 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:34:28 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/17 23:34:28 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.13.74:49430
2021/06/17 23:34:35 [ERR] memberlist: Failed fallback ping: read tcp 10.242.162.71:38658->10.242.13.79:8302: i/o timeout
2021/06/17 23:34:35 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:34:38 [ERR] memberlist: failed to receive: read tcp 10.242.162.71:8302->10.242.13.79:39854: i/o timeout from=10.242.13.79:39854
2021/06/17 23:34:38 [ERR] memberlist: Failed to send error: write tcp 10.242.162.71:8302->10.242.13.79:39854: i/o timeout from=10.242.13.79:39854
2021/06/17 23:35:06 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 23:35:26 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:35:46 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 23:36:26 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 23:36:26 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:37:06 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:37:26 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:37:46 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 23:38:26 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 23:38:56 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:39:06 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.13.79:8301
2021/06/17 23:39:46 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-rx74l 10.242.13.74:8301
2021/06/17 23:40:09 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-xqj4q 10.242.166.75
2021/06/17 23:40:12 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.13.79
2021/06/17 23:40:12 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 23:40:12 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.13.79:8300) (DC: dc1)
2021/06/17 23:40:12 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.13.79
2021/06/17 23:40:12 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/17 23:40:13 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1.dc1)
2021/06/17 23:40:13 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 23:40:13 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 23:40:20 [INFO] serf: EventMemberLeave: dev-consul-7467bf7b46-rx74l 10.242.13.74
2021/06/17 23:40:23 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:40:26 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/17 23:40:27 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.13.79
2021/06/17 23:40:27 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.13.79:8300) (DC: dc1)
2021/06/17 23:40:58 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.13.116
2021/06/17 23:40:58 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.13.116:8300) (DC: dc1)
2021/06/17 23:40:58 [ERR] memberlist: Conflicting address for dev-consul-server-1.dc1. Mine: 10.242.13.79:8302 Theirs: 10.242.13.116:8302
2021/06/17 23:40:58 [WARN] serf: Name conflict for 'dev-consul-server-1.dc1' both 10.242.13.79:8302 and 10.242.13.116:8302 are claiming
2021/06/17 23:40:58 [INFO] serf: EventMemberFailed: dev-consul-server-1.dc1 10.242.13.79
2021/06/17 23:40:58 [INFO] consul: Handled member-failed event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/17 23:40:58 [ERR] memberlist: Conflicting address for dev-consul-server-1.dc1. Mine: 10.242.13.79:8302 Theirs: 10.242.13.116:8302
2021/06/17 23:40:58 [WARN] serf: Name conflict for 'dev-consul-server-1.dc1' both 10.242.13.79:8302 and 10.242.13.116:8302 are claiming
2021/06/17 23:40:58 [ERR] memberlist: Conflicting address for dev-consul-server-1.dc1. Mine: 10.242.13.79:8302 Theirs: 10.242.13.116:8302
2021/06/17 23:40:58 [WARN] serf: Name conflict for 'dev-consul-server-1.dc1' both 10.242.13.79:8302 and 10.242.13.116:8302 are claiming
2021/06/17 23:40:59 [ERR] memberlist: Conflicting address for dev-consul-server-1.dc1. Mine: 10.242.13.79:8302 Theirs: 10.242.13.116:8302
2021/06/17 23:40:59 [WARN] serf: Name conflict for 'dev-consul-server-1.dc1' both 10.242.13.79:8302 and 10.242.13.116:8302 are claiming
2021/06/17 23:40:59 [ERR] memberlist: Conflicting address for dev-consul-server-1.dc1. Mine: 10.242.13.79:8302 Theirs: 10.242.13.116:8302
2021/06/17 23:40:59 [WARN] serf: Name conflict for 'dev-consul-server-1.dc1' both 10.242.13.79:8302 and 10.242.13.116:8302 are claiming
2021/06/17 23:41:03 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/17 23:41:26 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.13.79:8302
2021/06/17 23:42:16 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.13.116
2021/06/17 23:42:16 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"