By type
+ CONSUL_BIND=
+ [ -n ]
+ CONSUL_CLIENT=
+ [ -n ]
+ CONSUL_DATA_DIR=/consul/data
+ CONSUL_CONFIG_DIR=/consul/config
+ [ -n ]
+ [ a = - ]
+ [ agent = agent ]
+ shift
+ set -- consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui
+ [ consul = consul ]
+ stat -c %u /consul/data
+ id -u consul
+ [ 100 != 100 ]
+ stat -c %u /consul/config
+ id -u consul
+ [ 100 != 100 ]
+ [ ! -z ]
+ exec consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui
bootstrap_expect > 0: expecting 3 servers
==> Starting Consul agent...
==> Consul agent running!
Version: 'v1.0.6'
Node ID: 'e5252965-3447-fc21-8a17-1bdb0f1e921b'
Node name: 'dev-consul-server-2'
Datacenter: 'dc1' (Segment: '')
Server: true (Bootstrap: false)
Client Addr: [0.0.0.0] (HTTP: 8500, HTTPS: -1, DNS: 8600)
Cluster Addr: 10.242.3.200 (LAN: 8301, WAN: 8302)
Encrypt: Gossip: false, TLS-Outgoing: false, TLS-Incoming: false
==> Log data will now stream in as it occurs:
2021/05/28 22:41:38 [INFO] raft: Initial configuration (index=0): []
2021/05/28 22:41:38 [INFO] raft: Node at 10.242.3.200:8300 [Follower] entering Follower state (Leader: "")
2021/05/28 22:41:38 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.3.200
2021/05/28 22:41:38 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.3.200
2021/05/28 22:41:38 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/05/28 22:41:38 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.3.200:8300) (DC: dc1) 2021/05/28 22:41:38 [INFO] agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce os scaleway softlayer
2021/05/28 22:41:38 [INFO] agent: Joining LAN cluster...
2021/05/28 22:41:38 [INFO] agent: (LAN) joining: [dev-consul-server-0.consul-server dev-consul-server-1.consul-server dev-consul-server-2.consul-server]
2021/05/28 22:41:38 [INFO] agent: Started DNS server 0.0.0.0:8600 (tcp)
2021/05/28 22:41:38 [INFO] agent: Started DNS server 0.0.0.0:8600 (udp)
2021/05/28 22:41:38 [INFO] agent: Started HTTP server on [::]:8500 (tcp)
2021/05/28 22:41:38 [INFO] agent: started state syncer
2021/05/28 22:41:38 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.83.9
2021/05/28 22:41:38 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-467vr 10.242.29.134
2021/05/28 22:41:38 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.191.196
2021/05/28 22:41:38 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 22:41:38 [INFO] consul: Found expected number of peers, attempting bootstrap: 10.242.3.200:8300,10.242.83.9:8300,10.242.191.196:8300
2021/05/28 22:41:38 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.191.196:8300) (DC: dc1)
2021/05/28 22:41:38 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.83.9
2021/05/28 22:41:38 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.191.196
2021/05/28 22:41:38 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/28 22:41:38 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/05/28 22:41:38 [WARN] memberlist: Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host
2021/05/28 22:41:38 [INFO] agent: (LAN) joined: 2 Err:
2021/05/28 22:41:38 [INFO] agent: Join LAN completed. Synced with 2 initial agents
2021/05/28 22:41:45 [ERR] agent: failed to sync remote state: No cluster leader
2021/05/28 22:41:45 [WARN] raft: Heartbeat timeout from "" reached, starting election
2021/05/28 22:41:45 [INFO] raft: Node at 10.242.3.200:8300 [Candidate] entering Candidate state in term 2
2021/05/28 22:41:45 [INFO] raft: Election won. Tally: 2
2021/05/28 22:41:45 [INFO] raft: Node at 10.242.3.200:8300 [Leader] entering Leader state
2021/05/28 22:41:45 [INFO] raft: Added peer 5b141322-0cbd-1277-55aa-4bb1f8763d72, starting replication
2021/05/28 22:41:45 [INFO] raft: Added peer 50041021-4500-bc42-f855-8ce25b99549f, starting replication
2021/05/28 22:41:45 [INFO] consul: cluster leadership acquired
2021/05/28 22:41:45 [INFO] consul: New leader elected: dev-consul-server-2
2021/05/28 22:41:45 [WARN] raft: AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300} rejected, sending older logs (next: 1)
2021/05/28 22:41:45 [WARN] raft: AppendEntries to {Voter 50041021-4500-bc42-f855-8ce25b99549f 10.242.191.196:8300} rejected, sending older logs (next: 1)
2021/05/28 22:41:45 [INFO] raft: pipelining replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/28 22:41:45 [INFO] raft: pipelining replication to peer {Voter 50041021-4500-bc42-f855-8ce25b99549f 10.242.191.196:8300}
2021/05/28 22:41:45 [INFO] consul: member 'dev-consul-7467bf7b46-467vr' joined, marking health alive
2021/05/28 22:41:45 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/05/28 22:41:45 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive
2021/05/28 22:41:45 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive
2021/05/28 22:41:48 [INFO] agent: Synced node info
==> Failed to check for updates: Get https://checkpoint-api.hashicorp.com/v1/check/consul?arch=amd64&os=linux&signature=b725a824-d34f-2fec-3cdb-31fc6e482402&version=1.0.6: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/28 23:05:12 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:05:32 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:05:32 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:05:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:35166->10.242.83.9:8301: i/o timeout
2021/05/28 23:05:33 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:05:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:06:14 [WARN] memberlist: Was able to connect to dev-consul-server-0 but other probes failed, network may be misconfigured
2021/05/28 23:06:14 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:06:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:06:17 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:35748->10.242.83.9:8301: i/o timeout
2021/05/28 23:06:17 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:06:20 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:06:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:06:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:06:25 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500232484s
2021/05/28 23:06:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:06:28 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:06:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:06:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:06:32 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:35946->10.242.83.9:8301: i/o timeout
2021/05/28 23:06:32 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:06:32 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500220986s
2021/05/28 23:06:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:06:34 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.987679877s
2021/05/28 23:06:35 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:35998->10.242.83.9:8301: i/o timeout
2021/05/28 23:06:35 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:06:35 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.83.9
2021/05/28 23:06:35 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:06:35 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical
2021/05/28 23:06:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:06:36 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.397964533s
2021/05/28 23:06:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:06:38 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:06:38 [ERR] raft: Failed to pipeline AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: write tcp 10.242.3.200:58692->10.242.83.9:8300: use of closed network connection
2021/05/28 23:06:38 [INFO] raft: aborting pipeline replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/28 23:06:38 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:06:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:06:40 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:58698->10.242.83.9:8300: i/o timeout
2021/05/28 23:06:41 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500188239s
2021/05/28 23:06:41 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:06:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:06:43 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:37728->10.242.83.9:8302: i/o timeout
2021/05/28 23:06:43 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:06:43 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.934579153s
2021/05/28 23:06:44 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:06:44 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/05/28 23:06:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:06:45 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.348413839s
2021/05/28 23:06:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:06:48 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:06:48 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.83.9:41674
2021/05/28 23:06:48 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:48628->10.242.83.9:8300: i/o timeout
2021/05/28 23:06:48 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:06:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:06:50 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:06:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:06:52 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500226893s
2021/05/28 23:06:52 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0)
2021/05/28 23:06:52 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.83.9
2021/05/28 23:06:52 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:06:52 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive
2021/05/28 23:06:53 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:37864->10.242.83.9:8302: i/o timeout
2021/05/28 23:06:53 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:06:54 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:06:54 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:06:54 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.502643067s
2021/05/28 23:06:55 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:36242->10.242.83.9:8301: i/o timeout
2021/05/28 23:06:55 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:06:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:06:57 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:36288->10.242.83.9:8301: i/o timeout
2021/05/28 23:06:57 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:06:57 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.972574296s
2021/05/28 23:06:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:06:58 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:48760->10.242.83.9:8300: i/o timeout
2021/05/28 23:06:59 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations)
2021/05/28 23:06:59 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.83.9
2021/05/28 23:06:59 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:06:59 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical
2021/05/28 23:06:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:06:59 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.427304013s
2021/05/28 23:07:00 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:36334->10.242.83.9:8301: i/o timeout
2021/05/28 23:07:00 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:07:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:03 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:38002->10.242.83.9:8302: i/o timeout
2021/05/28 23:07:03 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:07:03 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:48656->10.242.83.9:8300: i/o timeout
2021/05/28 23:07:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:04 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:07:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:08 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:48900->10.242.83.9:8300: i/o timeout
2021/05/28 23:07:08 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:07:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:13 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:38150->10.242.83.9:8302: i/o timeout
2021/05/28 23:07:13 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:07:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:14 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:48970->10.242.83.9:8300: i/o timeout
2021/05/28 23:07:14 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:07:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:18 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:07:18 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:49046->10.242.83.9:8300: i/o timeout
2021/05/28 23:07:18 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:07:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:24 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:49130->10.242.83.9:8300: i/o timeout
2021/05/28 23:07:25 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:07:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:28 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:38356->10.242.83.9:8302: i/o timeout
2021/05/28 23:07:28 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:07:28 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/05/28 23:07:28 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.83.9
2021/05/28 23:07:28 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/28 23:07:28 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:49188->10.242.83.9:8300: i/o timeout
2021/05/28 23:07:28 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:07:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:30 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.83.9
2021/05/28 23:07:30 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:07:30 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive
2021/05/28 23:07:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:36794->10.242.83.9:8301: i/o timeout
2021/05/28 23:07:33 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:07:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:35 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:49272->10.242.83.9:8300: i/o timeout
2021/05/28 23:07:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:36872->10.242.83.9:8301: i/o timeout
2021/05/28 23:07:37 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:07:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:38 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:07:38 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:49328->10.242.83.9:8300: i/o timeout
2021/05/28 23:07:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:40 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:36882->10.242.83.9:8301: i/o timeout
2021/05/28 23:07:40 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:07:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:43 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.83.9
2021/05/28 23:07:43 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:07:43 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical
2021/05/28 23:07:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:46 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:49440->10.242.83.9:8300: i/o timeout
2021/05/28 23:07:46 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:07:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:49 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:49486->10.242.83.9:8300: i/o timeout
2021/05/28 23:07:49 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:07:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:56 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:49602->10.242.83.9:8300: i/o timeout
2021/05/28 23:07:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:07:57 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:07:58 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:07:58 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.83.9:35576
2021/05/28 23:07:59 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:49640->10.242.83.9:8300: i/o timeout
2021/05/28 23:07:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:00 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:08:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:07 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:49750->10.242.83.9:8300: i/o timeout
2021/05/28 23:08:09 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:08:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:10 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:49798->10.242.83.9:8300: i/o timeout
2021/05/28 23:08:11 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:08:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:19 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:49918->10.242.83.9:8300: i/o timeout
2021/05/28 23:08:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:20 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:08:21 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:49956->10.242.83.9:8300: i/o timeout
2021/05/28 23:08:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:23 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:08:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:26 [ERR] memberlist: failed to receive: read tcp 10.242.3.200:8302->10.242.83.9:39716: i/o timeout from=10.242.83.9:39716
2021/05/28 23:08:26 [ERR] memberlist: Failed to send error: write tcp 10.242.3.200:8302->10.242.83.9:39716: i/o timeout from=10.242.83.9:39716
2021/05/28 23:08:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:30 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:50080->10.242.83.9:8300: i/o timeout
2021/05/28 23:08:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:32 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:08:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:33 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:50138->10.242.83.9:8300: i/o timeout
2021/05/28 23:08:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:39 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:08:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:42 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:50260->10.242.83.9:8300: i/o timeout
2021/05/28 23:08:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:45 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:08:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:49 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:50380->10.242.83.9:8300: i/o timeout
2021/05/28 23:08:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:55 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:50494->10.242.83.9:8300: i/o timeout
2021/05/28 23:08:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:08:58 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:08:59 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:08:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:01 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:09:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:09 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:50672->10.242.83.9:8300: i/o timeout
2021/05/28 23:09:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:10 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:09:10 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:09:11 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:50706->10.242.83.9:8300: i/o timeout
2021/05/28 23:09:12 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:09:12 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:09:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:19 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:09:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:22 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:09:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:29 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:50958->10.242.83.9:8300: i/o timeout
2021/05/28 23:09:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:32 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:50992->10.242.83.9:8300: i/o timeout
2021/05/28 23:09:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:38 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:09:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:39 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:09:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:43 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:09:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:49 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:51238->10.242.83.9:8300: i/o timeout
2021/05/28 23:09:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:51 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:09:51 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:09:53 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:51272->10.242.83.9:8300: i/o timeout
2021/05/28 23:09:54 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:09:54 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:09:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:09:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:10:00 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:10:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:10:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:10:04 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:10:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:10:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:10:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:10:10 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:51500->10.242.83.9:8300: i/o timeout
2021/05/28 23:10:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:10:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:10:14 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:51552->10.242.83.9:8300: i/o timeout
2021/05/28 23:10:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:10:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:10:18 [DEBUG] raft-net: 10.242.3.200:8300 accepted connection from: 10.242.83.9:36800
2021/05/28 23:10:18 [WARN] raft: Rejecting vote request from 10.242.83.9:8300 since we have a leader: 10.242.3.200:8300
2021/05/28 23:10:18 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.83.9
2021/05/28 23:10:18 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/28 23:10:18 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.83.9
2021/05/28 23:10:18 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:10:18 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive
2021/05/28 23:10:20 [INFO] raft: pipelining replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/28 23:11:24 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:11:28 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:40058->10.242.83.9:8301: i/o timeout
2021/05/28 23:11:28 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:11:28 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:11:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:11:30 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500745439s
2021/05/28 23:11:32 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:40118->10.242.83.9:8301: i/o timeout
2021/05/28 23:11:32 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:11:32 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:11:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:11:35 [WARN] memberlist: Was able to connect to dev-consul-server-0 but other probes failed, network may be misconfigured
2021/05/28 23:11:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:11:37 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500188472s
2021/05/28 23:11:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:11:39 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 5.003931854s
2021/05/28 23:11:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:11:40 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:40228->10.242.83.9:8301: i/o timeout
2021/05/28 23:11:40 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:11:40 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations)
2021/05/28 23:11:40 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.83.9
2021/05/28 23:11:40 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:11:40 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical
2021/05/28 23:11:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:11:41 [INFO] raft: aborting pipeline replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/28 23:11:42 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:11:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:11:44 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500251068s
2021/05/28 23:11:45 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:51824->10.242.83.9:8300: i/o timeout
2021/05/28 23:11:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:11:46 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:11:46 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.924980966s
2021/05/28 23:11:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:11:48 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:41962->10.242.83.9:8302: i/o timeout
2021/05/28 23:11:48 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:11:49 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.3860203s
2021/05/28 23:11:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:11:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:11:52 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:52832->10.242.83.9:8300: i/o timeout
2021/05/28 23:11:52 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:11:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:11:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:11:56 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:52886->10.242.83.9:8300: i/o timeout
2021/05/28 23:11:56 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:11:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:11:58 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:42028->10.242.83.9:8302: i/o timeout
2021/05/28 23:11:58 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:11:58 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:11:58 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.83.9:36792
2021/05/28 23:11:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:02 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:52966->10.242.83.9:8300: i/o timeout
2021/05/28 23:12:02 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:12:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:04 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:12:04 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:12:06 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:12:06 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:53040->10.242.83.9:8300: i/o timeout
2021/05/28 23:12:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:07 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:12:08 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:12:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:12 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:53108->10.242.83.9:8300: i/o timeout
2021/05/28 23:12:12 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:12:13 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:42318->10.242.83.9:8302: i/o timeout
2021/05/28 23:12:13 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:12:13 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/05/28 23:12:13 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.83.9
2021/05/28 23:12:13 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/28 23:12:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:17 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:53188->10.242.83.9:8300: i/o timeout
2021/05/28 23:12:18 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:12:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:22 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:53258->10.242.83.9:8300: i/o timeout
2021/05/28 23:12:22 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:12:23 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:42392->10.242.83.9:8302: i/o timeout
2021/05/28 23:12:23 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:12:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:28 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:53356->10.242.83.9:8300: i/o timeout
2021/05/28 23:12:29 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:12:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:32 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:53400->10.242.83.9:8300: i/o timeout
2021/05/28 23:12:32 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:12:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:38 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:12:39 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:53508->10.242.83.9:8300: i/o timeout
2021/05/28 23:12:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:40 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:12:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:42 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:53544->10.242.83.9:8300: i/o timeout
2021/05/28 23:12:42 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:12:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:45 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:12:45 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:12:48 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:12:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:50 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:53658->10.242.83.9:8300: i/o timeout
2021/05/28 23:12:51 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:12:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:52 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:53682->10.242.83.9:8300: i/o timeout
2021/05/28 23:12:52 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:12:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:12:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:01 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:53806->10.242.83.9:8300: i/o timeout
2021/05/28 23:13:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:02 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:53824->10.242.83.9:8300: i/o timeout
2021/05/28 23:13:02 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:13:03 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:13:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:12 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:53952->10.242.83.9:8300: i/o timeout
2021/05/28 23:13:13 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:53960->10.242.83.9:8300: i/o timeout
2021/05/28 23:13:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:14 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:13:14 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:13:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:18 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:13:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:24 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:54124->10.242.83.9:8300: i/o timeout
2021/05/28 23:13:24 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:54130->10.242.83.9:8300: i/o timeout
2021/05/28 23:13:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:27 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:13:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:27 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:13:27 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:13:28 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:13:30 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:13:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:37 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:54278->10.242.83.9:8300: i/o timeout
2021/05/28 23:13:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:38 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:13:38 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:54302->10.242.83.9:8300: i/o timeout
2021/05/28 23:13:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:42 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:13:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:44 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:13:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:52 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:54476->10.242.83.9:8300: i/o timeout
2021/05/28 23:13:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:54 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:54502->10.242.83.9:8300: i/o timeout
2021/05/28 23:13:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:13:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:02 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:14:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:04 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:14:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:09 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:14:09 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:14:12 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:54746->10.242.83.9:8300: i/o timeout
2021/05/28 23:14:12 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:14:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:14 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:54784->10.242.83.9:8300: i/o timeout
2021/05/28 23:14:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:22 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:14:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:25 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:14:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:28 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:14:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:32 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:55014->10.242.83.9:8300: i/o timeout
2021/05/28 23:14:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:35 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:55058->10.242.83.9:8300: i/o timeout
2021/05/28 23:14:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:43 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:14:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:46 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:14:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:51 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:14:51 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:14:53 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:55286->10.242.83.9:8300: i/o timeout
2021/05/28 23:14:54 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:14:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:56 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:55336->10.242.83.9:8300: i/o timeout
2021/05/28 23:14:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:14:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:03 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:15:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:07 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:15:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:08 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:15:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:13 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:55542->10.242.83.9:8300: i/o timeout
2021/05/28 23:15:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:17 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:55600->10.242.83.9:8300: i/o timeout
2021/05/28 23:15:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:23 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:15:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:28 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:15:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:33 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:55804->10.242.83.9:8300: i/o timeout
2021/05/28 23:15:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:33 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:15:33 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:15:36 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:15:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:38 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:55876->10.242.83.9:8300: i/o timeout
2021/05/28 23:15:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:43 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:15:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:49 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:15:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:53 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:56066->10.242.83.9:8300: i/o timeout
2021/05/28 23:15:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:15:59 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:56150->10.242.83.9:8300: i/o timeout
2021/05/28 23:16:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:04 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:16:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:10 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:16:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:14 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:56318->10.242.83.9:8300: i/o timeout
2021/05/28 23:16:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:15 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:16:15 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:16:18 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:16:18 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:16:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:20 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:56414->10.242.83.9:8300: i/o timeout
2021/05/28 23:16:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:24 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:16:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:31 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:16:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:34 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:56574->10.242.83.9:8300: i/o timeout
2021/05/28 23:16:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:38 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:16:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:41 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:56682->10.242.83.9:8300: i/o timeout
2021/05/28 23:16:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:44 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:16:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:52 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:16:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:54 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:56844->10.242.83.9:8300: i/o timeout
2021/05/28 23:16:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:16:57 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:16:57 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:16:58 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:16:58 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.83.9
2021/05/28 23:16:58 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:16:58 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive
2021/05/28 23:16:58 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.83.9
2021/05/28 23:16:58 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/28 23:17:04 [INFO] raft: pipelining replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/28 23:19:28 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:19:29 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:46374->10.242.83.9:8301: i/o timeout
2021/05/28 23:19:29 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:19:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:19:31 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:46396->10.242.83.9:8301: i/o timeout
2021/05/28 23:19:31 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:19:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:19:32 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500172528s
2021/05/28 23:19:33 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations)
2021/05/28 23:19:33 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.83.9
2021/05/28 23:19:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:48056->10.242.83.9:8302: i/o timeout
2021/05/28 23:19:33 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:19:33 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:19:33 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical
2021/05/28 23:19:33 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:19:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:19:34 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:19:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:19:36 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500318221s
2021/05/28 23:19:37 [INFO] raft: aborting pipeline replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/28 23:19:37 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:19:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:19:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:19:39 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500215366s
2021/05/28 23:19:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:19:42 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.94088176s
2021/05/28 23:19:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:19:44 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:57116->10.242.83.9:8300: i/o timeout
2021/05/28 23:19:44 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.379617141s
2021/05/28 23:19:45 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:19:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:19:47 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:59058->10.242.83.9:8300: i/o timeout
2021/05/28 23:19:47 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:19:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:19:48 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:48246->10.242.83.9:8302: i/o timeout
2021/05/28 23:19:48 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:19:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:19:52 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:19:52 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:19:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:19:55 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:59164->10.242.83.9:8300: i/o timeout
2021/05/28 23:19:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:19:56 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:19:57 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:59186->10.242.83.9:8300: i/o timeout
2021/05/28 23:19:57 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:19:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:19:58 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:48316->10.242.83.9:8302: i/o timeout
2021/05/28 23:19:58 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:19:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:19:59 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:20:02 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:20:02 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:20:03 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/05/28 23:20:03 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.83.9
2021/05/28 23:20:03 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/28 23:20:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:06 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:59306->10.242.83.9:8300: i/o timeout
2021/05/28 23:20:06 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:20:07 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:59324->10.242.83.9:8300: i/o timeout
2021/05/28 23:20:07 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:20:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:08 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:48512->10.242.83.9:8302: i/o timeout
2021/05/28 23:20:08 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:20:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:13 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:20:13 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.83.9:38838
2021/05/28 23:20:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:16 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:59446->10.242.83.9:8300: i/o timeout
2021/05/28 23:20:17 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:20:17 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:59456->10.242.83.9:8300: i/o timeout
2021/05/28 23:20:17 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:20:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:27 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:59582->10.242.83.9:8300: i/o timeout
2021/05/28 23:20:27 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:59584->10.242.83.9:8300: i/o timeout
2021/05/28 23:20:27 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:20:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:28 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:20:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:37 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:59710->10.242.83.9:8300: i/o timeout
2021/05/28 23:20:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:37 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:20:38 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:59716->10.242.83.9:8300: i/o timeout
2021/05/28 23:20:39 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:20:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:41 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:20:41 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:20:44 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:20:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:47 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:59848->10.242.83.9:8300: i/o timeout
2021/05/28 23:20:48 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:20:49 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:59874->10.242.83.9:8300: i/o timeout
2021/05/28 23:20:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:50 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:20:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:20:58 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:59980->10.242.83.9:8300: i/o timeout
2021/05/28 23:20:58 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:20:58 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:20:58 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:20:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:00 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:60028->10.242.83.9:8300: i/o timeout
2021/05/28 23:21:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:01 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:21:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:08 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:60142->10.242.83.9:8300: i/o timeout
2021/05/28 23:21:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:09 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:21:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:11 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:60180->10.242.83.9:8300: i/o timeout
2021/05/28 23:21:13 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:21:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:19 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:60296->10.242.83.9:8300: i/o timeout
2021/05/28 23:21:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:22 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:21:23 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:60338->10.242.83.9:8300: i/o timeout
2021/05/28 23:21:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:23 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:21:23 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:21:26 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:21:27 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:21:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:32 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:60448->10.242.83.9:8300: i/o timeout
2021/05/28 23:21:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:37 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:60520->10.242.83.9:8300: i/o timeout
2021/05/28 23:21:37 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:21:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:42 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:21:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:47 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:60654->10.242.83.9:8300: i/o timeout
2021/05/28 23:21:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:52 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:60720->10.242.83.9:8300: i/o timeout
2021/05/28 23:21:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:21:57 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:21:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:03 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:22:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:05 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:22:05 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:22:07 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:60910->10.242.83.9:8300: i/o timeout
2021/05/28 23:22:08 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:22:08 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:22:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:13 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:60996->10.242.83.9:8300: i/o timeout
2021/05/28 23:22:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:18 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:22:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:25 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:22:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:28 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:32952->10.242.83.9:8300: i/o timeout
2021/05/28 23:22:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:35 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:33046->10.242.83.9:8300: i/o timeout
2021/05/28 23:22:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:38 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:22:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:45 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:22:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:47 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:22:47 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:22:48 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:33226->10.242.83.9:8300: i/o timeout
2021/05/28 23:22:50 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:22:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:55 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:33310->10.242.83.9:8300: i/o timeout
2021/05/28 23:22:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:22:58 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:22:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:23:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:23:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:23:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:23:06 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:23:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:23:08 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:33478->10.242.83.9:8300: i/o timeout
2021/05/28 23:23:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:23:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:23:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:23:15 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.83.9
2021/05/28 23:23:15 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:23:15 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive
2021/05/28 23:23:15 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.83.9
2021/05/28 23:23:15 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/28 23:23:15 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0)
2021/05/28 23:23:18 [INFO] raft: pipelining replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/28 23:24:22 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:24:22 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:24:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:24:24 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500216096s
2021/05/28 23:24:25 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:50240->10.242.83.9:8301: i/o timeout
2021/05/28 23:24:25 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:24:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:24:26 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.83.9
2021/05/28 23:24:26 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:24:26 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical
2021/05/28 23:24:26 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.943489526s
2021/05/28 23:24:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:24:28 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.400313519s
2021/05/28 23:24:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:24:31 [INFO] raft: aborting pipeline replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/28 23:24:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:24:31 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:24:32 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:33748->10.242.83.9:8300: i/o timeout
2021/05/28 23:24:32 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:24:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:51976->10.242.83.9:8302: i/o timeout
2021/05/28 23:24:33 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:24:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:24:34 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500258343s
2021/05/28 23:24:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:24:36 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.958567853s
2021/05/28 23:24:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:24:39 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.419135686s
2021/05/28 23:24:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:24:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:24:41 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:34676->10.242.83.9:8300: i/o timeout
2021/05/28 23:24:41 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:24:42 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:34688->10.242.83.9:8300: i/o timeout
2021/05/28 23:24:43 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:24:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:24:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:24:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:24:48 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:52172->10.242.83.9:8302: i/o timeout
2021/05/28 23:24:48 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:24:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:24:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:24:51 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:34804->10.242.83.9:8300: i/o timeout
2021/05/28 23:24:51 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:24:53 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:34820->10.242.83.9:8300: i/o timeout
2021/05/28 23:24:53 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:24:53 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.83.9:41702
2021/05/28 23:24:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:24:54 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:24:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:24:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:24:58 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:52308->10.242.83.9:8302: i/o timeout
2021/05/28 23:24:58 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:24:58 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/05/28 23:24:58 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.83.9
2021/05/28 23:24:58 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/28 23:24:58 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:24:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:24:59 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:24:59 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:25:01 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:34942->10.242.83.9:8300: i/o timeout
2021/05/28 23:25:01 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:25:02 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:25:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:04 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:34970->10.242.83.9:8300: i/o timeout
2021/05/28 23:25:05 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:25:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:11 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:35076->10.242.83.9:8300: i/o timeout
2021/05/28 23:25:11 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:25:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:15 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:35122->10.242.83.9:8300: i/o timeout
2021/05/28 23:25:15 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:25:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:18 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:25:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:21 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:35212->10.242.83.9:8300: i/o timeout
2021/05/28 23:25:21 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:25:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:25 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:35268->10.242.83.9:8300: i/o timeout
2021/05/28 23:25:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:26 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:25:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:31 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:35350->10.242.83.9:8300: i/o timeout
2021/05/28 23:25:32 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:25:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:36 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:35412->10.242.83.9:8300: i/o timeout
2021/05/28 23:25:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:37 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:25:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:41 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:25:41 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:25:42 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:35494->10.242.83.9:8300: i/o timeout
2021/05/28 23:25:42 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:25:44 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:25:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:47 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:35574->10.242.83.9:8300: i/o timeout
2021/05/28 23:25:49 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:25:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:52 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:35630->10.242.83.9:8300: i/o timeout
2021/05/28 23:25:52 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:25:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:25:58 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:25:58 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:25:59 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:35724->10.242.83.9:8300: i/o timeout
2021/05/28 23:25:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:01 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:26:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:02 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:35780->10.242.83.9:8300: i/o timeout
2021/05/28 23:26:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:04 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:26:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:11 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:35894->10.242.83.9:8300: i/o timeout
2021/05/28 23:26:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:14 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:35930->10.242.83.9:8300: i/o timeout
2021/05/28 23:26:14 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:26:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:16 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:26:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:23 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:26:23 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:26:24 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:36078->10.242.83.9:8300: i/o timeout
2021/05/28 23:26:26 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:26:26 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/05/28 23:26:26 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:36100->10.242.83.9:8300: i/o timeout
2021/05/28 23:26:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:30 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:26:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:31 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:26:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:38 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:26:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:40 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:36282->10.242.83.9:8300: i/o timeout
2021/05/28 23:26:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:41 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:36302->10.242.83.9:8300: i/o timeout
2021/05/28 23:26:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:51 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:26:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:52 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:26:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:26:58 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:26:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:01 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:36560->10.242.83.9:8300: i/o timeout
2021/05/28 23:27:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:02 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:36574->10.242.83.9:8300: i/o timeout
2021/05/28 23:27:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:05 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:27:05 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:27:08 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:27:08 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:27:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:12 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:27:12 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:27:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:18 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:27:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:22 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:36838->10.242.83.9:8300: i/o timeout
2021/05/28 23:27:22 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:36840->10.242.83.9:8300: i/o timeout
2021/05/28 23:27:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:32 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:27:33 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:27:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:42 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:37110->10.242.83.9:8300: i/o timeout
2021/05/28 23:27:43 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:37116->10.242.83.9:8300: i/o timeout
2021/05/28 23:27:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:47 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:27:47 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:27:50 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:27:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:53 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:27:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:54 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:27:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:27:58 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:27:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:03 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:37376->10.242.83.9:8300: i/o timeout
2021/05/28 23:28:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:04 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:37396->10.242.83.9:8300: i/o timeout
2021/05/28 23:28:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:13 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:28:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:15 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:28:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:23 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:37638->10.242.83.9:8300: i/o timeout
2021/05/28 23:28:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:25 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:37678->10.242.83.9:8300: i/o timeout
2021/05/28 23:28:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:29 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:28:29 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:28:32 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:28:33 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:28:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:36 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:28:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:43 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:37900->10.242.83.9:8300: i/o timeout
2021/05/28 23:28:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:46 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:37946->10.242.83.9:8300: i/o timeout
2021/05/28 23:28:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:53 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:28:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:57 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:28:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:28:58 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:28:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:29:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:29:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:29:03 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:38166->10.242.83.9:8300: i/o timeout
2021/05/28 23:29:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:29:07 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:38212->10.242.83.9:8300: i/o timeout
2021/05/28 23:29:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:29:09 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.83.9
2021/05/28 23:29:09 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:29:09 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive
2021/05/28 23:29:09 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.83.9
2021/05/28 23:29:09 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/28 23:29:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:29:10 [WARN] raft: Rejecting vote request from 10.242.83.9:8300 since we have a leader: 10.242.3.200:8300
2021/05/28 23:29:13 [ERR] raft: peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300} has newer term, stopping replication
2021/05/28 23:29:13 [INFO] raft: Node at 10.242.3.200:8300 [Follower] entering Follower state (Leader: "")
2021/05/28 23:29:13 [INFO] raft: aborting pipeline replication to peer {Voter 50041021-4500-bc42-f855-8ce25b99549f 10.242.191.196:8300}
2021/05/28 23:29:13 [INFO] consul: cluster leadership lost
2021/05/28 23:29:16 [WARN] raft: Rejecting vote request from 10.242.83.9:8300 since our last index is greater (652, 598)
2021/05/28 23:29:22 [DEBUG] raft-net: 10.242.3.200:8300 accepted connection from: 10.242.191.196:45550
2021/05/28 23:29:22 [WARN] raft: Rejecting vote request from 10.242.83.9:8300 since our last index is greater (652, 598)
2021/05/28 23:29:23 [WARN] raft: Heartbeat timeout from "" reached, starting election
2021/05/28 23:29:23 [INFO] raft: Node at 10.242.3.200:8300 [Candidate] entering Candidate state in term 6
2021/05/28 23:29:23 [INFO] raft: Election won. Tally: 2
2021/05/28 23:29:23 [INFO] raft: Node at 10.242.3.200:8300 [Leader] entering Leader state
2021/05/28 23:29:23 [INFO] raft: Added peer 5b141322-0cbd-1277-55aa-4bb1f8763d72, starting replication
2021/05/28 23:29:23 [INFO] raft: Added peer 50041021-4500-bc42-f855-8ce25b99549f, starting replication
2021/05/28 23:29:23 [INFO] consul: cluster leadership acquired
2021/05/28 23:29:23 [INFO] consul: New leader elected: dev-consul-server-2
2021/05/28 23:29:23 [INFO] raft: pipelining replication to peer {Voter 50041021-4500-bc42-f855-8ce25b99549f 10.242.191.196:8300}
2021/05/28 23:29:23 [WARN] raft: AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300} rejected, sending older logs (next: 599)
2021/05/28 23:29:23 [INFO] raft: pipelining replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/28 23:30:20 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:30:20 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:30:22 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:30:22 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:30:24 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:30:24 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:30:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:30:25 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500235165s
2021/05/28 23:30:26 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:55036->10.242.83.9:8301: i/o timeout
2021/05/28 23:30:26 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:30:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:30:28 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.949879559s
2021/05/28 23:30:29 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations)
2021/05/28 23:30:29 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.83.9
2021/05/28 23:30:29 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:30:29 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical
2021/05/28 23:30:29 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:55066->10.242.83.9:8301: i/o timeout
2021/05/28 23:30:29 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:30:29 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:30:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:30:30 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:30:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:30:31 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:30:32 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:30:33 [INFO] raft: aborting pipeline replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/28 23:30:33 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:30:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:30:33 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:30:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:30:35 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500281598s
2021/05/28 23:30:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:30:37 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.912055972s
2021/05/28 23:30:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:30:40 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.40437002s
2021/05/28 23:30:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:30:43 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:56902->10.242.83.9:8302: i/o timeout
2021/05/28 23:30:43 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:30:43 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:38430->10.242.83.9:8300: i/o timeout
2021/05/28 23:30:43 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:30:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:30:43 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:39500->10.242.83.9:8300: i/o timeout
2021/05/28 23:30:44 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:30:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:30:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:30:49 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:30:49 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.83.9:44070
2021/05/28 23:30:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:30:50 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:30:50 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:30:52 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:30:53 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:57036->10.242.83.9:8302: i/o timeout
2021/05/28 23:30:53 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:30:53 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:39620->10.242.83.9:8300: i/o timeout
2021/05/28 23:30:53 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:30:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:30:54 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:39636->10.242.83.9:8300: i/o timeout
2021/05/28 23:30:55 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:30:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:30:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:30:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:02 [ERR] memberlist: failed to receive: read tcp 10.242.3.200:8301->10.242.83.9:34694: i/o timeout from=10.242.83.9:34694
2021/05/28 23:31:02 [ERR] memberlist: Failed to send error: write tcp 10.242.3.200:8301->10.242.83.9:34694: i/o timeout from=10.242.83.9:34694
2021/05/28 23:31:03 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:39756->10.242.83.9:8300: i/o timeout
2021/05/28 23:31:03 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:31:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:05 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:39790->10.242.83.9:8300: i/o timeout
2021/05/28 23:31:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:05 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:31:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:08 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:57178->10.242.83.9:8302: i/o timeout
2021/05/28 23:31:08 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:31:08 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.83.9
2021/05/28 23:31:08 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/28 23:31:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:10 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:31:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:13 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:39898->10.242.83.9:8300: i/o timeout
2021/05/28 23:31:13 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:31:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:15 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:39938->10.242.83.9:8300: i/o timeout
2021/05/28 23:31:16 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:31:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:23 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:40048->10.242.83.9:8300: i/o timeout
2021/05/28 23:31:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:23 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:31:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:26 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:40100->10.242.83.9:8300: i/o timeout
2021/05/28 23:31:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:27 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:31:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:31 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:31:31 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:31:33 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:40178->10.242.83.9:8300: i/o timeout
2021/05/28 23:31:33 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:31:34 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:31:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:37 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:40240->10.242.83.9:8300: i/o timeout
2021/05/28 23:31:38 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:31:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:43 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:40318->10.242.83.9:8300: i/o timeout
2021/05/28 23:31:43 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:31:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:48 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:40400->10.242.83.9:8300: i/o timeout
2021/05/28 23:31:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:49 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:31:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:53 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:40462->10.242.83.9:8300: i/o timeout
2021/05/28 23:31:54 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:31:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:58 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:31:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:31:59 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:40544->10.242.83.9:8300: i/o timeout
2021/05/28 23:32:00 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:32:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:04 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:40616->10.242.83.9:8300: i/o timeout
2021/05/28 23:32:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:05 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:32:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:10 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:40718->10.242.83.9:8300: i/o timeout
2021/05/28 23:32:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:12 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:32:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:13 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:32:13 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:32:15 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:40792->10.242.83.9:8300: i/o timeout
2021/05/28 23:32:16 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:32:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:18 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:32:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:22 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:40882->10.242.83.9:8300: i/o timeout
2021/05/28 23:32:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:26 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:32:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:28 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:40972->10.242.83.9:8300: i/o timeout
2021/05/28 23:32:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:33 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:32:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:36 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:41056->10.242.83.9:8300: i/o timeout
2021/05/28 23:32:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:38 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:32:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:40 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:32:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:42 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:32:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:43 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:41156->10.242.83.9:8300: i/o timeout
2021/05/28 23:32:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:52 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:41286->10.242.83.9:8300: i/o timeout
2021/05/28 23:32:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:53 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:32:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:32:55 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:32:55 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:32:58 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:32:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:03 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:33:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:03 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:41446->10.242.83.9:8300: i/o timeout
2021/05/28 23:33:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:13 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:41564->10.242.83.9:8300: i/o timeout
2021/05/28 23:33:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:13 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:33:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:23 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:33:23 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:41710->10.242.83.9:8300: i/o timeout
2021/05/28 23:33:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:33 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:41828->10.242.83.9:8300: i/o timeout
2021/05/28 23:33:34 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:33:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:37 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:33:37 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:33:40 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:33:40 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:33:40 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:33:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:44 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:41972->10.242.83.9:8300: i/o timeout
2021/05/28 23:33:44 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:33:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:54 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:33:54 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:42124->10.242.83.9:8300: i/o timeout
2021/05/28 23:33:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:33:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:04 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:42242->10.242.83.9:8300: i/o timeout
2021/05/28 23:34:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:06 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:34:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:14 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:34:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:16 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:42390->10.242.83.9:8300: i/o timeout
2021/05/28 23:34:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:19 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:34:19 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:34:22 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:34:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:24 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:42516->10.242.83.9:8300: i/o timeout
2021/05/28 23:34:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:27 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:34:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:34 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:34:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:37 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:42676->10.242.83.9:8300: i/o timeout
2021/05/28 23:34:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:44 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:42782->10.242.83.9:8300: i/o timeout
2021/05/28 23:34:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:48 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:34:48 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:34:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:55 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:34:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:34:58 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:42966->10.242.83.9:8300: i/o timeout
2021/05/28 23:34:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:35:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:35:01 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:35:01 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:35:04 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:35:05 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:43060->10.242.83.9:8300: i/o timeout
2021/05/28 23:35:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:35:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:35:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:35:09 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:35:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:35:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:35:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:35:15 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:35:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:35:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:35:19 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:43246->10.242.83.9:8300: i/o timeout
2021/05/28 23:35:21 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.83.9
2021/05/28 23:35:21 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/28 23:35:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:35:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:35:24 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.83.9
2021/05/28 23:35:24 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:35:24 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive
2021/05/28 23:35:24 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0.dc1)
2021/05/28 23:35:24 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0)
2021/05/28 23:35:24 [INFO] raft: pipelining replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/28 23:36:22 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:36:23 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500209139s
2021/05/28 23:36:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:36:25 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:59924->10.242.83.9:8301: i/o timeout
2021/05/28 23:36:25 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:36:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:36:27 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:59950->10.242.83.9:8301: i/o timeout
2021/05/28 23:36:27 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:36:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:36:29 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations)
2021/05/28 23:36:29 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.83.9
2021/05/28 23:36:29 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:36:29 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical
2021/05/28 23:36:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:36:30 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.505203851s
2021/05/28 23:36:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:36:33 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.945203138s
2021/05/28 23:36:34 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:36:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:36:35 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.379212281s
2021/05/28 23:36:37 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:36:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:36:38 [INFO] raft: aborting pipeline replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/28 23:36:38 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:33498->10.242.83.9:8302: i/o timeout
2021/05/28 23:36:38 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:36:38 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:36:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:36:40 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500161499s
2021/05/28 23:36:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:36:43 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.978687933s
2021/05/28 23:36:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:36:43 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:36:43 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:36:45 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.469849009s
2021/05/28 23:36:46 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:36:47 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:43552->10.242.83.9:8300: i/o timeout
2021/05/28 23:36:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:36:47 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:36:48 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:44444->10.242.83.9:8300: i/o timeout
2021/05/28 23:36:48 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:36:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:36:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:36:53 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:33712->10.242.83.9:8302: i/o timeout
2021/05/28 23:36:53 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:36:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:36:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:36:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:36:57 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:44584->10.242.83.9:8300: i/o timeout
2021/05/28 23:36:58 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:44594->10.242.83.9:8300: i/o timeout
2021/05/28 23:36:58 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:36:58 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:36:58 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:36:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:03 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:33782->10.242.83.9:8302: i/o timeout
2021/05/28 23:37:03 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:37:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:04 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:37:04 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.83.9:47340
2021/05/28 23:37:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:08 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/05/28 23:37:08 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.83.9
2021/05/28 23:37:08 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/28 23:37:08 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:44736->10.242.83.9:8300: i/o timeout
2021/05/28 23:37:08 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:37:08 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:44764->10.242.83.9:8300: i/o timeout
2021/05/28 23:37:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:09 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:37:10 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:37:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:13 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:34004->10.242.83.9:8302: i/o timeout
2021/05/28 23:37:13 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:37:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:18 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:44894->10.242.83.9:8300: i/o timeout
2021/05/28 23:37:18 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:37:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:19 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:44904->10.242.83.9:8300: i/o timeout
2021/05/28 23:37:20 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:37:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:25 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:37:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:25 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:37:28 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:45030->10.242.83.9:8300: i/o timeout
2021/05/28 23:37:28 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:37:28 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:37:28 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:37:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:30 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:45048->10.242.83.9:8300: i/o timeout
2021/05/28 23:37:31 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:37:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:38 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:45164->10.242.83.9:8300: i/o timeout
2021/05/28 23:37:38 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:37:38 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:37:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:41 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:45200->10.242.83.9:8300: i/o timeout
2021/05/28 23:37:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:41 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:37:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:48 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:45312->10.242.83.9:8300: i/o timeout
2021/05/28 23:37:48 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:37:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:51 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:45352->10.242.83.9:8300: i/o timeout
2021/05/28 23:37:52 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:37:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:58 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:45474->10.242.83.9:8300: i/o timeout
2021/05/28 23:37:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:37:59 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:38:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:02 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:45526->10.242.83.9:8300: i/o timeout
2021/05/28 23:38:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:04 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:38:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:07 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:38:07 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:38:09 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:45624->10.242.83.9:8300: i/o timeout
2021/05/28 23:38:10 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:38:10 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:38:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:14 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:45692->10.242.83.9:8300: i/o timeout
2021/05/28 23:38:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:16 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:38:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:20 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:45780->10.242.83.9:8300: i/o timeout
2021/05/28 23:38:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:23 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:38:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:26 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:45848->10.242.83.9:8300: i/o timeout
2021/05/28 23:38:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:29 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:38:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:33 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:45928->10.242.83.9:8300: i/o timeout
2021/05/28 23:38:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:38 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:38:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:39 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:46034->10.242.83.9:8300: i/o timeout
2021/05/28 23:38:40 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:38:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:45 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:38:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:48 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:46152->10.242.83.9:8300: i/o timeout
2021/05/28 23:38:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:49 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:38:49 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:38:52 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:38:52 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:38:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:55 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:46238->10.242.83.9:8300: i/o timeout
2021/05/28 23:38:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:38:58 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:38:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:06 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:39:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:08 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:46412->10.242.83.9:8300: i/o timeout
2021/05/28 23:39:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:16 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:46504->10.242.83.9:8300: i/o timeout
2021/05/28 23:39:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:18 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:39:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:27 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:39:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:28 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:46662->10.242.83.9:8300: i/o timeout
2021/05/28 23:39:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:31 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:39:31 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:39:34 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:39:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:37 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:46764->10.242.83.9:8300: i/o timeout
2021/05/28 23:39:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:39 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:39:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:40 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:39:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:48 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:39:49 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:46932->10.242.83.9:8300: i/o timeout
2021/05/28 23:39:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:58 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:47054->10.242.83.9:8300: i/o timeout
2021/05/28 23:39:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:39:59 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:40:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:09 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:40:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:09 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:47190->10.242.83.9:8300: i/o timeout
2021/05/28 23:40:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:13 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:40:13 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:40:16 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:40:16 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:40:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:18 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:40:19 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:47314->10.242.83.9:8300: i/o timeout
2021/05/28 23:40:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:19 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:40:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:29 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:47460->10.242.83.9:8300: i/o timeout
2021/05/28 23:40:30 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:40:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:39 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:40:40 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:47596->10.242.83.9:8300: i/o timeout
2021/05/28 23:40:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:49 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:47730->10.242.83.9:8300: i/o timeout
2021/05/28 23:40:50 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:40:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:40:55 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:40:55 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:40:58 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:40:58 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:40:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:41:00 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:41:00 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:47868->10.242.83.9:8300: i/o timeout
2021/05/28 23:41:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:41:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:41:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:41:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:41:08 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.83.9
2021/05/28 23:41:08 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:41:08 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive
2021/05/28 23:41:08 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.83.9
2021/05/28 23:41:08 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/28 23:41:08 [WARN] raft: Rejecting vote request from 10.242.83.9:8300 since we have a leader: 10.242.3.200:8300
2021/05/28 23:41:08 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0)
2021/05/28 23:41:08 [ERR] raft: peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300} has newer term, stopping replication
2021/05/28 23:41:08 [INFO] raft: Node at 10.242.3.200:8300 [Follower] entering Follower state (Leader: "")
2021/05/28 23:41:08 [INFO] raft: aborting pipeline replication to peer {Voter 50041021-4500-bc42-f855-8ce25b99549f 10.242.191.196:8300}
2021/05/28 23:41:08 [INFO] consul: cluster leadership lost
2021/05/28 23:41:14 [WARN] raft: Heartbeat timeout from "" reached, starting election
2021/05/28 23:41:14 [INFO] raft: Node at 10.242.3.200:8300 [Candidate] entering Candidate state in term 7
2021/05/28 23:41:14 [INFO] raft: Election won. Tally: 2
2021/05/28 23:41:14 [INFO] raft: Node at 10.242.3.200:8300 [Leader] entering Leader state
2021/05/28 23:41:14 [INFO] raft: Added peer 5b141322-0cbd-1277-55aa-4bb1f8763d72, starting replication
2021/05/28 23:41:14 [INFO] raft: Added peer 50041021-4500-bc42-f855-8ce25b99549f, starting replication
2021/05/28 23:41:14 [INFO] consul: cluster leadership acquired
2021/05/28 23:41:14 [INFO] consul: New leader elected: dev-consul-server-2
2021/05/28 23:41:14 [INFO] raft: pipelining replication to peer {Voter 50041021-4500-bc42-f855-8ce25b99549f 10.242.191.196:8300}
2021/05/28 23:41:14 [WARN] raft: AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300} rejected, sending older logs (next: 736)
2021/05/28 23:41:14 [INFO] raft: pipelining replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/28 23:42:23 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:42:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:42:26 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500562159s
2021/05/28 23:42:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:42:27 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:36548->10.242.83.9:8301: i/o timeout
2021/05/28 23:42:27 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:42:28 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.989183663s
2021/05/28 23:42:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:42:30 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations)
2021/05/28 23:42:30 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.83.9
2021/05/28 23:42:30 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:42:30 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical
2021/05/28 23:42:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:42:31 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:36610->10.242.83.9:8301: i/o timeout
2021/05/28 23:42:31 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:42:31 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.486186796s
2021/05/28 23:42:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:42:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:38270->10.242.83.9:8302: i/o timeout
2021/05/28 23:42:33 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:42:33 [INFO] raft: aborting pipeline replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/28 23:42:33 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:42:34 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:48238->10.242.83.9:8300: i/o timeout
2021/05/28 23:42:34 [ERR] memberlist: failed to receive: read tcp 10.242.3.200:8301->10.242.83.9:39496: i/o timeout from=10.242.83.9:39496
2021/05/28 23:42:34 [ERR] memberlist: Failed to send error: write tcp 10.242.3.200:8301->10.242.83.9:39496: i/o timeout from=10.242.83.9:39496
2021/05/28 23:42:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:42:35 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:42:36 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500258197s
2021/05/28 23:42:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:42:37 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:42:37 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:42:38 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.992530166s
2021/05/28 23:42:39 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:42:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:42:41 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.466413846s
2021/05/28 23:42:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:42:43 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:49232->10.242.83.9:8300: i/o timeout
2021/05/28 23:42:43 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:42:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:42:45 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:49256->10.242.83.9:8300: i/o timeout
2021/05/28 23:42:45 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:42:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:42:48 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:38474->10.242.83.9:8302: i/o timeout
2021/05/28 23:42:48 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:42:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:42:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:42:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:42:53 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:49364->10.242.83.9:8300: i/o timeout
2021/05/28 23:42:53 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:42:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:42:55 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:49396->10.242.83.9:8300: i/o timeout
2021/05/28 23:42:56 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:42:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:42:56 [ERR] memberlist: Push/Pull with dev-consul-server-0.dc1 failed: read tcp 10.242.3.200:38206->10.242.83.9:8302: i/o timeout
2021/05/28 23:42:58 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:38544->10.242.83.9:8302: i/o timeout
2021/05/28 23:42:58 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:42:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:03 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/05/28 23:43:03 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.83.9
2021/05/28 23:43:03 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/28 23:43:03 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:49512->10.242.83.9:8300: i/o timeout
2021/05/28 23:43:03 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:43:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:06 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:49550->10.242.83.9:8300: i/o timeout
2021/05/28 23:43:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:07 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:43:08 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:38790->10.242.83.9:8302: i/o timeout
2021/05/28 23:43:08 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:43:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:10 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:43:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:13 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:49670->10.242.83.9:8300: i/o timeout
2021/05/28 23:43:13 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:43:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:17 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:49738->10.242.83.9:8300: i/o timeout
2021/05/28 23:43:17 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:43:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:18 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:43:18 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:43:20 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:43:20 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.83.9:49154
2021/05/28 23:43:21 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:43:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:23 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:49866->10.242.83.9:8300: i/o timeout
2021/05/28 23:43:23 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:43:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:27 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:49926->10.242.83.9:8300: i/o timeout
2021/05/28 23:43:28 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:43:28 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:43:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:33 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:50028->10.242.83.9:8300: i/o timeout
2021/05/28 23:43:34 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:43:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:38 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:50096->10.242.83.9:8300: i/o timeout
2021/05/28 23:43:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:39 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:43:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:44 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:50166->10.242.83.9:8300: i/o timeout
2021/05/28 23:43:44 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:43:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:49 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:50236->10.242.83.9:8300: i/o timeout
2021/05/28 23:43:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:51 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:43:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:54 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:50298->10.242.83.9:8300: i/o timeout
2021/05/28 23:43:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:55 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:43:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:43:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:00 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:44:00 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:44:01 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:50386->10.242.83.9:8300: i/o timeout
2021/05/28 23:44:03 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:44:03 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:44:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:05 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:50438->10.242.83.9:8300: i/o timeout
2021/05/28 23:44:06 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:44:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:10 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:44:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:13 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:50534->10.242.83.9:8300: i/o timeout
2021/05/28 23:44:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:16 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:50580->10.242.83.9:8300: i/o timeout
2021/05/28 23:44:16 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:44:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:18 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:44:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:26 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:50718->10.242.83.9:8300: i/o timeout
2021/05/28 23:44:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:28 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:50750->10.242.83.9:8300: i/o timeout
2021/05/28 23:44:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:32 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:44:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:34 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:44:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:42 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:50914->10.242.83.9:8300: i/o timeout
2021/05/28 23:44:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:42 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:44:42 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:44:44 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:50944->10.242.83.9:8300: i/o timeout
2021/05/28 23:44:45 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:44:45 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:44:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:53 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:44:54 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:44:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:44:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:03 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:51200->10.242.83.9:8300: i/o timeout
2021/05/28 23:45:04 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:51206->10.242.83.9:8300: i/o timeout
2021/05/28 23:45:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:14 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:45:14 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:45:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:24 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:51470->10.242.83.9:8300: i/o timeout
2021/05/28 23:45:24 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:51472->10.242.83.9:8300: i/o timeout
2021/05/28 23:45:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:24 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:45:24 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:45:27 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:45:27 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:45:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:34 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:45:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:35 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:45:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:44 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:51730->10.242.83.9:8300: i/o timeout
2021/05/28 23:45:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:45 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:51740->10.242.83.9:8300: i/o timeout
2021/05/28 23:45:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:55 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:45:56 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:45:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:45:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:46:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:46:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:46:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:46:05 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:52004->10.242.83.9:8300: i/o timeout
2021/05/28 23:46:06 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:52014->10.242.83.9:8300: i/o timeout
2021/05/28 23:46:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:46:06 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:46:06 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:46:09 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:46:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:46:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:46:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:46:15 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:46:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:46:17 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:46:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:46:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:46:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:46:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:46:25 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:52264->10.242.83.9:8300: i/o timeout
2021/05/28 23:46:26 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.83.9
2021/05/28 23:46:26 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/28 23:46:26 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.83.9
2021/05/28 23:46:26 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:46:26 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive
2021/05/28 23:46:35 [INFO] raft: pipelining replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/28 23:48:21 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:48:21 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:48:25 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:41334->10.242.83.9:8301: i/o timeout
2021/05/28 23:48:25 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:48:25 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:48:25 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:48:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:48:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:48:29 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations)
2021/05/28 23:48:29 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:41390->10.242.83.9:8301: i/o timeout
2021/05/28 23:48:29 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:48:29 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.83.9
2021/05/28 23:48:29 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:48:29 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical
2021/05/28 23:48:30 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500356916s
2021/05/28 23:48:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:48:32 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.969467155s
2021/05/28 23:48:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:48:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:43070->10.242.83.9:8302: i/o timeout
2021/05/28 23:48:33 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:48:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:48:35 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.430038131s
2021/05/28 23:48:36 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:52560->10.242.83.9:8300: i/o timeout
2021/05/28 23:48:36 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:48:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:48:37 [INFO] raft: aborting pipeline replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/28 23:48:37 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:48:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:48:40 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.501084944s
2021/05/28 23:48:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:48:42 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.986281375s
2021/05/28 23:48:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:48:43 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:43158->10.242.83.9:8302: i/o timeout
2021/05/28 23:48:43 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:48:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:48:45 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.47774627s
2021/05/28 23:48:46 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:54094->10.242.83.9:8300: i/o timeout
2021/05/28 23:48:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:48:47 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:48:47 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:54112->10.242.83.9:8300: i/o timeout
2021/05/28 23:48:47 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:48:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:48:49 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:48:49 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:48:51 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:48:51 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:48:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:48:53 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:43404->10.242.83.9:8302: i/o timeout
2021/05/28 23:48:53 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:48:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:48:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:48:57 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:54270->10.242.83.9:8300: i/o timeout
2021/05/28 23:48:57 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:54274->10.242.83.9:8300: i/o timeout
2021/05/28 23:48:57 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:48:58 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:48:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:03 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:43534->10.242.83.9:8302: i/o timeout
2021/05/28 23:49:03 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:49:03 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/05/28 23:49:03 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.83.9
2021/05/28 23:49:03 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/28 23:49:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:07 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:49:07 [ERR] yamux: Failed to read stream data: read tcp 10.242.3.200:8300->10.242.83.9:52054: use of closed network connection
2021/05/28 23:49:07 [WARN] yamux: failed to send go away: session shutdown
2021/05/28 23:49:07 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.83.9:52054
2021/05/28 23:49:07 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:54406->10.242.83.9:8300: i/o timeout
2021/05/28 23:49:07 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:49:08 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:54434->10.242.83.9:8300: i/o timeout
2021/05/28 23:49:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:09 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:49:10 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:49:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:17 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:54550->10.242.83.9:8300: i/o timeout
2021/05/28 23:49:17 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:49:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:19 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:54576->10.242.83.9:8300: i/o timeout
2021/05/28 23:49:19 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:49:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:27 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:54688->10.242.83.9:8300: i/o timeout
2021/05/28 23:49:27 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:49:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:29 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:54730->10.242.83.9:8300: i/o timeout
2021/05/28 23:49:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:30 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:49:30 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:49:30 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:49:33 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:49:33 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/05/28 23:49:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:37 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:54826->10.242.83.9:8300: i/o timeout
2021/05/28 23:49:38 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:49:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:40 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:54878->10.242.83.9:8300: i/o timeout
2021/05/28 23:49:42 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:49:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:48 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:54962->10.242.83.9:8300: i/o timeout
2021/05/28 23:49:48 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:49:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:52 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:55022->10.242.83.9:8300: i/o timeout
2021/05/28 23:49:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:53 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:49:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:58 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:55110->10.242.83.9:8300: i/o timeout
2021/05/28 23:49:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:49:59 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:50:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:03 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:55166->10.242.83.9:8300: i/o timeout
2021/05/28 23:50:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:05 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:50:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:09 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:55250->10.242.83.9:8300: i/o timeout
2021/05/28 23:50:10 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:50:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:12 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:50:12 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:50:15 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:55330->10.242.83.9:8300: i/o timeout
2021/05/28 23:50:15 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:50:15 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:50:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:18 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:50:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:20 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:55402->10.242.83.9:8300: i/o timeout
2021/05/28 23:50:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:22 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:50:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:28 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:55520->10.242.83.9:8300: i/o timeout
2021/05/28 23:50:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:32 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:55564->10.242.83.9:8300: i/o timeout
2021/05/28 23:50:34 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:50:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:37 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:50:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:44 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:55714->10.242.83.9:8300: i/o timeout
2021/05/28 23:50:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:47 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:55758->10.242.83.9:8300: i/o timeout
2021/05/28 23:50:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:50:54 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:50:54 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:50:55 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:50:57 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:50:58 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:50:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:05 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:56000->10.242.83.9:8300: i/o timeout
2021/05/28 23:51:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:08 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:56050->10.242.83.9:8300: i/o timeout
2021/05/28 23:51:08 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:51:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:10 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:51:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:16 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:51:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:18 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:51:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:26 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:56280->10.242.83.9:8300: i/o timeout
2021/05/28 23:51:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:28 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:56314->10.242.83.9:8300: i/o timeout
2021/05/28 23:51:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:36 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:51:36 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:51:37 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:51:38 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:51:39 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:51:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:47 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:56546->10.242.83.9:8300: i/o timeout
2021/05/28 23:51:48 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:56572->10.242.83.9:8300: i/o timeout
2021/05/28 23:51:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:58 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:51:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:51:58 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:52:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:52:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:52:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:52:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:52:08 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:56856->10.242.83.9:8300: i/o timeout
2021/05/28 23:52:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:52:08 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:56858->10.242.83.9:8300: i/o timeout
2021/05/28 23:52:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:52:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:52:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:52:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:52:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:52:18 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:52:18 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:52:19 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:52:19 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:52:21 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:52:21 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:52:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:52:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:52:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:52:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:52:29 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:57156->10.242.83.9:8300: i/o timeout
2021/05/28 23:52:29 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:57160->10.242.83.9:8300: i/o timeout
2021/05/28 23:52:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:52:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:52:33 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.83.9
2021/05/28 23:52:33 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:52:33 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive
2021/05/28 23:52:33 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.83.9
2021/05/28 23:52:33 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/28 23:52:33 [WARN] raft: Rejecting vote request from 10.242.83.9:8300 since we have a leader: 10.242.3.200:8300
2021/05/28 23:52:39 [INFO] raft: pipelining replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/28 23:53:44 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:45692->10.242.83.9:8301: i/o timeout
2021/05/28 23:53:44 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:53:45 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500626374s
2021/05/28 23:53:45 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:53:45 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:53:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:53:47 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:45724->10.242.83.9:8301: i/o timeout
2021/05/28 23:53:47 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:53:48 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations)
2021/05/28 23:53:48 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.83.9
2021/05/28 23:53:48 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:53:48 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical
2021/05/28 23:53:48 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.917515432s
2021/05/28 23:53:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:53:51 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:53:51 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:53:52 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0)
2021/05/28 23:53:52 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.83.9
2021/05/28 23:53:52 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:53:52 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive
2021/05/28 23:53:57 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:53:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:53:59 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:45912->10.242.83.9:8301: i/o timeout
2021/05/28 23:53:59 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:54:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:01 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.50829854s
2021/05/28 23:54:02 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:45930->10.242.83.9:8301: i/o timeout
2021/05/28 23:54:02 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:54:02 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.83.9
2021/05/28 23:54:02 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:54:02 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical
2021/05/28 23:54:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:03 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:47590->10.242.83.9:8302: i/o timeout
2021/05/28 23:54:03 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:54:03 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.935167363s
2021/05/28 23:54:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:06 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.424990209s
2021/05/28 23:54:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:07 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:57482->10.242.83.9:8300: i/o timeout
2021/05/28 23:54:07 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:54:07 [ERR] memberlist: Push/Pull with dev-consul-server-0 failed: read tcp 10.242.3.200:45882->10.242.83.9:8301: i/o timeout
2021/05/28 23:54:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:08 [INFO] raft: aborting pipeline replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/28 23:54:09 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:54:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:11 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500415765s
2021/05/28 23:54:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:13 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:47656->10.242.83.9:8302: i/o timeout
2021/05/28 23:54:13 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:54:13 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:54:13 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.83.9:55254
2021/05/28 23:54:13 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.969023504s
2021/05/28 23:54:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:16 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.437228877s
2021/05/28 23:54:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:17 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:58600->10.242.83.9:8300: i/o timeout
2021/05/28 23:54:18 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:54:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:19 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:58624->10.242.83.9:8300: i/o timeout
2021/05/28 23:54:19 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:54:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:28 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:47914->10.242.83.9:8302: i/o timeout
2021/05/28 23:54:28 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:54:28 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:58748->10.242.83.9:8300: i/o timeout
2021/05/28 23:54:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:29 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:58750->10.242.83.9:8300: i/o timeout
2021/05/28 23:54:29 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:54:29 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:54:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:30 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:54:30 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:54:33 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/05/28 23:54:33 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.83.9
2021/05/28 23:54:33 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/28 23:54:33 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:54:33 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:54:33 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/05/28 23:54:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:39 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:58880->10.242.83.9:8300: i/o timeout
2021/05/28 23:54:39 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:58882->10.242.83.9:8300: i/o timeout
2021/05/28 23:54:39 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:54:39 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:54:40 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:54:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:43 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:48052->10.242.83.9:8302: i/o timeout
2021/05/28 23:54:43 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:54:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:49 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:59020->10.242.83.9:8300: i/o timeout
2021/05/28 23:54:49 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:54:49 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:59034->10.242.83.9:8300: i/o timeout
2021/05/28 23:54:50 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:54:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:54:59 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:59158->10.242.83.9:8300: i/o timeout
2021/05/28 23:54:59 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:55:00 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:59184->10.242.83.9:8300: i/o timeout
2021/05/28 23:55:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:01 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:55:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:09 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:59288->10.242.83.9:8300: i/o timeout
2021/05/28 23:55:09 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:55:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:11 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:59318->10.242.83.9:8300: i/o timeout
2021/05/28 23:55:12 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:55:12 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:55:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:12 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:55:15 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:55:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:18 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:55:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:19 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:59424->10.242.83.9:8300: i/o timeout
2021/05/28 23:55:19 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:55:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:22 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:59466->10.242.83.9:8300: i/o timeout
2021/05/28 23:55:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:23 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:55:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:29 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:59570->10.242.83.9:8300: i/o timeout
2021/05/28 23:55:30 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:55:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:33 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:59632->10.242.83.9:8300: i/o timeout
2021/05/28 23:55:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:36 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:55:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:40 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:59718->10.242.83.9:8300: i/o timeout
2021/05/28 23:55:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:41 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:55:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:46 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:59794->10.242.83.9:8300: i/o timeout
2021/05/28 23:55:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:49 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:55:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:51 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:59864->10.242.83.9:8300: i/o timeout
2021/05/28 23:55:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:54 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:55:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:54 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:55:54 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:55:57 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:55:58 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:55:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:55:59 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:59960->10.242.83.9:8300: i/o timeout
2021/05/28 23:56:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:04 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:60024->10.242.83.9:8300: i/o timeout
2021/05/28 23:56:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:04 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:56:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:09 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:56:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:14 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:60168->10.242.83.9:8300: i/o timeout
2021/05/28 23:56:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:19 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:60232->10.242.83.9:8300: i/o timeout
2021/05/28 23:56:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:26 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:56:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:29 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:56:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:36 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:60450->10.242.83.9:8300: i/o timeout
2021/05/28 23:56:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:36 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:56:36 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:56:38 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:56:39 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:60504->10.242.83.9:8300: i/o timeout
2021/05/28 23:56:39 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:56:39 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:56:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:44 [ERR] memberlist: failed to receive: read tcp 10.242.3.200:8302->10.242.83.9:34216: i/o timeout from=10.242.83.9:34216
2021/05/28 23:56:44 [ERR] memberlist: Failed to send error: write tcp 10.242.3.200:8302->10.242.83.9:34216: i/o timeout from=10.242.83.9:34216
2021/05/28 23:56:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:47 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:56:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:49 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:56:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:57 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:60728->10.242.83.9:8300: i/o timeout
2021/05/28 23:56:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:56:59 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:60774->10.242.83.9:8300: i/o timeout
2021/05/28 23:57:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:08 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:57:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:10 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:57:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:18 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:32804->10.242.83.9:8300: i/o timeout
2021/05/28 23:57:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:18 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:57:18 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:57:20 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:32846->10.242.83.9:8300: i/o timeout
2021/05/28 23:57:21 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:57:21 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:57:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:28 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:57:30 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:57:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:38 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:33118->10.242.83.9:8300: i/o timeout
2021/05/28 23:57:40 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:33138->10.242.83.9:8300: i/o timeout
2021/05/28 23:57:40 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/28 23:57:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:48 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:57:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:49 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:57:50 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:57:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:57:59 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:33410->10.242.83.9:8300: i/o timeout
2021/05/28 23:58:00 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:33418->10.242.83.9:8300: i/o timeout
2021/05/28 23:58:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:58:00 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/28 23:58:00 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/28 23:58:03 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:58:03 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/05/28 23:58:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:58:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:58:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:58:10 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:58:10 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:58:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:58:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:58:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:58:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:58:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:58:20 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:33688->10.242.83.9:8300: i/o timeout
2021/05/28 23:58:20 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:33690->10.242.83.9:8300: i/o timeout
2021/05/28 23:58:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:58:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:58:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:58:26 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.83.9
2021/05/28 23:58:26 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/28 23:58:26 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0)
2021/05/28 23:58:26 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.83.9
2021/05/28 23:58:26 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:58:26 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive
2021/05/28 23:58:31 [INFO] raft: pipelining replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/28 23:59:45 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/28 23:59:45 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/28 23:59:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:59:48 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:50942->10.242.83.9:8301: i/o timeout
2021/05/28 23:59:48 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/28 23:59:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:59:49 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500385987s
2021/05/28 23:59:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:59:51 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.978715885s
2021/05/28 23:59:52 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations)
2021/05/28 23:59:52 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.83.9
2021/05/28 23:59:52 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/28 23:59:52 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical
2021/05/28 23:59:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:59:53 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:52662->10.242.83.9:8302: i/o timeout
2021/05/28 23:59:53 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/28 23:59:54 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.449817629s
2021/05/28 23:59:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:59:55 [INFO] raft: aborting pipeline replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/28 23:59:55 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:59:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:59:57 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:33958->10.242.83.9:8300: i/o timeout
2021/05/28 23:59:57 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500269725s
2021/05/28 23:59:58 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/28 23:59:58 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/28 23:59:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/28 23:59:59 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.990933629s
2021/05/29 00:00:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:02 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.442877949s
2021/05/29 00:00:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:05 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:35412->10.242.83.9:8300: i/o timeout
2021/05/29 00:00:05 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:00:05 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:00:05 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.83.9:59836
2021/05/29 00:00:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:08 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:52866->10.242.83.9:8302: i/o timeout
2021/05/29 00:00:08 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/29 00:00:08 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:35450->10.242.83.9:8300: i/o timeout
2021/05/29 00:00:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:09 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:00:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:12 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:00:12 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:00:15 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:35548->10.242.83.9:8300: i/o timeout
2021/05/29 00:00:15 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:00:15 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:00:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:18 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:52956->10.242.83.9:8302: i/o timeout
2021/05/29 00:00:18 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/29 00:00:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:19 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:35612->10.242.83.9:8300: i/o timeout
2021/05/29 00:00:19 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:00:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:23 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/05/29 00:00:23 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.83.9
2021/05/29 00:00:23 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/29 00:00:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:25 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:35714->10.242.83.9:8300: i/o timeout
2021/05/29 00:00:25 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:00:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:28 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:53162->10.242.83.9:8302: i/o timeout
2021/05/29 00:00:28 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/29 00:00:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:29 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:35774->10.242.83.9:8300: i/o timeout
2021/05/29 00:00:30 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:00:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:35 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:35846->10.242.83.9:8300: i/o timeout
2021/05/29 00:00:35 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:00:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:40 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:35920->10.242.83.9:8300: i/o timeout
2021/05/29 00:00:40 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/29 00:00:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:41 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:00:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:45 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:35996->10.242.83.9:8300: i/o timeout
2021/05/29 00:00:45 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:00:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:51 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:36076->10.242.83.9:8300: i/o timeout
2021/05/29 00:00:52 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:00:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:00:54 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:00:54 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:00:55 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:36138->10.242.83.9:8300: i/o timeout
2021/05/29 00:00:55 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:00:57 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:00:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:02 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:36222->10.242.83.9:8300: i/o timeout
2021/05/29 00:01:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:03 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:01:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:05 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:36274->10.242.83.9:8300: i/o timeout
2021/05/29 00:01:05 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:01:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:13 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:36374->10.242.83.9:8300: i/o timeout
2021/05/29 00:01:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:14 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:01:15 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:36406->10.242.83.9:8300: i/o timeout
2021/05/29 00:01:16 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:01:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:24 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:36526->10.242.83.9:8300: i/o timeout
2021/05/29 00:01:26 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:36544->10.242.83.9:8300: i/o timeout
2021/05/29 00:01:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:27 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:01:27 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:01:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:36 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:01:36 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:01:37 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:36684->10.242.83.9:8300: i/o timeout
2021/05/29 00:01:37 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:36700->10.242.83.9:8300: i/o timeout
2021/05/29 00:01:38 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:01:38 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/29 00:01:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:40 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:01:40 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:01:40 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/29 00:01:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:50 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:36972->10.242.83.9:8300: i/o timeout
2021/05/29 00:01:50 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:36974->10.242.83.9:8300: i/o timeout
2021/05/29 00:01:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:53 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/29 00:01:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:55 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:01:56 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:01:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:01:57 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/29 00:01:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:05 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:37228->10.242.83.9:8300: i/o timeout
2021/05/29 00:02:06 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:37240->10.242.83.9:8300: i/o timeout
2021/05/29 00:02:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:11 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/29 00:02:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/05/29 00:02:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/05/29 00:02:15 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:02:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:17 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:02:17 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:02:17 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:02:19 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:02:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:25 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:37520->10.242.83.9:8300: i/o timeout
2021/05/29 00:02:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:27 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:37538->10.242.83.9:8300: i/o timeout
2021/05/29 00:02:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:36 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:02:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:38 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:02:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:46 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:37828->10.242.83.9:8300: i/o timeout
2021/05/29 00:02:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:48 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:37876->10.242.83.9:8300: i/o timeout
2021/05/29 00:02:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:56 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:02:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:02:58 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:02:58 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:02:59 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:03:01 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:03:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:06 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:38128->10.242.83.9:8300: i/o timeout
2021/05/29 00:03:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:09 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:38172->10.242.83.9:8300: i/o timeout
2021/05/29 00:03:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:16 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:03:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:20 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:03:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:26 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:38414->10.242.83.9:8300: i/o timeout
2021/05/29 00:03:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:30 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:38472->10.242.83.9:8300: i/o timeout
2021/05/29 00:03:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:36 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:03:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:38 [ERR] memberlist: failed to receive: read tcp 10.242.3.200:8302->10.242.83.9:37154: i/o timeout from=10.242.83.9:37154
2021/05/29 00:03:38 [ERR] memberlist: Failed to send error: write tcp 10.242.3.200:8302->10.242.83.9:37154: i/o timeout from=10.242.83.9:37154
2021/05/29 00:03:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:40 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/29 00:03:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:40 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:03:40 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:03:41 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:03:43 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:03:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:46 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:38710->10.242.83.9:8300: i/o timeout
2021/05/29 00:03:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:48 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/29 00:03:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:51 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:38788->10.242.83.9:8300: i/o timeout
2021/05/29 00:03:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:03:57 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:03:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:04:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:04:02 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:04:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:04:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:04:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:04:07 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:39016->10.242.83.9:8300: i/o timeout
2021/05/29 00:04:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:04:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:04:12 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:39086->10.242.83.9:8300: i/o timeout
2021/05/29 00:04:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:04:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:04:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:04:17 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:04:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:04:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:04:22 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0.dc1)
2021/05/29 00:04:22 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.83.9
2021/05/29 00:04:22 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/29 00:04:22 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.83.9
2021/05/29 00:04:22 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/29 00:04:22 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive
2021/05/29 00:04:22 [WARN] raft: Rejecting vote request from 10.242.83.9:8300 since we have a leader: 10.242.3.200:8300
2021/05/29 00:04:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:04:23 [ERR] raft: peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300} has newer term, stopping replication
2021/05/29 00:04:23 [INFO] raft: Node at 10.242.3.200:8300 [Follower] entering Follower state (Leader: "")
2021/05/29 00:04:23 [INFO] raft: aborting pipeline replication to peer {Voter 50041021-4500-bc42-f855-8ce25b99549f 10.242.191.196:8300}
2021/05/29 00:04:23 [INFO] consul: cluster leadership lost
2021/05/29 00:04:26 [WARN] consul.coordinate: Batch update failed: node is not the leader
2021/05/29 00:04:29 [WARN] raft: Rejecting vote request from 10.242.83.9:8300 since our last index is greater (1053, 1006)
2021/05/29 00:04:31 [ERR] agent: Coordinate update error: No cluster leader
2021/05/29 00:04:32 [WARN] raft: Heartbeat timeout from "" reached, starting election
2021/05/29 00:04:32 [INFO] raft: Node at 10.242.3.200:8300 [Candidate] entering Candidate state in term 10
2021/05/29 00:04:32 [INFO] raft: Election won. Tally: 2
2021/05/29 00:04:32 [INFO] raft: Node at 10.242.3.200:8300 [Leader] entering Leader state
2021/05/29 00:04:32 [INFO] raft: Added peer 5b141322-0cbd-1277-55aa-4bb1f8763d72, starting replication
2021/05/29 00:04:32 [INFO] raft: Added peer 50041021-4500-bc42-f855-8ce25b99549f, starting replication
2021/05/29 00:04:32 [INFO] consul: cluster leadership acquired
2021/05/29 00:04:32 [INFO] consul: New leader elected: dev-consul-server-2
2021/05/29 00:04:32 [INFO] raft: pipelining replication to peer {Voter 50041021-4500-bc42-f855-8ce25b99549f 10.242.191.196:8300}
2021/05/29 00:04:32 [WARN] raft: AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300} rejected, sending older logs (next: 1007)
2021/05/29 00:04:32 [INFO] raft: pipelining replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/29 00:05:33 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:05:33 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/29 00:05:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:05:35 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500170534s
2021/05/29 00:05:36 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:56102->10.242.83.9:8301: i/o timeout
2021/05/29 00:05:36 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/29 00:05:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:05:37 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 5.000612162s
2021/05/29 00:05:38 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations)
2021/05/29 00:05:38 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.83.9
2021/05/29 00:05:38 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/29 00:05:38 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical
2021/05/29 00:05:38 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.83.9
2021/05/29 00:05:38 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/29 00:05:38 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive
2021/05/29 00:05:38 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0)
2021/05/29 00:05:47 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:05:49 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500252011s
2021/05/29 00:05:49 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:05:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:05:51 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:56314->10.242.83.9:8301: i/o timeout
2021/05/29 00:05:51 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/29 00:05:51 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations)
2021/05/29 00:05:51 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.83.9
2021/05/29 00:05:51 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/29 00:05:51 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical
2021/05/29 00:05:51 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.966699825s
2021/05/29 00:05:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:05:54 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.42903661s
2021/05/29 00:05:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:05:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:05:56 [ERR] raft: Failed to pipeline AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: write tcp 10.242.3.200:39390->10.242.83.9:8300: use of closed network connection
2021/05/29 00:05:56 [INFO] raft: aborting pipeline replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/29 00:05:56 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:05:57 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:39296->10.242.83.9:8300: i/o timeout
2021/05/29 00:05:58 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:58038->10.242.83.9:8302: i/o timeout
2021/05/29 00:05:58 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/29 00:05:58 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:05:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:05:59 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500210464s
2021/05/29 00:05:59 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:05:59 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.83.9:34046
2021/05/29 00:06:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:01 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:06:02 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:06:02 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:06:02 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500208808s
2021/05/29 00:06:03 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:06:03 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/29 00:06:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:05 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.947113042s
2021/05/29 00:06:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:06 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:40740->10.242.83.9:8300: i/o timeout
2021/05/29 00:06:06 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:06:07 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.445398561s
2021/05/29 00:06:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:10 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:06:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:11 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.83.9
2021/05/29 00:06:11 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/29 00:06:11 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive
2021/05/29 00:06:12 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500218806s
2021/05/29 00:06:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:13 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:58262->10.242.83.9:8302: i/o timeout
2021/05/29 00:06:13 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/29 00:06:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:56638->10.242.83.9:8301: i/o timeout
2021/05/29 00:06:14 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/29 00:06:14 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.994247775s
2021/05/29 00:06:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:15 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:56662->10.242.83.9:8301: i/o timeout
2021/05/29 00:06:15 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/29 00:06:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:16 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:40884->10.242.83.9:8300: i/o timeout
2021/05/29 00:06:17 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.466015546s
2021/05/29 00:06:17 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations)
2021/05/29 00:06:17 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.83.9
2021/05/29 00:06:17 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/29 00:06:17 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical
2021/05/29 00:06:18 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:56698->10.242.83.9:8301: i/o timeout
2021/05/29 00:06:18 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/29 00:06:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:20 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:40754->10.242.83.9:8300: i/o timeout
2021/05/29 00:06:20 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:06:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:23 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:58332->10.242.83.9:8302: i/o timeout
2021/05/29 00:06:23 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/29 00:06:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:26 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:41034->10.242.83.9:8300: i/o timeout
2021/05/29 00:06:26 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:06:28 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/29 00:06:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:30 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:41096->10.242.83.9:8300: i/o timeout
2021/05/29 00:06:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:31 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:06:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:58550->10.242.83.9:8302: i/o timeout
2021/05/29 00:06:33 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/29 00:06:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:36 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:41174->10.242.83.9:8300: i/o timeout
2021/05/29 00:06:36 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:06:38 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/05/29 00:06:38 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.83.9
2021/05/29 00:06:38 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/29 00:06:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:40 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/29 00:06:41 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:41252->10.242.83.9:8300: i/o timeout
2021/05/29 00:06:42 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:06:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:42 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:06:42 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:06:45 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:06:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:46 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:41320->10.242.83.9:8300: i/o timeout
2021/05/29 00:06:46 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:06:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:52 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:41398->10.242.83.9:8300: i/o timeout
2021/05/29 00:06:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:53 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:06:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:06:56 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:41470->10.242.83.9:8300: i/o timeout
2021/05/29 00:06:57 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:06:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:03 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:41554->10.242.83.9:8300: i/o timeout
2021/05/29 00:07:03 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:07:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:07 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:41612->10.242.83.9:8300: i/o timeout
2021/05/29 00:07:07 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:07:08 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/29 00:07:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:13 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:41710->10.242.83.9:8300: i/o timeout
2021/05/29 00:07:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:14 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:07:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:17 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:41758->10.242.83.9:8300: i/o timeout
2021/05/29 00:07:18 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:07:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:24 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:07:24 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:07:24 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:41872->10.242.83.9:8300: i/o timeout
2021/05/29 00:07:26 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:07:27 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:07:27 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/29 00:07:28 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:41912->10.242.83.9:8300: i/o timeout
2021/05/29 00:07:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:29 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:07:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:36 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:42022->10.242.83.9:8300: i/o timeout
2021/05/29 00:07:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:37 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:07:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:39 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:42078->10.242.83.9:8300: i/o timeout
2021/05/29 00:07:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:40 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/29 00:07:41 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.83.9
2021/05/29 00:07:41 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/29 00:07:41 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive
2021/05/29 00:07:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:57902->10.242.83.9:8301: i/o timeout
2021/05/29 00:07:42 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/29 00:07:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:57928->10.242.83.9:8301: i/o timeout
2021/05/29 00:07:45 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/29 00:07:46 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.83.9
2021/05/29 00:07:46 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/29 00:07:46 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical
2021/05/29 00:07:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:47 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:42186->10.242.83.9:8300: i/o timeout
2021/05/29 00:07:48 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/29 00:07:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:49 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:07:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:51 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:42252->10.242.83.9:8300: i/o timeout
2021/05/29 00:07:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:57 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:07:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:07:59 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:42392->10.242.83.9:8300: i/o timeout
2021/05/29 00:08:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:03 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:08:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:06 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:08:06 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:08:07 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:42480->10.242.83.9:8300: i/o timeout
2021/05/29 00:08:09 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:08:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:13 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:42564->10.242.83.9:8300: i/o timeout
2021/05/29 00:08:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:17 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:08:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:19 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:08:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:20 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:08:20 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.83.9:36368
2021/05/29 00:08:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:27 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:42788->10.242.83.9:8300: i/o timeout
2021/05/29 00:08:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:29 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:42814->10.242.83.9:8300: i/o timeout
2021/05/29 00:08:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:37 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:08:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:39 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:08:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:40 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/29 00:08:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:47 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:43070->10.242.83.9:8300: i/o timeout
2021/05/29 00:08:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:48 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:08:48 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:08:49 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:43118->10.242.83.9:8300: i/o timeout
2021/05/29 00:08:51 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:08:51 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/29 00:08:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:08:57 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:08:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:01 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:09:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:07 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:43362->10.242.83.9:8300: i/o timeout
2021/05/29 00:09:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:11 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:43416->10.242.83.9:8300: i/o timeout
2021/05/29 00:09:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:18 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:09:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:22 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:09:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:28 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:43646->10.242.83.9:8300: i/o timeout
2021/05/29 00:09:28 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/29 00:09:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:30 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:09:30 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:09:32 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:43708->10.242.83.9:8300: i/o timeout
2021/05/29 00:09:33 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:09:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:38 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:09:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:43 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:09:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:48 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:43948->10.242.83.9:8300: i/o timeout
2021/05/29 00:09:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:53 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:44004->10.242.83.9:8300: i/o timeout
2021/05/29 00:09:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:09:58 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:09:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:04 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:10:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:08 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/29 00:10:08 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:44230->10.242.83.9:8300: i/o timeout
2021/05/29 00:10:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:10 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/29 00:10:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:12 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:10:12 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:10:14 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:44304->10.242.83.9:8300: i/o timeout
2021/05/29 00:10:15 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:10:15 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/29 00:10:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:18 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:10:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:24 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:10:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:28 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:44524->10.242.83.9:8300: i/o timeout
2021/05/29 00:10:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:34 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:44614->10.242.83.9:8300: i/o timeout
2021/05/29 00:10:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:39 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:10:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:45 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:10:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:49 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:44812->10.242.83.9:8300: i/o timeout
2021/05/29 00:10:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:54 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:10:54 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:10:55 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:44908->10.242.83.9:8300: i/o timeout
2021/05/29 00:10:57 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:10:57 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/29 00:10:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:10:59 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:11:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:11:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:11:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:11:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:11:06 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:11:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:11:09 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:45100->10.242.83.9:8300: i/o timeout
2021/05/29 00:11:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:11:10 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/29 00:11:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:11:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:11:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:11:16 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:45210->10.242.83.9:8300: i/o timeout
2021/05/29 00:11:17 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.83.9
2021/05/29 00:11:17 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/29 00:11:17 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive
2021/05/29 00:11:17 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.83.9
2021/05/29 00:11:17 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/29 00:11:18 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0.dc1)
2021/05/29 00:11:19 [INFO] raft: pipelining replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/29 00:12:21 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:12:21 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/29 00:12:22 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500106576s
2021/05/29 00:12:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:12:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:33764->10.242.83.9:8301: i/o timeout
2021/05/29 00:12:24 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/29 00:12:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:12:25 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.9537754s
2021/05/29 00:12:25 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations)
2021/05/29 00:12:25 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.83.9
2021/05/29 00:12:25 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/29 00:12:25 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical
2021/05/29 00:12:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:12:27 [WARN] memberlist: Was able to connect to dev-consul-server-0 but other probes failed, network may be misconfigured
2021/05/29 00:12:27 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.443407261s
2021/05/29 00:12:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:12:30 [INFO] raft: aborting pipeline replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/29 00:12:30 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:12:30 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:45528->10.242.83.9:8300: i/o timeout
2021/05/29 00:12:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:12:31 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:12:32 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.503638456s
2021/05/29 00:12:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:12:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:35534->10.242.83.9:8302: i/o timeout
2021/05/29 00:12:33 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/29 00:12:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:12:35 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 5.00060369s
2021/05/29 00:12:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:12:37 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.495557492s
2021/05/29 00:12:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:12:40 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:46446->10.242.83.9:8300: i/o timeout
2021/05/29 00:12:40 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:12:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:12:41 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:46462->10.242.83.9:8300: i/o timeout
2021/05/29 00:12:41 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:12:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:12:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:12:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:12:47 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:12:47 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.83.9:37280
2021/05/29 00:12:48 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:35748->10.242.83.9:8302: i/o timeout
2021/05/29 00:12:48 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/29 00:12:48 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/29 00:12:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:12:50 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:46598->10.242.83.9:8300: i/o timeout
2021/05/29 00:12:50 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:12:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:12:51 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:46616->10.242.83.9:8300: i/o timeout
2021/05/29 00:12:52 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:12:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:12:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:12:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:12:58 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:35832->10.242.83.9:8302: i/o timeout
2021/05/29 00:12:58 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/29 00:12:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:00 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:46744->10.242.83.9:8300: i/o timeout
2021/05/29 00:13:00 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:13:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:02 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:46774->10.242.83.9:8300: i/o timeout
2021/05/29 00:13:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:03 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/05/29 00:13:03 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.83.9
2021/05/29 00:13:03 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/29 00:13:03 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:13:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:10 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:46900->10.242.83.9:8300: i/o timeout
2021/05/29 00:13:10 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:13:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:13 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:13:13 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:13:13 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:46940->10.242.83.9:8300: i/o timeout
2021/05/29 00:13:14 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:13:15 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:13:15 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/29 00:13:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:20 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:47052->10.242.83.9:8300: i/o timeout
2021/05/29 00:13:20 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:13:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:24 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:47110->10.242.83.9:8300: i/o timeout
2021/05/29 00:13:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:25 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:13:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:28 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/29 00:13:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:30 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:47208->10.242.83.9:8300: i/o timeout
2021/05/29 00:13:30 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:13:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:35 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:47288->10.242.83.9:8300: i/o timeout
2021/05/29 00:13:36 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:13:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:40 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:47368->10.242.83.9:8300: i/o timeout
2021/05/29 00:13:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:40 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:13:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:46 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:47460->10.242.83.9:8300: i/o timeout
2021/05/29 00:13:48 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:13:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:50 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:47528->10.242.83.9:8300: i/o timeout
2021/05/29 00:13:51 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:13:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:13:54 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:13:54 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:13:57 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:13:58 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:47624->10.242.83.9:8300: i/o timeout
2021/05/29 00:13:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:00 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:14:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:01 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:47678->10.242.83.9:8300: i/o timeout
2021/05/29 00:14:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:02 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:14:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:10 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:47810->10.242.83.9:8300: i/o timeout
2021/05/29 00:14:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:12 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:47840->10.242.83.9:8300: i/o timeout
2021/05/29 00:14:13 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:14:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:15 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:14:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:23 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:48016->10.242.83.9:8300: i/o timeout
2021/05/29 00:14:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:25 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:48038->10.242.83.9:8300: i/o timeout
2021/05/29 00:14:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:29 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:14:30 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:14:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:36 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:14:36 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:14:38 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/29 00:14:39 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:48244->10.242.83.9:8300: i/o timeout
2021/05/29 00:14:39 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:14:39 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/29 00:14:40 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:48260->10.242.83.9:8300: i/o timeout
2021/05/29 00:14:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:50 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:14:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:50 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:14:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:14:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:00 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:48554->10.242.83.9:8300: i/o timeout
2021/05/29 00:15:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:00 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:48562->10.242.83.9:8300: i/o timeout
2021/05/29 00:15:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:10 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:15:11 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:15:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:17 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/29 00:15:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:18 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:15:18 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:15:20 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:48860->10.242.83.9:8300: i/o timeout
2021/05/29 00:15:21 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:48864->10.242.83.9:8300: i/o timeout
2021/05/29 00:15:21 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:15:21 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/29 00:15:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:31 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:15:32 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:15:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:41 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:49150->10.242.83.9:8300: i/o timeout
2021/05/29 00:15:42 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:49160->10.242.83.9:8300: i/o timeout
2021/05/29 00:15:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:48 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/29 00:15:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:51 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:15:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:53 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:15:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:15:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:00 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:16:00 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:16:01 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:49434->10.242.83.9:8300: i/o timeout
2021/05/29 00:16:03 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:49458->10.242.83.9:8300: i/o timeout
2021/05/29 00:16:03 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:16:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:11 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:16:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:14 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:16:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:21 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:49726->10.242.83.9:8300: i/o timeout
2021/05/29 00:16:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:24 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:49766->10.242.83.9:8300: i/o timeout
2021/05/29 00:16:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:28 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/29 00:16:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:31 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:16:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:35 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:16:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:41 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:50010->10.242.83.9:8300: i/o timeout
2021/05/29 00:16:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:42 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:16:42 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:16:45 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:50064->10.242.83.9:8300: i/o timeout
2021/05/29 00:16:45 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:16:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:52 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:16:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:56 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:16:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:16:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:17:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:17:02 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:50298->10.242.83.9:8300: i/o timeout
2021/05/29 00:17:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:17:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:17:06 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:50366->10.242.83.9:8300: i/o timeout
2021/05/29 00:17:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:17:08 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/29 00:17:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:17:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:17:12 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:17:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:17:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:17:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:17:17 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.83.9
2021/05/29 00:17:17 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/29 00:17:17 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive
2021/05/29 00:17:17 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.83.9
2021/05/29 00:17:17 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/29 00:17:17 [WARN] raft: Rejecting vote request from 10.242.83.9:8300 since we have a leader: 10.242.3.200:8300
2021/05/29 00:17:17 [INFO] raft: pipelining replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/29 00:18:21 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:39016->10.242.83.9:8301: i/o timeout
2021/05/29 00:18:21 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/29 00:18:21 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:18:22 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500211254s
2021/05/29 00:18:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:18:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:39034->10.242.83.9:8301: i/o timeout
2021/05/29 00:18:24 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/29 00:18:24 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.986264002s
2021/05/29 00:18:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:18:25 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations)
2021/05/29 00:18:25 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.83.9
2021/05/29 00:18:25 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/29 00:18:25 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical
2021/05/29 00:18:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:18:27 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.442660783s
2021/05/29 00:18:28 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:40740->10.242.83.9:8302: i/o timeout
2021/05/29 00:18:28 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/29 00:18:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:18:29 [INFO] raft: aborting pipeline replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/29 00:18:29 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:18:29 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:50678->10.242.83.9:8300: i/o timeout
2021/05/29 00:18:30 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:18:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:18:32 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500237124s
2021/05/29 00:18:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:18:34 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.942235138s
2021/05/29 00:18:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:18:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:18:37 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.416946246s
2021/05/29 00:18:38 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:40888->10.242.83.9:8302: i/o timeout
2021/05/29 00:18:38 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/29 00:18:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:18:39 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:51730->10.242.83.9:8300: i/o timeout
2021/05/29 00:18:39 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:18:40 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:51734->10.242.83.9:8300: i/o timeout
2021/05/29 00:18:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:18:41 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:18:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:18:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:18:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:18:48 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:41044->10.242.83.9:8302: i/o timeout
2021/05/29 00:18:48 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/29 00:18:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:18:49 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:51884->10.242.83.9:8300: i/o timeout
2021/05/29 00:18:49 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:18:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:18:51 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:51902->10.242.83.9:8300: i/o timeout
2021/05/29 00:18:51 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:18:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:18:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:18:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:18:57 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:18:57 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:18:57 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:18:57 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.83.9:38632
2021/05/29 00:18:58 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/05/29 00:18:58 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.83.9
2021/05/29 00:18:58 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/29 00:18:58 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:41194->10.242.83.9:8302: i/o timeout
2021/05/29 00:18:58 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/29 00:18:59 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:18:59 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:52032->10.242.83.9:8300: i/o timeout
2021/05/29 00:18:59 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:19:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:01 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:52058->10.242.83.9:8300: i/o timeout
2021/05/29 00:19:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:02 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:19:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:09 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:52182->10.242.83.9:8300: i/o timeout
2021/05/29 00:19:09 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:19:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:12 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:52214->10.242.83.9:8300: i/o timeout
2021/05/29 00:19:13 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:19:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:17 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/29 00:19:17 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/29 00:19:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:19 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:52334->10.242.83.9:8300: i/o timeout
2021/05/29 00:19:20 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:19:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:23 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:52372->10.242.83.9:8300: i/o timeout
2021/05/29 00:19:24 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:19:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:30 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:52486->10.242.83.9:8300: i/o timeout
2021/05/29 00:19:30 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:19:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:34 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:52536->10.242.83.9:8300: i/o timeout
2021/05/29 00:19:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:35 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:19:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:38 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:19:38 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:19:40 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:52630->10.242.83.9:8300: i/o timeout
2021/05/29 00:19:40 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:19:41 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:19:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:45 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:52708->10.242.83.9:8300: i/o timeout
2021/05/29 00:19:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:46 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:19:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:50 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:52786->10.242.83.9:8300: i/o timeout
2021/05/29 00:19:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:51 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:19:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:56 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:52882->10.242.83.9:8300: i/o timeout
2021/05/29 00:19:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:19:58 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:20:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:01 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:52952->10.242.83.9:8300: i/o timeout
2021/05/29 00:20:02 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:20:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:04 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:08 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:53068->10.242.83.9:8300: i/o timeout
2021/05/29 00:20:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:12 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:20:12 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:53114->10.242.83.9:8300: i/o timeout
2021/05/29 00:20:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:15 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:20:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:17 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.83.9:8302
2021/05/29 00:20:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:20 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:20:20 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:20:22 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:53264->10.242.83.9:8300: i/o timeout
2021/05/29 00:20:23 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:20:23 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/29 00:20:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:25 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:53314->10.242.83.9:8300: i/o timeout
2021/05/29 00:20:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:28 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:20:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:30 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:20:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:38 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:53518->10.242.83.9:8300: i/o timeout
2021/05/29 00:20:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:40 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:53548->10.242.83.9:8300: i/o timeout
2021/05/29 00:20:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:46 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:49 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:20:50 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:20:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:54 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:56 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:57 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/29 00:20:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:20:59 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:53824->10.242.83.9:8300: i/o timeout
2021/05/29 00:21:00 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:53856->10.242.83.9:8300: i/o timeout
2021/05/29 00:21:00 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:02 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:02 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:21:02 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:21:05 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:21:06 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:08 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:10 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:21:10 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:21:10 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:12 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:14 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:16 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:18 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:20 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:54166->10.242.83.9:8300: i/o timeout
2021/05/29 00:21:20 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:54172->10.242.83.9:8300: i/o timeout
2021/05/29 00:21:20 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:22 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:24 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:26 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:28 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:30 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:30 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:21:31 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:21:32 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:34 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:37 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/29 00:21:38 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:40 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:40 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:54492->10.242.83.9:8300: i/o timeout
2021/05/29 00:21:41 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:54494->10.242.83.9:8300: i/o timeout
2021/05/29 00:21:42 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:44 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:44 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:21:44 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:21:47 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:21:47 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/29 00:21:47 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/05/29 00:21:48 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:50 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:51 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:21:52 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:21:52 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:21:53 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0)
2021/05/29 00:21:53 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.83.9
2021/05/29 00:21:53 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.83.9
2021/05/29 00:21:53 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/29 00:21:53 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/05/29 00:21:53 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive
2021/05/29 00:21:53 [WARN] raft: Rejecting vote request from 10.242.83.9:8300 since we have a leader: 10.242.3.200:8300
2021/05/29 00:21:53 [ERR] raft: peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300} has newer term, stopping replication
2021/05/29 00:21:53 [INFO] raft: Node at 10.242.3.200:8300 [Follower] entering Follower state (Leader: "")
2021/05/29 00:21:53 [INFO] raft: aborting pipeline replication to peer {Voter 50041021-4500-bc42-f855-8ce25b99549f 10.242.191.196:8300}
2021/05/29 00:21:53 [INFO] consul: cluster leadership lost
2021/05/29 00:21:57 [WARN] consul.coordinate: Batch update failed: node is not the leader
2021/05/29 00:22:01 [WARN] raft: Heartbeat timeout from "" reached, starting election
2021/05/29 00:22:01 [INFO] raft: Node at 10.242.3.200:8300 [Candidate] entering Candidate state in term 11
2021/05/29 00:22:01 [INFO] raft: Election won. Tally: 2
2021/05/29 00:22:01 [INFO] raft: Node at 10.242.3.200:8300 [Leader] entering Leader state
2021/05/29 00:22:01 [INFO] raft: Added peer 5b141322-0cbd-1277-55aa-4bb1f8763d72, starting replication
2021/05/29 00:22:01 [INFO] raft: Added peer 50041021-4500-bc42-f855-8ce25b99549f, starting replication
2021/05/29 00:22:01 [INFO] consul: cluster leadership acquired
2021/05/29 00:22:01 [INFO] consul: New leader elected: dev-consul-server-2
2021/05/29 00:22:01 [INFO] raft: pipelining replication to peer {Voter 50041021-4500-bc42-f855-8ce25b99549f 10.242.191.196:8300}
2021/05/29 00:22:01 [WARN] raft: AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300} rejected, sending older logs (next: 1193)
2021/05/29 00:22:01 [INFO] raft: pipelining replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/29 00:23:02 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:43268->10.242.83.9:8301: i/o timeout
2021/05/29 00:23:02 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/29 00:23:02 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:23:02 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/05/29 00:23:02 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.502662186s
2021/05/29 00:23:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:23:05 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:43320->10.242.83.9:8301: i/o timeout
2021/05/29 00:23:05 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/29 00:23:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:23:05 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.982908289s
2021/05/29 00:23:06 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations)
2021/05/29 00:23:06 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.83.9
2021/05/29 00:23:06 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.83.9:8300) (DC: dc1)
2021/05/29 00:23:06 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical
2021/05/29 00:23:07 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:43330->10.242.83.9:8301: i/o timeout
2021/05/29 00:23:07 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/05/29 00:23:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:23:08 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500223877s
2021/05/29 00:23:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:23:10 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.955995675s
2021/05/29 00:23:10 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:54800->10.242.83.9:8300: i/o timeout
2021/05/29 00:23:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:23:11 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:23:13 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:45074->10.242.83.9:8302: i/o timeout
2021/05/29 00:23:13 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/29 00:23:13 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.423729381s
2021/05/29 00:23:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:23:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:23:15 [INFO] raft: aborting pipeline replication to peer {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}
2021/05/29 00:23:15 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:23:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:23:17 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.83.9:8301
2021/05/29 00:23:18 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 2.500230068s
2021/05/29 00:23:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:23:20 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 4.99794566s
2021/05/29 00:23:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:23:21 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:56006->10.242.83.9:8300: i/o timeout
2021/05/29 00:23:22 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:23:23 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:45230->10.242.83.9:8302: i/o timeout
2021/05/29 00:23:23 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/05/29 00:23:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:23:23 [WARN] raft: Failed to contact 5b141322-0cbd-1277-55aa-4bb1f8763d72 in 7.463131908s
2021/05/29 00:23:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:23:25 [ERR] raft: Failed to AppendEntries to {Voter 5b141322-0cbd-1277-55aa-4bb1f8763d72 10.242.83.9:8300}: read tcp 10.242.3.200:56066->10.242.83.9:8300: i/o timeout
2021/05/29 00:23:25 [WARN] Unable to get address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72, using fallback address 10.242.83.9:8300: Could not find address for server id 5b141322-0cbd-1277-55aa-4bb1f8763d72
2021/05/29 00:23:26 [ERR] yamux: keepalive failed: i/o deadline reached
2021/05/29 00:23:26 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF
2021/05/29 00:23:28 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/05/29 00:23:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:23:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding
2021/05/29 00:23:32 [ERR] raft: Failed to heartbeat to 10.242.83.9:8300: read tcp 10.242.3.200:56168->10.242.83.9:8300: i/o timeout
2021/05/29 00:23:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.3.200:45380->10.242.83.9:8302: i/o timeout
2021/05/29 00:23:33 [INFO] memberlist: Suspect dev-consul-serv