By type
+ CONSUL_BIND=
+ [ -n ]
+ CONSUL_CLIENT=
+ [ -n ]
+ CONSUL_DATA_DIR=/consul/data
+ CONSUL_CONFIG_DIR=/consul/config
+ [ -n ]
+ [ a = - ]
+ [ agent = agent ]
+ shift
+ set -- consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui
+ [ consul = consul ]
+ stat -c %u /consul/data
+ id -u consul
+ [ 100 != 100 ]
+ stat -c %u /consul/config
+ id -u consul
+ [ 100 != 100 ]
+ [ ! -z ]
+ exec consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui
bootstrap_expect > 0: expecting 3 servers
==> Starting Consul agent...
==> Consul agent running!
Version: 'v1.0.6'
Node ID: '04c0514d-f716-e1ff-58b3-22dd44795e60'
Node name: 'dev-consul-server-0'
Datacenter: 'dc1' (Segment: '')
Server: true (Bootstrap: false)
Client Addr: [0.0.0.0] (HTTP: 8500, HTTPS: -1, DNS: 8600)
Cluster Addr: 10.242.121.202 (LAN: 8301, WAN: 8302)
Encrypt: Gossip: false, TLS-Outgoing: false, TLS-Incoming: false
==> Log data will now stream in as it occurs:
2021/04/29 14:43:34 [INFO] raft: Initial configuration (index=0): []
2021/04/29 14:43:34 [INFO] raft: Node at 10.242.121.202:8300 [Follower] entering Follower state (Leader: "")
2021/04/29 14:43:34 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.121.202
2021/04/29 14:43:34 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.121.202
2021/04/29 14:43:34 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/04/29 14:43:34 [INFO] agent: Started DNS server 0.0.0.0:8600 (udp)
2021/04/29 14:43:34 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.121.202:8300) (DC: dc1)
2021/04/29 14:43:34 [INFO] agent: Started DNS server 0.0.0.0:8600 (tcp)
2021/04/29 14:43:34 [INFO] agent: Started HTTP server on [::]:8500 (tcp)
2021/04/29 14:43:34 [INFO] agent: started state syncer
2021/04/29 14:43:34 [INFO] agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce os scaleway softlayer
2021/04/29 14:43:34 [INFO] agent: Joining LAN cluster...
2021/04/29 14:43:34 [INFO] agent: (LAN) joining: [dev-consul-server-0.consul-server dev-consul-server-1.consul-server dev-consul-server-2.consul-server]
2021/04/29 14:43:34 [WARN] memberlist: Failed to resolve dev-consul-server-0.consul-server: lookup dev-consul-server-0.consul-server on 10.96.0.10:53: no such host
2021/04/29 14:43:34 [WARN] memberlist: Failed to resolve dev-consul-server-1.consul-server: lookup dev-consul-server-1.consul-server on 10.96.0.10:53: no such host
2021/04/29 14:43:34 [WARN] memberlist: Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host
2021/04/29 14:43:34 [INFO] agent: (LAN) joined: 0 Err: 3 error(s) occurred:
* Failed to resolve dev-consul-server-0.consul-server: lookup dev-consul-server-0.consul-server on 10.96.0.10:53: no such host
* Failed to resolve dev-consul-server-1.consul-server: lookup dev-consul-server-1.consul-server on 10.96.0.10:53: no such host
* Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host
2021/04/29 14:43:34 [WARN] agent: Join LAN failed: , retrying in 30s
2021/04/29 14:43:41 [ERR] agent: failed to sync remote state: No cluster leader
2021/04/29 14:43:42 [WARN] raft: no known peers, aborting election
2021/04/29 14:43:49 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.219.205
2021/04/29 14:43:49 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.219.205:8300) (DC: dc1)
2021/04/29 14:43:49 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.219.205
2021/04/29 14:43:49 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
==> Failed to check for updates: Get https://checkpoint-api.hashicorp.com/v1/check/consul?arch=amd64&os=linux&signature=566d21d2-bcd8-804a-cc4a-599e59ce2d30&version=1.0.6: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/29 14:44:00 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-7jkd9 10.242.219.201
2021/04/29 14:44:03 [ERR] agent: Coordinate update error: No cluster leader
2021/04/29 14:44:04 [INFO] agent: (LAN) joining: [dev-consul-server-0.consul-server dev-consul-server-1.consul-server dev-consul-server-2.consul-server]
2021/04/29 14:44:04 [WARN] memberlist: Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host
2021/04/29 14:44:04 [INFO] agent: (LAN) joined: 2 Err:
2021/04/29 14:44:04 [INFO] agent: Join LAN completed. Synced with 2 initial agents
2021/04/29 14:44:08 [ERR] agent: failed to sync remote state: No cluster leader
2021/04/29 14:44:10 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.226.70
2021/04/29 14:44:10 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 14:44:10 [INFO] consul: Found expected number of peers, attempting bootstrap: 10.242.121.202:8300,10.242.219.205:8300,10.242.226.70:8300
2021/04/29 14:44:10 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.226.70
2021/04/29 14:44:10 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/29 14:44:10 [WARN] raft: Heartbeat timeout from "" reached, starting election
2021/04/29 14:44:10 [INFO] raft: Node at 10.242.121.202:8300 [Candidate] entering Candidate state in term 2
2021/04/29 14:44:10 [INFO] raft: Election won. Tally: 2
2021/04/29 14:44:10 [INFO] raft: Node at 10.242.121.202:8300 [Leader] entering Leader state
2021/04/29 14:44:10 [INFO] raft: Added peer 1b6640de-e429-69bf-958a-cf5edfb07777, starting replication
2021/04/29 14:44:10 [INFO] raft: Added peer 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, starting replication
2021/04/29 14:44:10 [INFO] consul: New leader elected: dev-consul-server-0
2021/04/29 14:44:10 [INFO] consul: cluster leadership acquired
2021/04/29 14:44:10 [WARN] raft: AppendEntries to {Voter 1b6640de-e429-69bf-958a-cf5edfb07777 10.242.219.205:8300} rejected, sending older logs (next: 1)
2021/04/29 14:44:10 [WARN] raft: AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300} rejected, sending older logs (next: 1)
2021/04/29 14:44:10 [INFO] raft: pipelining replication to peer {Voter 1b6640de-e429-69bf-958a-cf5edfb07777 10.242.219.205:8300}
2021/04/29 14:44:10 [INFO] raft: pipelining replication to peer {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}
2021/04/29 14:44:10 [INFO] consul: member 'dev-consul-7467bf7b46-7jkd9' joined, marking health alive
2021/04/29 14:44:10 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive
2021/04/29 14:44:10 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive
2021/04/29 14:44:10 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/04/29 14:44:13 [INFO] agent: Synced node info
2021/04/29 15:05:43 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:05:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:18:19 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:18:19 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/04/29 15:18:19 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/04/29 15:18:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:18:49 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:19:39 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:19:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:20:29 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:20:39 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:20:39 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/04/29 15:20:39 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/04/29 15:20:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:20:49 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:20:51 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:47510->10.242.226.70:8301: i/o timeout
2021/04/29 15:20:51 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:20:51 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:20:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:20:53 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.50020788s
2021/04/29 15:20:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:46260->10.242.226.70:8302: i/o timeout
2021/04/29 15:20:54 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/29 15:20:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:47568->10.242.226.70:8301: i/o timeout
2021/04/29 15:20:54 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:20:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:20:55 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/29 15:20:55 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.226.70
2021/04/29 15:20:55 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:20:55 [INFO] consul: member 'dev-consul-server-2' failed, marking health critical
2021/04/29 15:20:55 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/04/29 15:20:55 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.226.70
2021/04/29 15:20:55 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:20:55 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive
2021/04/29 15:21:01 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:47662->10.242.226.70:8301: i/o timeout
2021/04/29 15:21:01 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:21:01 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:21:01 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/04/29 15:21:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:21:04 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.500330288s
2021/04/29 15:21:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:47718->10.242.226.70:8301: i/o timeout
2021/04/29 15:21:04 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:21:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:21:07 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:21:08 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.500269742s
2021/04/29 15:21:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:21:09 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:47788->10.242.226.70:8301: i/o timeout
2021/04/29 15:21:09 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:21:10 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.226.70
2021/04/29 15:21:10 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:21:10 [INFO] consul: member 'dev-consul-server-2' failed, marking health critical
2021/04/29 15:21:10 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 4.967910075s
2021/04/29 15:21:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:21:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:21:13 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 7.428727758s
2021/04/29 15:21:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:21:15 [INFO] raft: aborting pipeline replication to peer {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}
2021/04/29 15:21:15 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:21:16 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:54090->10.242.226.70:8300: i/o timeout
2021/04/29 15:21:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:21:16 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:21:17 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.500223948s
2021/04/29 15:21:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:21:20 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 4.916459656s
2021/04/29 15:21:20 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:21:20 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.226.70:52100
2021/04/29 15:21:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:21:21 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:21:21 [INFO] raft: pipelining replication to peer {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}
2021/04/29 15:21:21 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.226.70
2021/04/29 15:21:21 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:21:21 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive
2021/04/29 15:21:29 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:21:29 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/04/29 15:21:30 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:48084->10.242.226.70:8301: i/o timeout
2021/04/29 15:21:30 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:21:30 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.500141211s
2021/04/29 15:21:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:21:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:21:33 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 4.964968976s
2021/04/29 15:21:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:48130->10.242.226.70:8301: i/o timeout
2021/04/29 15:21:33 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:21:34 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/29 15:21:34 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.226.70
2021/04/29 15:21:34 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:21:34 [INFO] consul: member 'dev-consul-server-2' failed, marking health critical
2021/04/29 15:21:34 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.226.70:8301
2021/04/29 15:21:34 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:21:35 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 7.432837625s
2021/04/29 15:21:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:21:37 [INFO] raft: aborting pipeline replication to peer {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}
2021/04/29 15:21:37 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:21:38 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:21:39 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:54124->10.242.226.70:8300: i/o timeout
2021/04/29 15:21:39 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:21:40 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.500220068s
2021/04/29 15:21:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:21:42 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 4.97222281s
2021/04/29 15:21:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:21:44 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:47004->10.242.226.70:8302: i/o timeout
2021/04/29 15:21:44 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/29 15:21:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:21:45 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 7.442260391s
2021/04/29 15:21:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:21:47 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:54426->10.242.226.70:8300: i/o timeout
2021/04/29 15:21:47 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:21:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:21:49 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:54454->10.242.226.70:8300: i/o timeout
2021/04/29 15:21:50 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:21:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:21:53 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:21:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:21:56 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.226.70
2021/04/29 15:21:56 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:21:56 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive
2021/04/29 15:21:56 [DEBUG] raft-net: 10.242.121.202:8300 accepted connection from: 10.242.226.70:50348
2021/04/29 15:21:56 [WARN] raft: Rejecting vote request from 10.242.226.70:8300 since we have a leader: 10.242.121.202:8300
2021/04/29 15:21:56 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2)
2021/04/29 15:21:56 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2.dc1)
2021/04/29 15:21:56 [ERR] raft: peer {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300} has newer term, stopping replication
2021/04/29 15:21:56 [INFO] raft: Node at 10.242.121.202:8300 [Follower] entering Follower state (Leader: "")
2021/04/29 15:21:56 [INFO] raft: aborting pipeline replication to peer {Voter 1b6640de-e429-69bf-958a-cf5edfb07777 10.242.219.205:8300}
2021/04/29 15:21:56 [INFO] consul: cluster leadership lost
2021/04/29 15:21:57 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:48494->10.242.226.70:8301: i/o timeout
2021/04/29 15:21:57 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:21:59 [WARN] memberlist: Was able to connect to dev-consul-server-2.dc1 but other probes failed, network may be misconfigured
2021/04/29 15:22:01 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/04/29 15:22:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:47300->10.242.226.70:8302: i/o timeout
2021/04/29 15:22:04 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/29 15:22:04 [WARN] raft: Heartbeat timeout from "" reached, starting election
2021/04/29 15:22:04 [INFO] raft: Node at 10.242.121.202:8300 [Candidate] entering Candidate state in term 3
2021/04/29 15:22:04 [INFO] raft: Election won. Tally: 2
2021/04/29 15:22:04 [INFO] raft: Node at 10.242.121.202:8300 [Leader] entering Leader state
2021/04/29 15:22:04 [INFO] consul: cluster leadership acquired
2021/04/29 15:22:04 [INFO] raft: Added peer 1b6640de-e429-69bf-958a-cf5edfb07777, starting replication
2021/04/29 15:22:04 [INFO] consul: New leader elected: dev-consul-server-0
2021/04/29 15:22:04 [INFO] raft: Added peer 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, starting replication
2021/04/29 15:22:04 [INFO] raft: pipelining replication to peer {Voter 1b6640de-e429-69bf-958a-cf5edfb07777 10.242.219.205:8300}
2021/04/29 15:22:06 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:48634->10.242.226.70:8301: i/o timeout
2021/04/29 15:22:06 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:22:06 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/29 15:22:06 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.226.70
2021/04/29 15:22:06 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:22:06 [INFO] consul: member 'dev-consul-server-2' failed, marking health critical
2021/04/29 15:22:06 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.501734513s
2021/04/29 15:22:07 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:22:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:09 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 4.951175591s
2021/04/29 15:22:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:11 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 7.384411954s
2021/04/29 15:22:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:14 [ERR] raft: Failed to make RequestVote RPC to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:54570->10.242.226.70:8300: i/o timeout
2021/04/29 15:22:14 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:54604->10.242.226.70:8300: i/o timeout
2021/04/29 15:22:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:14 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:22:14 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.226.70:8301
2021/04/29 15:22:14 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.226.70
2021/04/29 15:22:14 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:22:14 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive
2021/04/29 15:22:14 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:54828->10.242.226.70:8300: i/o timeout
2021/04/29 15:22:16 [WARN] raft: Rejecting vote request from 10.242.226.70:8300 since we have a leader: 10.242.121.202:8300
2021/04/29 15:22:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:20 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:48854->10.242.226.70:8301: i/o timeout
2021/04/29 15:22:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:22 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:23 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:48910->10.242.226.70:8301: i/o timeout
2021/04/29 15:22:23 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:22:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:24 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:54964->10.242.226.70:8300: i/o timeout
2021/04/29 15:22:26 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/29 15:22:26 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.226.70
2021/04/29 15:22:26 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:22:26 [INFO] consul: member 'dev-consul-server-2' failed, marking health critical
2021/04/29 15:22:26 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:26 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.500192892s
2021/04/29 15:22:28 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:28 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 4.94006851s
2021/04/29 15:22:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:31 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 7.379286852s
2021/04/29 15:22:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:34 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:34 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:54992->10.242.226.70:8300: i/o timeout
2021/04/29 15:22:34 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:22:34 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:55148->10.242.226.70:8300: i/o timeout
2021/04/29 15:22:35 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:22:36 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:22:36 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.226.70:49936
2021/04/29 15:22:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:38 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:47844->10.242.226.70:8302: i/o timeout
2021/04/29 15:22:39 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/29 15:22:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:44 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:55292->10.242.226.70:8300: i/o timeout
2021/04/29 15:22:44 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:22:44 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.226.70
2021/04/29 15:22:44 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:22:44 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive
2021/04/29 15:22:44 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:22:45 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:55302->10.242.226.70:8300: i/o timeout
2021/04/29 15:22:47 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:49274->10.242.226.70:8301: i/o timeout
2021/04/29 15:22:47 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:22:47 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:22:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:48 [WARN] raft: AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300} rejected, sending older logs (next: 527)
2021/04/29 15:22:49 [WARN] memberlist: Was able to connect to dev-consul-server-2.dc1 but other probes failed, network may be misconfigured
2021/04/29 15:22:49 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/29 15:22:49 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.226.70
2021/04/29 15:22:49 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:22:49 [INFO] consul: member 'dev-consul-server-2' failed, marking health critical
2021/04/29 15:22:50 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:49292->10.242.226.70:8301: i/o timeout
2021/04/29 15:22:50 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:22:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:51 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.500245981s
2021/04/29 15:22:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:53 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 4.989851347s
2021/04/29 15:22:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:55 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:22:56 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:22:56 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:22:57 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:22:58 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:22:58 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2.dc1)
2021/04/29 15:22:58 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:22:58 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:55448->10.242.226.70:8300: i/o timeout
2021/04/29 15:22:58 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:22:59 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:23:00 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:23:00 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:01 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.500198634s
2021/04/29 15:23:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:04 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 4.990095845s
2021/04/29 15:23:06 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:06 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 7.444868745s
2021/04/29 15:23:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:08 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:55658->10.242.226.70:8300: i/o timeout
2021/04/29 15:23:08 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:23:09 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:48218->10.242.226.70:8302: i/o timeout
2021/04/29 15:23:09 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/29 15:23:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:10 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:23:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:12 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.500274259s
2021/04/29 15:23:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:15 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 4.943433635s
2021/04/29 15:23:15 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.226.70:8301
2021/04/29 15:23:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:17 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 7.39563999s
2021/04/29 15:23:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:18 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:55806->10.242.226.70:8300: i/o timeout
2021/04/29 15:23:19 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:23:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:48446->10.242.226.70:8302: i/o timeout
2021/04/29 15:23:19 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/29 15:23:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:20 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:55474->10.242.226.70:8300: i/o timeout
2021/04/29 15:23:21 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:23:22 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:26 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:26 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:23:26 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:23:29 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:55968->10.242.226.70:8300: i/o timeout
2021/04/29 15:23:29 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:23:29 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:48548->10.242.226.70:8302: i/o timeout
2021/04/29 15:23:29 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/29 15:23:29 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:23:29 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/04/29 15:23:29 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/04/29 15:23:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:31 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:56004->10.242.226.70:8300: i/o timeout
2021/04/29 15:23:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:32 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:23:34 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:35 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/29 15:23:35 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.226.70
2021/04/29 15:23:35 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/29 15:23:35 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:23:35 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.226.70:51184
2021/04/29 15:23:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:38 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:39 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:56168->10.242.226.70:8300: i/o timeout
2021/04/29 15:23:39 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:23:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:42 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:56250->10.242.226.70:8300: i/o timeout
2021/04/29 15:23:43 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:23:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:49 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:56396->10.242.226.70:8300: i/o timeout
2021/04/29 15:23:49 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:23:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:53 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:56496->10.242.226.70:8300: i/o timeout
2021/04/29 15:23:53 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:23:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:55 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.226.70:8301
2021/04/29 15:23:56 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:23:59 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:56604->10.242.226.70:8300: i/o timeout
2021/04/29 15:23:59 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:24:00 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:03 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:56708->10.242.226.70:8300: i/o timeout
2021/04/29 15:24:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:04 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:24:06 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:08 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:24:08 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:24:09 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:56822->10.242.226.70:8300: i/o timeout
2021/04/29 15:24:10 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:24:11 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:24:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:14 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:56922->10.242.226.70:8300: i/o timeout
2021/04/29 15:24:15 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:24:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:20 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:57012->10.242.226.70:8300: i/o timeout
2021/04/29 15:24:21 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:24:22 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:25 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:57096->10.242.226.70:8300: i/o timeout
2021/04/29 15:24:26 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:26 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:24:28 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:31 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:57216->10.242.226.70:8300: i/o timeout
2021/04/29 15:24:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:34 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:24:34 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:34 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.226.70:8302
2021/04/29 15:24:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:36 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:57294->10.242.226.70:8300: i/o timeout
2021/04/29 15:24:38 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:24:38 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:44 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:57424->10.242.226.70:8300: i/o timeout
2021/04/29 15:24:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:48 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:57502->10.242.226.70:8300: i/o timeout
2021/04/29 15:24:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:49 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:24:50 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:24:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:50 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:24:50 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:24:53 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:24:53 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/04/29 15:24:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:56 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:24:59 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:57678->10.242.226.70:8300: i/o timeout
2021/04/29 15:25:00 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:57684->10.242.226.70:8300: i/o timeout
2021/04/29 15:25:00 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:03 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:25:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:06 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:09 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:25:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:13 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:57924->10.242.226.70:8300: i/o timeout
2021/04/29 15:25:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:19 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:25:19 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:58014->10.242.226.70:8300: i/o timeout
2021/04/29 15:25:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:22 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:26 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:28 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:29 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:58172->10.242.226.70:8300: i/o timeout
2021/04/29 15:25:29 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:25:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:32 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:25:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:32 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:25:35 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:25:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:38 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:39 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:58336->10.242.226.70:8300: i/o timeout
2021/04/29 15:25:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:40 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:25:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:50 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:25:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:50 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:58518->10.242.226.70:8300: i/o timeout
2021/04/29 15:25:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:56 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:25:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:00 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:58680->10.242.226.70:8300: i/o timeout
2021/04/29 15:26:00 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:01 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:26:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:06 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:10 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:26:11 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:58870->10.242.226.70:8300: i/o timeout
2021/04/29 15:26:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:14 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:26:14 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:26:17 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:26:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:20 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:59014->10.242.226.70:8300: i/o timeout
2021/04/29 15:26:22 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:22 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:26:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:26 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:28 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:30 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:26:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:32 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:59222->10.242.226.70:8300: i/o timeout
2021/04/29 15:26:34 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:35 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.226.70:8301
2021/04/29 15:26:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:38 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:40 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:59348->10.242.226.70:8300: i/o timeout
2021/04/29 15:26:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:43 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:26:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:50 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:26:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:53 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:59586->10.242.226.70:8300: i/o timeout
2021/04/29 15:26:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:56 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:26:56 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:26:56 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:26:59 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:27:00 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:00 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:59698->10.242.226.70:8300: i/o timeout
2021/04/29 15:27:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:04 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.226.70:8302
2021/04/29 15:27:04 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:27:06 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:11 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:27:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:14 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:59948->10.242.226.70:8300: i/o timeout
2021/04/29 15:27:15 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.226.70:8301
2021/04/29 15:27:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:21 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:60050->10.242.226.70:8300: i/o timeout
2021/04/29 15:27:22 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:25 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:27:26 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:28 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:31 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:27:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:34 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:35 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:60346->10.242.226.70:8300: i/o timeout
2021/04/29 15:27:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:38 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:38 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:27:38 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:27:41 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:27:41 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:60504->10.242.226.70:8300: i/o timeout
2021/04/29 15:27:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:46 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:27:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:51 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:27:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:56 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:27:56 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:60810->10.242.226.70:8300: i/o timeout
2021/04/29 15:27:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:00 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:01 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:60896->10.242.226.70:8300: i/o timeout
2021/04/29 15:28:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:04 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.226.70:8302
2021/04/29 15:28:06 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:07 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:28:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:11 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:28:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:17 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:32974->10.242.226.70:8300: i/o timeout
2021/04/29 15:28:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:20 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:28:20 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:28:21 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:33060->10.242.226.70:8300: i/o timeout
2021/04/29 15:28:23 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:28:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:25 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.226.70:8301
2021/04/29 15:28:26 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:28 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:28 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:28:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:32 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:28:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:34 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:38 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:38 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:33460->10.242.226.70:8300: i/o timeout
2021/04/29 15:28:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:42 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:33546->10.242.226.70:8300: i/o timeout
2021/04/29 15:28:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:49 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:28:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:52 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:28:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:56 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:28:59 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:33968->10.242.226.70:8300: i/o timeout
2021/04/29 15:29:00 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:02 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:34032->10.242.226.70:8300: i/o timeout
2021/04/29 15:29:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:02 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:29:02 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:29:04 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.226.70:8302
2021/04/29 15:29:05 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:29:06 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:10 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:29:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:12 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:29:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:20 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:34424->10.242.226.70:8300: i/o timeout
2021/04/29 15:29:22 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:22 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:34470->10.242.226.70:8300: i/o timeout
2021/04/29 15:29:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:26 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:28 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:31 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:29:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:32 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:29:34 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:38 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:41 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:34854->10.242.226.70:8300: i/o timeout
2021/04/29 15:29:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:42 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:34890->10.242.226.70:8300: i/o timeout
2021/04/29 15:29:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:44 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:29:44 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:29:47 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:29:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:52 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:29:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:53 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:29:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:56 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:29:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:00 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:02 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:35342->10.242.226.70:8300: i/o timeout
2021/04/29 15:30:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:03 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:35362->10.242.226.70:8300: i/o timeout
2021/04/29 15:30:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:06 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:13 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:30:13 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:30:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:22 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:23 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:35786->10.242.226.70:8300: i/o timeout
2021/04/29 15:30:23 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:35800->10.242.226.70:8300: i/o timeout
2021/04/29 15:30:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:26 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:26 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:30:26 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:30:29 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:30:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:33 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:30:33 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:30:34 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:34 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.226.70:8302
2021/04/29 15:30:35 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.226.70:8301
2021/04/29 15:30:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:38 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:43 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:36192->10.242.226.70:8300: i/o timeout
2021/04/29 15:30:43 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:36198->10.242.226.70:8300: i/o timeout
2021/04/29 15:30:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:53 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:30:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:54 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:30:56 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:30:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:00 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:03 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:36626->10.242.226.70:8300: i/o timeout
2021/04/29 15:31:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:04 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:36640->10.242.226.70:8300: i/o timeout
2021/04/29 15:31:06 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:08 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:31:08 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:31:11 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:31:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:14 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:31:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:15 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:31:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:22 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:24 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:37056->10.242.226.70:8300: i/o timeout
2021/04/29 15:31:24 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:31:24 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2)
2021/04/29 15:31:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:26 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.50028435s
2021/04/29 15:31:26 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:28 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:31:28 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:28 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.226.70
2021/04/29 15:31:28 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/29 15:31:29 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:31:29 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.226.70
2021/04/29 15:31:29 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:31:29 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive
2021/04/29 15:31:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:32 [WARN] raft: Rejecting vote request from 10.242.226.70:8300 since we have a leader: 10.242.121.202:8300
2021/04/29 15:31:34 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:35 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:59540->10.242.226.70:8301: i/o timeout
2021/04/29 15:31:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:37 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.500200709s
2021/04/29 15:31:38 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:40 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 4.95347314s
2021/04/29 15:31:40 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:59678->10.242.226.70:8301: i/o timeout
2021/04/29 15:31:40 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:31:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:42 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 7.453397569s
2021/04/29 15:31:42 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/29 15:31:42 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.226.70
2021/04/29 15:31:42 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:31:42 [INFO] consul: member 'dev-consul-server-2' failed, marking health critical
2021/04/29 15:31:43 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:59722->10.242.226.70:8301: i/o timeout
2021/04/29 15:31:43 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:31:44 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:37510->10.242.226.70:8300: i/o timeout
2021/04/29 15:31:44 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:58454->10.242.226.70:8302: i/o timeout
2021/04/29 15:31:44 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/29 15:31:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:46 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:37086->10.242.226.70:8300: i/o timeout
2021/04/29 15:31:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:46 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:31:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:58652->10.242.226.70:8302: i/o timeout
2021/04/29 15:31:54 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/29 15:31:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:54 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:31:56 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:31:56 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:37796->10.242.226.70:8300: i/o timeout
2021/04/29 15:31:57 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:31:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:01 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:32:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:58828->10.242.226.70:8302: i/o timeout
2021/04/29 15:32:04 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/29 15:32:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:04 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:37960->10.242.226.70:8300: i/o timeout
2021/04/29 15:32:06 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:07 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:37990->10.242.226.70:8300: i/o timeout
2021/04/29 15:32:08 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:32:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:14 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/29 15:32:14 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.226.70
2021/04/29 15:32:14 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/29 15:32:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:14 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:32:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:18 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:38174->10.242.226.70:8300: i/o timeout
2021/04/29 15:32:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:18 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:32:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:59046->10.242.226.70:8302: i/o timeout
2021/04/29 15:32:19 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/29 15:32:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:22 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:24 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:38276->10.242.226.70:8300: i/o timeout
2021/04/29 15:32:25 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:32:25 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:32:27 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:32:27 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/04/29 15:32:28 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:28 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:38334->10.242.226.70:8300: i/o timeout
2021/04/29 15:32:29 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:32:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:34 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:34 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.226.70:8302
2021/04/29 15:32:35 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:32:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:38 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:39 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:32:39 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.226.70:52610
2021/04/29 15:32:39 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:38518->10.242.226.70:8300: i/o timeout
2021/04/29 15:32:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:40 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:32:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:45 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:38618->10.242.226.70:8300: i/o timeout
2021/04/29 15:32:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:50 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:38724->10.242.226.70:8300: i/o timeout
2021/04/29 15:32:51 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:32:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:55 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:32:56 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:32:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:00 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:01 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:38926->10.242.226.70:8300: i/o timeout
2021/04/29 15:33:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:02 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:33:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:05 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:38990->10.242.226.70:8300: i/o timeout
2021/04/29 15:33:06 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:06 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:33:06 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:33:09 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:33:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:12 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:39158->10.242.226.70:8300: i/o timeout
2021/04/29 15:33:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:15 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:33:15 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:33:15 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.226.70:8301
2021/04/29 15:33:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:22 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:25 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:39450->10.242.226.70:8300: i/o timeout
2021/04/29 15:33:25 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:39456->10.242.226.70:8300: i/o timeout
2021/04/29 15:33:26 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:28 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:33:28 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:34 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:35 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:33:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:38 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:39656->10.242.226.70:8300: i/o timeout
2021/04/29 15:33:38 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:44 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:33:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:45 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:39774->10.242.226.70:8300: i/o timeout
2021/04/29 15:33:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:48 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:33:48 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:33:51 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:33:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:54 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:39916->10.242.226.70:8300: i/o timeout
2021/04/29 15:33:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:55 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:33:56 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:33:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:00 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:04 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.226.70:8302
2021/04/29 15:34:05 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:34:05 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:40096->10.242.226.70:8300: i/o timeout
2021/04/29 15:34:06 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:15 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:40248->10.242.226.70:8300: i/o timeout
2021/04/29 15:34:16 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:34:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:22 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:25 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.226.70:8301
2021/04/29 15:34:26 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:34:26 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:40416->10.242.226.70:8300: i/o timeout
2021/04/29 15:34:26 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:28 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:30 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:34:30 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:34:33 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:34:33 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/04/29 15:34:34 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:36 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:40574->10.242.226.70:8300: i/o timeout
2021/04/29 15:34:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:36 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:34:38 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:46 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:40742->10.242.226.70:8300: i/o timeout
2021/04/29 15:34:47 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:34:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:56 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:34:56 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:34:57 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:40908->10.242.226.70:8300: i/o timeout
2021/04/29 15:34:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:00 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:06 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:06 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:41054->10.242.226.70:8300: i/o timeout
2021/04/29 15:35:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:08 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:35:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:12 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:35:12 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:35:15 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:35:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:16 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:35:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:18 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:41244->10.242.226.70:8300: i/o timeout
2021/04/29 15:35:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:22 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:26 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:26 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:41372->10.242.226.70:8300: i/o timeout
2021/04/29 15:35:28 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:29 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:35:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:34 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:34 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.226.70:8302
2021/04/29 15:35:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:37 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:35:38 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:39 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:41574->10.242.226.70:8300: i/o timeout
2021/04/29 15:35:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:47 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:41704->10.242.226.70:8300: i/o timeout
2021/04/29 15:35:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:50 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:35:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:35:54 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:35:54 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:35:57 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:35:57 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:35:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:00 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:00 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:41916->10.242.226.70:8300: i/o timeout
2021/04/29 15:36:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:06 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:07 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:42028->10.242.226.70:8300: i/o timeout
2021/04/29 15:36:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:11 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:36:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:17 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:36:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:21 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:42266->10.242.226.70:8300: i/o timeout
2021/04/29 15:36:22 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:26 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:27 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:42356->10.242.226.70:8300: i/o timeout
2021/04/29 15:36:28 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:32 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:36:34 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:34 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.226.70:8302
2021/04/29 15:36:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:36 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:36:36 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:36:37 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:36:39 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:36:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:42 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:42596->10.242.226.70:8300: i/o timeout
2021/04/29 15:36:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:47 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:42680->10.242.226.70:8300: i/o timeout
2021/04/29 15:36:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:53 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:36:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:56 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:36:58 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:36:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:00 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:03 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:42956->10.242.226.70:8300: i/o timeout
2021/04/29 15:37:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:06 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:08 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:43014->10.242.226.70:8300: i/o timeout
2021/04/29 15:37:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:14 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:37:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:18 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:37:18 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:37:18 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:37:21 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:37:22 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:24 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:43290->10.242.226.70:8300: i/o timeout
2021/04/29 15:37:26 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:28 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:28 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:43342->10.242.226.70:8300: i/o timeout
2021/04/29 15:37:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:34 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:34 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.226.70:8302
2021/04/29 15:37:35 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:37:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:38 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:38 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:37:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:45 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:43628->10.242.226.70:8300: i/o timeout
2021/04/29 15:37:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:48 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:43678->10.242.226.70:8300: i/o timeout
2021/04/29 15:37:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:56 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:56 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:37:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:37:58 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:38:00 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:00 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:38:00 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:38:03 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:38:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:06 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:06 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:43970->10.242.226.70:8300: i/o timeout
2021/04/29 15:38:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:08 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:43998->10.242.226.70:8300: i/o timeout
2021/04/29 15:38:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:17 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:38:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:19 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:38:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:22 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:26 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:27 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:44306->10.242.226.70:8300: i/o timeout
2021/04/29 15:38:28 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:29 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:44326->10.242.226.70:8300: i/o timeout
2021/04/29 15:38:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:34 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:35 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.226.70:8301
2021/04/29 15:38:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:38 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:38 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:38:39 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:38:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:42 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:38:42 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:38:45 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:38:45 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/04/29 15:38:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:48 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:44654->10.242.226.70:8300: i/o timeout
2021/04/29 15:38:49 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:44668->10.242.226.70:8300: i/o timeout
2021/04/29 15:38:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:56 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:38:59 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:38:59 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:39:00 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:06 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:09 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:44990->10.242.226.70:8300: i/o timeout
2021/04/29 15:39:09 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:44992->10.242.226.70:8300: i/o timeout
2021/04/29 15:39:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:19 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:39:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:20 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:39:22 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:24 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:39:24 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:39:27 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:39:28 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:29 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:45324->10.242.226.70:8300: i/o timeout
2021/04/29 15:39:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:30 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:45336->10.242.226.70:8300: i/o timeout
2021/04/29 15:39:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:34 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:38 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:40 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:39:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:41 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:39:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:50 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:45656->10.242.226.70:8300: i/o timeout
2021/04/29 15:39:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:51 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:45690->10.242.226.70:8300: i/o timeout
2021/04/29 15:39:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:56 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:39:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:00 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:40:00 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:02 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:40:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:06 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:06 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:40:06 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:40:09 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:40:09 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/04/29 15:40:10 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:45982->10.242.226.70:8300: i/o timeout
2021/04/29 15:40:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:12 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:46034->10.242.226.70:8300: i/o timeout
2021/04/29 15:40:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:20 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:40:22 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:23 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:40:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:26 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:28 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:30 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:46318->10.242.226.70:8300: i/o timeout
2021/04/29 15:40:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:33 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:46382->10.242.226.70:8300: i/o timeout
2021/04/29 15:40:34 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:38 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:40 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:40:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:44 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:40:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:48 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:40:48 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:40:50 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:46648->10.242.226.70:8300: i/o timeout
2021/04/29 15:40:51 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:40:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:54 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:46722->10.242.226.70:8300: i/o timeout
2021/04/29 15:40:56 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:40:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:00 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:01 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:41:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:05 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:41:06 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:11 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:46976->10.242.226.70:8300: i/o timeout
2021/04/29 15:41:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:15 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:47072->10.242.226.70:8300: i/o timeout
2021/04/29 15:41:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:21 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:41:22 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:26 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:27 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:41:28 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:30 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:41:30 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:41:31 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:47302->10.242.226.70:8300: i/o timeout
2021/04/29 15:41:33 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:41:34 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:37 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:47400->10.242.226.70:8300: i/o timeout
2021/04/29 15:41:38 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:41 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:41:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:45 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.226.70:8301
2021/04/29 15:41:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:47 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:41:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:51 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:47642->10.242.226.70:8300: i/o timeout
2021/04/29 15:41:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:56 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:41:57 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:47746->10.242.226.70:8300: i/o timeout
2021/04/29 15:41:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:00 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:01 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:42:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:04 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.226.70:8302
2021/04/29 15:42:06 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:09 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:42:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:11 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:47972->10.242.226.70:8300: i/o timeout
2021/04/29 15:42:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:12 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:42:12 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:42:15 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:42:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:19 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:48090->10.242.226.70:8300: i/o timeout
2021/04/29 15:42:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:22 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:42:22 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:26 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:28 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:30 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:42:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:32 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:48304->10.242.226.70:8300: i/o timeout
2021/04/29 15:42:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:34 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:38 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:40 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:48426->10.242.226.70:8300: i/o timeout
2021/04/29 15:42:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:42 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:42:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:51 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:42:52 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:48634->10.242.226.70:8300: i/o timeout
2021/04/29 15:42:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:42:54 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:42:54 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:42:57 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:42:57 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/04/29 15:42:57 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/04/29 15:42:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:00 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:01 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:48764->10.242.226.70:8300: i/o timeout
2021/04/29 15:43:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:02 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:43:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:06 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:12 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:43:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:12 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:48962->10.242.226.70:8300: i/o timeout
2021/04/29 15:43:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:22 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:49116->10.242.226.70:8300: i/o timeout
2021/04/29 15:43:22 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:22 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:43:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:26 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:28 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:30 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:32 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:49290->10.242.226.70:8300: i/o timeout
2021/04/29 15:43:33 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:43:34 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:34 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.226.70:8302
2021/04/29 15:43:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:36 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:43:36 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:43:39 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:43:40 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:42 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:43:43 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:49450->10.242.226.70:8300: i/o timeout
2021/04/29 15:43:44 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:52 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:49622->10.242.226.70:8300: i/o timeout
2021/04/29 15:43:54 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:43:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:56 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:43:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:44:00 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:44:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:44:03 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:44:04 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:49792->10.242.226.70:8300: i/o timeout
2021/04/29 15:44:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:44:06 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:44:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:44:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:44:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:44:13 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:49952->10.242.226.70:8300: i/o timeout
2021/04/29 15:44:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:44:15 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:44:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:44:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:44:18 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:44:18 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:44:21 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:44:22 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:44:23 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:44:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:44:25 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:50128->10.242.226.70:8300: i/o timeout
2021/04/29 15:44:25 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.226.70:8301
2021/04/29 15:44:26 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:44:28 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:44:28 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.226.70
2021/04/29 15:44:28 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:44:28 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive
2021/04/29 15:44:28 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.226.70
2021/04/29 15:44:28 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/29 15:44:28 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2.dc1)
2021/04/29 15:44:29 [WARN] raft: Rejecting vote request from 10.242.226.70:8300 since we have a leader: 10.242.121.202:8300
2021/04/29 15:44:29 [ERR] raft: peer {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300} has newer term, stopping replication
2021/04/29 15:44:29 [INFO] raft: Node at 10.242.121.202:8300 [Follower] entering Follower state (Leader: "")
2021/04/29 15:44:29 [INFO] raft: aborting pipeline replication to peer {Voter 1b6640de-e429-69bf-958a-cf5edfb07777 10.242.219.205:8300}
2021/04/29 15:44:29 [INFO] consul: cluster leadership lost
2021/04/29 15:44:31 [WARN] consul.coordinate: Batch update failed: node is not the leader
2021/04/29 15:44:38 [DEBUG] raft-net: 10.242.121.202:8300 accepted connection from: 10.242.219.205:35080
2021/04/29 15:44:38 [WARN] raft: Rejecting vote request from 10.242.226.70:8300 since our last term is greater (3, 2)
2021/04/29 15:44:42 [ERR] http: Request GET /v1/catalog/service/config_binding_service, error: No cluster leader from=10.242.76.199:43792
2021/04/29 15:44:44 [WARN] raft: Rejecting vote request from 10.242.226.70:8300 since our last term is greater (3, 2)
2021/04/29 15:44:47 [WARN] raft: Heartbeat timeout from "" reached, starting election
2021/04/29 15:44:47 [INFO] raft: Node at 10.242.121.202:8300 [Candidate] entering Candidate state in term 8
2021/04/29 15:44:47 [INFO] raft: Election won. Tally: 2
2021/04/29 15:44:47 [INFO] raft: Node at 10.242.121.202:8300 [Leader] entering Leader state
2021/04/29 15:44:47 [INFO] raft: Added peer 1b6640de-e429-69bf-958a-cf5edfb07777, starting replication
2021/04/29 15:44:47 [INFO] raft: Added peer 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, starting replication
2021/04/29 15:44:47 [INFO] consul: cluster leadership acquired
2021/04/29 15:44:47 [INFO] consul: New leader elected: dev-consul-server-0
2021/04/29 15:44:47 [WARN] raft: AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300} rejected, sending older logs (next: 527)
2021/04/29 15:44:47 [INFO] raft: pipelining replication to peer {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}
2021/04/29 15:44:47 [INFO] raft: pipelining replication to peer {Voter 1b6640de-e429-69bf-958a-cf5edfb07777 10.242.219.205:8300}
2021/04/29 15:45:34 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:45:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:45416->10.242.226.70:8301: i/o timeout
2021/04/29 15:45:45 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:45:48 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:45460->10.242.226.70:8301: i/o timeout
2021/04/29 15:45:48 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:45:50 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:45:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:45578->10.242.226.70:8301: i/o timeout
2021/04/29 15:45:54 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:45:58 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:45:59 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:01 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:01 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.500235843s
2021/04/29 15:46:03 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:04 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 4.985238221s
2021/04/29 15:46:05 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:45754->10.242.226.70:8301: i/o timeout
2021/04/29 15:46:05 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:46:05 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/29 15:46:05 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.226.70
2021/04/29 15:46:05 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:46:05 [INFO] consul: member 'dev-consul-server-2' failed, marking health critical
2021/04/29 15:46:05 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:06 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 7.443815804s
2021/04/29 15:46:07 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:08 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:45768->10.242.226.70:8301: i/o timeout
2021/04/29 15:46:08 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:46:08 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:46:09 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:10 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.500157874s
2021/04/29 15:46:11 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:12 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 4.997436447s
2021/04/29 15:46:13 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:44598->10.242.226.70:8302: i/o timeout
2021/04/29 15:46:14 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/29 15:46:15 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 7.450718954s
2021/04/29 15:46:15 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:17 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:17 [ERR] raft: Failed to pipeline AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: write tcp 10.242.121.202:50284->10.242.226.70:8300: use of closed network connection
2021/04/29 15:46:17 [INFO] raft: aborting pipeline replication to peer {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}
2021/04/29 15:46:17 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:46:18 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:50694->10.242.226.70:8300: i/o timeout
2021/04/29 15:46:19 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:46:19 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:20 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.500227831s
2021/04/29 15:46:21 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:22 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 4.992432391s
2021/04/29 15:46:23 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:44662->10.242.226.70:8302: i/o timeout
2021/04/29 15:46:24 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/29 15:46:25 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 7.474507414s
2021/04/29 15:46:25 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:27 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:27 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:52170->10.242.226.70:8300: i/o timeout
2021/04/29 15:46:27 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:46:29 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:52196->10.242.226.70:8300: i/o timeout
2021/04/29 15:46:29 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:30 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:46:31 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:31 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:46:31 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:46:31 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:46:31 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.226.70:54358
2021/04/29 15:46:34 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:46:34 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/04/29 15:46:34 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/04/29 15:46:35 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:37 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:37 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:52332->10.242.226.70:8300: i/o timeout
2021/04/29 15:46:38 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:46:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:44992->10.242.226.70:8302: i/o timeout
2021/04/29 15:46:39 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/29 15:46:39 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:39 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/29 15:46:39 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.226.70
2021/04/29 15:46:39 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/29 15:46:40 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:52370->10.242.226.70:8300: i/o timeout
2021/04/29 15:46:41 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:46:41 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:42 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:46:42 [WARN] raft: Rejecting vote request from 10.242.226.70:8300 since we have a leader: 10.242.121.202:8300
2021/04/29 15:46:43 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:46:43 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:43 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:46:43 [INFO] raft: pipelining replication to peer {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}
2021/04/29 15:46:43 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2)
2021/04/29 15:46:43 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.226.70
2021/04/29 15:46:43 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/29 15:46:44 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.226.70
2021/04/29 15:46:44 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:46:44 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive
2021/04/29 15:46:48 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:46:49 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:50 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:46488->10.242.226.70:8301: i/o timeout
2021/04/29 15:46:50 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:46:51 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:52 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/29 15:46:52 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.226.70
2021/04/29 15:46:52 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:46:52 [INFO] consul: member 'dev-consul-server-2' failed, marking health critical
2021/04/29 15:46:53 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:46:53 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:46506->10.242.226.70:8301: i/o timeout
2021/04/29 15:46:53 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:46:53 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:53 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:46:54 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:46:55 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:46:55 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:56 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:46:57 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:46:57 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:46:57 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:46:58 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:46:59 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:45324->10.242.226.70:8302: i/o timeout
2021/04/29 15:46:59 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/29 15:46:59 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:46:59 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:47:00 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:47:01 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:47:01 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:47:02 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:47:02 [ERR] raft: Failed to pipeline AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: write tcp 10.242.121.202:52500->10.242.226.70:8300: use of closed network connection
2021/04/29 15:47:02 [INFO] raft: aborting pipeline replication to peer {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}
2021/04/29 15:47:02 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:47:03 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:47:03 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:47:04 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:47:04 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2)
2021/04/29 15:47:04 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.226.70
2021/04/29 15:47:04 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:47:04 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive
2021/04/29 15:47:05 [INFO] raft: pipelining replication to peer {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}
2021/04/29 15:47:11 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:46842->10.242.226.70:8301: i/o timeout
2021/04/29 15:47:20 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:47:21 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:47002->10.242.226.70:8301: i/o timeout
2021/04/29 15:47:21 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:47:21 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:47:26 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:47:27 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:47:28 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:47124->10.242.226.70:8301: i/o timeout
2021/04/29 15:47:28 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:47:28 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.500178385s
2021/04/29 15:47:29 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:47:31 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:47:33 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.500338317s
2021/04/29 15:47:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:47262->10.242.226.70:8301: i/o timeout
2021/04/29 15:47:34 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:47:34 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:47:34 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/04/29 15:47:34 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/04/29 15:47:35 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:47:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:47312->10.242.226.70:8301: i/o timeout
2021/04/29 15:47:37 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:47:37 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:47:39 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:47:41 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.226.70
2021/04/29 15:47:41 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:47:41 [INFO] consul: member 'dev-consul-server-2' failed, marking health critical
2021/04/29 15:47:41 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:47372->10.242.226.70:8301: i/o timeout
2021/04/29 15:47:41 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:47:41 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:47:42 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:47:43 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:47:43 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.226.70
2021/04/29 15:47:43 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:47:43 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive
2021/04/29 15:47:43 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:47:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:47442->10.242.226.70:8301: i/o timeout
2021/04/29 15:47:45 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:47:45 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:47:46 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.50027026s
2021/04/29 15:47:47 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:47:48 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.500239113s
2021/04/29 15:47:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:46194->10.242.226.70:8302: i/o timeout
2021/04/29 15:47:49 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/29 15:47:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:47504->10.242.226.70:8301: i/o timeout
2021/04/29 15:47:49 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:47:49 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/29 15:47:49 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.226.70
2021/04/29 15:47:49 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:47:49 [INFO] consul: member 'dev-consul-server-2' failed, marking health critical
2021/04/29 15:47:49 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:47:51 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 4.955720135s
2021/04/29 15:47:51 [ERR] raft: Failed to pipeline AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: write tcp 10.242.121.202:52920->10.242.226.70:8300: use of closed network connection
2021/04/29 15:47:51 [INFO] raft: aborting pipeline replication to peer {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}
2021/04/29 15:47:51 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:47:51 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:47:53 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:47:54 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.500151361s
2021/04/29 15:47:55 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:47:55 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.226.70:55414
2021/04/29 15:47:55 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:47:56 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 4.988654719s
2021/04/29 15:47:56 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:52552->10.242.226.70:8300: i/o timeout
2021/04/29 15:47:57 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:47:57 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:47:58 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 7.456083774s
2021/04/29 15:47:59 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:46288->10.242.226.70:8302: i/o timeout
2021/04/29 15:47:59 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/29 15:47:59 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:01 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:53756->10.242.226.70:8300: i/o timeout
2021/04/29 15:48:01 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:48:01 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:03 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:05 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:07 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:53854->10.242.226.70:8300: i/o timeout
2021/04/29 15:48:07 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:08 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:48:09 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:46528->10.242.226.70:8302: i/o timeout
2021/04/29 15:48:09 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/29 15:48:09 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:11 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:53922->10.242.226.70:8300: i/o timeout
2021/04/29 15:48:11 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:48:11 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:13 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:14 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:48:14 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:48:16 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:48:17 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:18 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:54038->10.242.226.70:8300: i/o timeout
2021/04/29 15:48:18 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:48:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:46698->10.242.226.70:8302: i/o timeout
2021/04/29 15:48:19 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/29 15:48:19 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/29 15:48:19 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.226.70
2021/04/29 15:48:19 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/29 15:48:19 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:21 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:54094->10.242.226.70:8300: i/o timeout
2021/04/29 15:48:21 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:48:21 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:23 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:25 [ERR] memberlist: failed to receive: read tcp 10.242.121.202:8302->10.242.226.70:38100: i/o timeout from=10.242.226.70:38100
2021/04/29 15:48:25 [ERR] memberlist: Failed to send error: write tcp 10.242.121.202:8302->10.242.226.70:38100: i/o timeout from=10.242.226.70:38100
2021/04/29 15:48:25 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:27 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:28 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:54218->10.242.226.70:8300: i/o timeout
2021/04/29 15:48:29 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:48:29 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:31 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:54270->10.242.226.70:8300: i/o timeout
2021/04/29 15:48:31 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:48:31 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:33 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:34 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.226.70:8302
2021/04/29 15:48:35 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:37 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:39 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:54430->10.242.226.70:8300: i/o timeout
2021/04/29 15:48:39 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:40 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:48:41 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:54476->10.242.226.70:8300: i/o timeout
2021/04/29 15:48:41 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:41 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:48:43 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:45 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:47 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:49 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:50 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:54642->10.242.226.70:8300: i/o timeout
2021/04/29 15:48:51 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:48:51 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:51 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:54674->10.242.226.70:8300: i/o timeout
2021/04/29 15:48:51 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:48:53 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:55 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:48:55 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:48:55 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:48:58 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:48:59 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:01 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:54842->10.242.226.70:8300: i/o timeout
2021/04/29 15:49:01 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:01 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:54870->10.242.226.70:8300: i/o timeout
2021/04/29 15:49:02 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:49:02 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:49:03 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:05 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:07 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:09 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:11 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:12 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:55048->10.242.226.70:8300: i/o timeout
2021/04/29 15:49:12 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:55054->10.242.226.70:8300: i/o timeout
2021/04/29 15:49:12 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:49:13 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:49:13 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:15 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:17 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:19 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:21 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:22 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:55244->10.242.226.70:8300: i/o timeout
2021/04/29 15:49:23 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:55260->10.242.226.70:8300: i/o timeout
2021/04/29 15:49:23 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:24 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:49:25 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:49:25 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:27 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:29 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:31 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:33 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:34 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:55456->10.242.226.70:8300: i/o timeout
2021/04/29 15:49:34 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.226.70:8302
2021/04/29 15:49:35 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:55468->10.242.226.70:8300: i/o timeout
2021/04/29 15:49:35 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:36 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:49:37 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:37 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:49:37 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:49:38 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:49:40 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:49:41 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:43 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:45 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:46 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:55672->10.242.226.70:8300: i/o timeout
2021/04/29 15:49:47 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:48 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:55706->10.242.226.70:8300: i/o timeout
2021/04/29 15:49:49 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:51 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:51 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:49:53 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:54 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:49:55 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:57 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:49:58 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.226.70:8301
2021/04/29 15:49:59 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:01 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:01 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:55958->10.242.226.70:8300: i/o timeout
2021/04/29 15:50:03 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:04 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:56000->10.242.226.70:8300: i/o timeout
2021/04/29 15:50:05 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:07 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:09 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:11 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:12 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:50:13 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:15 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:50:15 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:17 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:19 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:19 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:50:19 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:50:22 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:56288->10.242.226.70:8300: i/o timeout
2021/04/29 15:50:22 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:50:22 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/04/29 15:50:23 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:25 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:56334->10.242.226.70:8300: i/o timeout
2021/04/29 15:50:25 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:27 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:29 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:31 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:32 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:50:33 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:34 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.226.70:8302
2021/04/29 15:50:35 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:36 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:50:37 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:39 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:41 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:42 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:56630->10.242.226.70:8300: i/o timeout
2021/04/29 15:50:43 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:45 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:46 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:56710->10.242.226.70:8300: i/o timeout
2021/04/29 15:50:47 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:49 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:51 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:52 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:50:53 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:55 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:57 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:50:57 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:50:59 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:01 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:01 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:51:01 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:51:02 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:57002->10.242.226.70:8300: i/o timeout
2021/04/29 15:51:04 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:51:05 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:07 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:57076->10.242.226.70:8300: i/o timeout
2021/04/29 15:51:07 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:09 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:11 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:12 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:51:13 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:15 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:17 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:18 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:51:19 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:21 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:22 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:57362->10.242.226.70:8300: i/o timeout
2021/04/29 15:51:23 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:25 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:27 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:28 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:57450->10.242.226.70:8300: i/o timeout
2021/04/29 15:51:29 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:31 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:33 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:51:33 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:35 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:37 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:38 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:51:39 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:41 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:43 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:57722->10.242.226.70:8300: i/o timeout
2021/04/29 15:51:43 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:43 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:51:43 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:51:46 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:51:46 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/04/29 15:51:47 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:48 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:57828->10.242.226.70:8300: i/o timeout
2021/04/29 15:51:49 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:51 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:53 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:51:53 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:55 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:57 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:59 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:51:59 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:52:01 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:03 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:58108->10.242.226.70:8300: i/o timeout
2021/04/29 15:52:03 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:05 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:07 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:09 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:09 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:58210->10.242.226.70:8300: i/o timeout
2021/04/29 15:52:11 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:13 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:52:13 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:15 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:17 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:19 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:20 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:52:21 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:23 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:58472->10.242.226.70:8300: i/o timeout
2021/04/29 15:52:23 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:25 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:25 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:52:25 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:52:28 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:52:29 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:30 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:58592->10.242.226.70:8300: i/o timeout
2021/04/29 15:52:31 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:33 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:33 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:52:35 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:37 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:39 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:41 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:41 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:52:43 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:43 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:58864->10.242.226.70:8300: i/o timeout
2021/04/29 15:52:45 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:47 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:49 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:51 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:51 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:59042->10.242.226.70:8300: i/o timeout
2021/04/29 15:52:53 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:54 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:52:55 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:57 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:52:59 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:01 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:02 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:53:03 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:04 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:59292->10.242.226.70:8300: i/o timeout
2021/04/29 15:53:04 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.226.70:8302
2021/04/29 15:53:05 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:07 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:53:07 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:07 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:53:10 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:53:11 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:12 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:59450->10.242.226.70:8300: i/o timeout
2021/04/29 15:53:13 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:14 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:53:15 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:17 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:19 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:21 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:23 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:23 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:53:24 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:59680->10.242.226.70:8300: i/o timeout
2021/04/29 15:53:25 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:27 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:29 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:31 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:33 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:33 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:59864->10.242.226.70:8300: i/o timeout
2021/04/29 15:53:34 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:53:35 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:37 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:38 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.226.70:8301
2021/04/29 15:53:39 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:41 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:43 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:44 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:60046->10.242.226.70:8300: i/o timeout
2021/04/29 15:53:45 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:53:45 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:47 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:49 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:49 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:53:49 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:53:52 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:53:52 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/04/29 15:53:53 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:54 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:53:55 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:60234->10.242.226.70:8300: i/o timeout
2021/04/29 15:53:55 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:57 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:53:59 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:01 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:03 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:04 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.226.70:8302
2021/04/29 15:54:04 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:60424->10.242.226.70:8300: i/o timeout
2021/04/29 15:54:05 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:05 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:54:07 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:09 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:11 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:13 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:15 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:54:15 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:15 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:60630->10.242.226.70:8300: i/o timeout
2021/04/29 15:54:17 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:19 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:21 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:23 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:25 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:60776->10.242.226.70:8300: i/o timeout
2021/04/29 15:54:25 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:27 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:54:27 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:29 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:31 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:31 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:54:31 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:54:34 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:54:35 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:54:35 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:37 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:60980->10.242.226.70:8300: i/o timeout
2021/04/29 15:54:37 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:39 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:41 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:43 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:45 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:32892->10.242.226.70:8300: i/o timeout
2021/04/29 15:54:45 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:47 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:47 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:54:49 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:51 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:53 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:55 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:54:55 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:57 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:54:57 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:33122->10.242.226.70:8300: i/o timeout
2021/04/29 15:54:59 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:01 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:03 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:04 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.226.70:8302
2021/04/29 15:55:05 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:33256->10.242.226.70:8300: i/o timeout
2021/04/29 15:55:05 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:07 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:09 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:55:09 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:11 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:13 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:13 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:55:13 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:55:15 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:55:16 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:55:17 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:19 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:33494->10.242.226.70:8300: i/o timeout
2021/04/29 15:55:19 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:21 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:23 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:25 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:25 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:33612->10.242.226.70:8300: i/o timeout
2021/04/29 15:55:27 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:29 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:30 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:55:31 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:33 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:35 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:35 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:55:37 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:39 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:40 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:33862->10.242.226.70:8300: i/o timeout
2021/04/29 15:55:41 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:43 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:45 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:45 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:33968->10.242.226.70:8300: i/o timeout
2021/04/29 15:55:47 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:48 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.226.70:8301
2021/04/29 15:55:49 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:51 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:55:51 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:53 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:55 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:55:55 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:55:55 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:55:56 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:55:58 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:55:58 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/04/29 15:55:58 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/04/29 15:55:59 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:01 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:34238->10.242.226.70:8300: i/o timeout
2021/04/29 15:56:01 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:03 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:05 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:06 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:34322->10.242.226.70:8300: i/o timeout
2021/04/29 15:56:07 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:09 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:11 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:12 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:56:13 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:15 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:16 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:56:17 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:19 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:21 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:22 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:34616->10.242.226.70:8300: i/o timeout
2021/04/29 15:56:23 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:25 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:26 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:34684->10.242.226.70:8300: i/o timeout
2021/04/29 15:56:27 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:28 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.226.70:8301
2021/04/29 15:56:29 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:31 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:33 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:56:33 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:34 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.226.70:8302
2021/04/29 15:56:35 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:36 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:56:37 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:37 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/29 15:56:37 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/29 15:56:40 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:56:41 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:43 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:34982->10.242.226.70:8300: i/o timeout
2021/04/29 15:56:43 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:45 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:46 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:35038->10.242.226.70:8300: i/o timeout
2021/04/29 15:56:47 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:49 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:51 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:53 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:54 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:56:55 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:56 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:56:57 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:56:59 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:57:01 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:57:03 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:57:04 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: read tcp 10.242.121.202:35348->10.242.226.70:8300: i/o timeout
2021/04/29 15:57:05 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:57:06 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: read tcp 10.242.121.202:35386->10.242.226.70:8300: i/o timeout
2021/04/29 15:57:07 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:57:09 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:57:11 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:57:13 [WARN] raft: Rejecting vote request from 10.242.226.70:8300 since we have a leader: 10.242.121.202:8300
2021/04/29 15:57:13 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:57:13 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2.dc1)
2021/04/29 15:57:15 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:57:15 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:57:17 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:57:17 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.226.70
2021/04/29 15:57:17 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:57:17 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive
2021/04/29 15:57:17 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.226.70
2021/04/29 15:57:17 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/29 15:57:17 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:57:18 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/04/29 15:57:19 [ERR] raft: peer {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300} has newer term, stopping replication
2021/04/29 15:57:19 [INFO] raft: aborting pipeline replication to peer {Voter 1b6640de-e429-69bf-958a-cf5edfb07777 10.242.219.205:8300}
2021/04/29 15:57:19 [INFO] raft: Node at 10.242.121.202:8300 [Follower] entering Follower state (Leader: "")
2021/04/29 15:57:19 [INFO] consul: cluster leadership lost
2021/04/29 15:57:20 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/04/29 15:57:21 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2)
2021/04/29 15:57:22 [WARN] consul.coordinate: Batch update failed: node is not the leader
2021/04/29 15:57:27 [WARN] raft: Heartbeat timeout from "" reached, starting election
2021/04/29 15:57:27 [INFO] raft: Node at 10.242.121.202:8300 [Candidate] entering Candidate state in term 9
2021/04/29 15:57:27 [INFO] raft: Election won. Tally: 2
2021/04/29 15:57:27 [INFO] raft: Node at 10.242.121.202:8300 [Leader] entering Leader state
2021/04/29 15:57:27 [INFO] raft: Added peer 1b6640de-e429-69bf-958a-cf5edfb07777, starting replication
2021/04/29 15:57:27 [INFO] raft: Added peer 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, starting replication
2021/04/29 15:57:27 [INFO] consul: cluster leadership acquired
2021/04/29 15:57:27 [INFO] consul: New leader elected: dev-consul-server-0
2021/04/29 15:57:27 [INFO] raft: pipelining replication to peer {Voter 1b6640de-e429-69bf-958a-cf5edfb07777 10.242.219.205:8300}
2021/04/29 15:57:27 [ERR] raft: peer {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300} has newer term, stopping replication
2021/04/29 15:57:27 [INFO] raft: Node at 10.242.121.202:8300 [Follower] entering Follower state (Leader: "")
2021/04/29 15:57:27 [INFO] raft: aborting pipeline replication to peer {Voter 1b6640de-e429-69bf-958a-cf5edfb07777 10.242.219.205:8300}
2021/04/29 15:57:27 [INFO] consul: cluster leadership lost
2021/04/29 15:57:29 [ERR] http: Request PUT /v1/txn, error: No cluster leader from=10.242.76.199:53856
2021/04/29 15:57:29 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:57988->10.242.226.70:8301: i/o timeout
2021/04/29 15:57:29 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:57:30 [WARN] raft: Rejecting vote request from 10.242.226.70:8300 since our last term is greater (9, 8)
2021/04/29 15:57:31 [ERR] agent: Coordinate update error: No cluster leader
2021/04/29 15:57:32 [ERR] http: Request GET /v1/kv/policy_handler, error: No cluster leader from=10.242.226.71:45420
2021/04/29 15:57:32 [ERR] http: Request GET /v1/catalog/service/config_binding_service, error: No cluster leader from=10.242.76.199:53874
2021/04/29 15:57:36 [ERR] http: Request GET /v1/catalog/service/config_binding_service, error: No cluster leader from=10.242.76.199:53940
2021/04/29 15:57:36 [INFO] consul: New leader elected: dev-consul-server-1
2021/04/29 15:57:37 [WARN] raft: Rejecting vote request from 10.242.226.70:8300 since we have a leader: 10.242.219.205:8300
2021/04/29 15:57:43 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/04/29 15:57:44 [WARN] raft: Heartbeat timeout from "10.242.219.205:8300" reached, starting election
2021/04/29 15:57:44 [INFO] raft: Node at 10.242.121.202:8300 [Candidate] entering Candidate state in term 11
2021/04/29 15:57:44 [INFO] raft: Election won. Tally: 2
2021/04/29 15:57:44 [INFO] raft: Node at 10.242.121.202:8300 [Leader] entering Leader state
2021/04/29 15:57:44 [INFO] raft: Added peer 1b6640de-e429-69bf-958a-cf5edfb07777, starting replication
2021/04/29 15:57:44 [INFO] raft: Added peer 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, starting replication
2021/04/29 15:57:44 [INFO] consul: cluster leadership acquired
2021/04/29 15:57:44 [INFO] consul: New leader elected: dev-consul-server-0
2021/04/29 15:57:44 [INFO] raft: pipelining replication to peer {Voter 1b6640de-e429-69bf-958a-cf5edfb07777 10.242.219.205:8300}
2021/04/29 15:57:46 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:58300->10.242.226.70:8301: i/o timeout
2021/04/29 15:57:46 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:57:46 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/29 15:57:46 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.226.70
2021/04/29 15:57:46 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:57:46 [INFO] consul: member 'dev-consul-server-2' failed, marking health critical
2021/04/29 15:57:46 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.503577191s
2021/04/29 15:57:47 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:57:47 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/04/29 15:57:47 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/04/29 15:57:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:57:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.121.202:57038->10.242.226.70:8302: i/o timeout
2021/04/29 15:57:49 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/29 15:57:49 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 4.997058502s
2021/04/29 15:57:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:57:51 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.226.70
2021/04/29 15:57:51 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:57:51 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive
2021/04/29 15:57:51 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2)
2021/04/29 15:57:51 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 7.433238893s
2021/04/29 15:57:52 [ERR] raft: peer {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300} has newer term, stopping replication
2021/04/29 15:57:52 [INFO] raft: Node at 10.242.121.202:8300 [Follower] entering Follower state (Leader: "")
2021/04/29 15:57:52 [INFO] raft: aborting pipeline replication to peer {Voter 1b6640de-e429-69bf-958a-cf5edfb07777 10.242.219.205:8300}
2021/04/29 15:57:52 [WARN] raft: Rejecting vote request from 10.242.226.70:8300 since our last term is greater (11, 8)
2021/04/29 15:57:52 [INFO] consul: cluster leadership lost
2021/04/29 15:58:01 [WARN] raft: Rejecting vote request from 10.242.226.70:8300 since our last term is greater (11, 8)
2021/04/29 15:58:01 [WARN] raft: Heartbeat timeout from "" reached, starting election
2021/04/29 15:58:01 [INFO] raft: Node at 10.242.121.202:8300 [Candidate] entering Candidate state in term 14
2021/04/29 15:58:01 [INFO] raft: Election won. Tally: 2
2021/04/29 15:58:01 [INFO] raft: Node at 10.242.121.202:8300 [Leader] entering Leader state
2021/04/29 15:58:01 [INFO] raft: Added peer 1b6640de-e429-69bf-958a-cf5edfb07777, starting replication
2021/04/29 15:58:01 [INFO] raft: Added peer 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, starting replication
2021/04/29 15:58:01 [INFO] consul: cluster leadership acquired
2021/04/29 15:58:01 [INFO] consul: New leader elected: dev-consul-server-0
2021/04/29 15:58:01 [INFO] raft: pipelining replication to peer {Voter 1b6640de-e429-69bf-958a-cf5edfb07777 10.242.219.205:8300}
2021/04/29 15:58:01 [WARN] raft: AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300} rejected, sending older logs (next: 762)
2021/04/29 15:58:01 [INFO] raft: pipelining replication to peer {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}
2021/04/29 15:58:05 [INFO] raft: aborting pipeline replication to peer {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}
2021/04/29 15:58:05 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: EOF
2021/04/29 15:58:05 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: EOF
2021/04/29 15:58:05 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: dial tcp ->10.242.226.70:8300: getsockopt: connection refused
2021/04/29 15:58:05 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: dial tcp ->10.242.226.70:8300: getsockopt: connection refused
2021/04/29 15:58:06 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: dial tcp ->10.242.226.70:8300: getsockopt: connection refused
2021/04/29 15:58:06 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: dial tcp ->10.242.226.70:8300: getsockopt: connection refused
2021/04/29 15:58:07 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: stream closed
2021/04/29 15:58:08 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 2.500259946s
2021/04/29 15:58:08 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:58:10 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:58:10 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 4.990711647s
2021/04/29 15:58:11 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:58:13 [WARN] raft: Failed to contact 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 in 7.431071488s
2021/04/29 15:58:13 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:58:15 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:58:16 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: dial tcp ->10.242.226.70:8300: i/o timeout
2021/04/29 15:58:16 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: dial tcp ->10.242.226.70:8300: i/o timeout
2021/04/29 15:58:16 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:58:17 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:58:19 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:58:19 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error getting client: failed to get conn: dial tcp ->10.242.226.70:8300: i/o timeout
2021/04/29 15:58:20 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.226.70
2021/04/29 15:58:20 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.226.70:8300) (DC: dc1)
2021/04/29 15:58:20 [INFO] consul: member 'dev-consul-server-2' failed, marking health critical
2021/04/29 15:58:22 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:58:23 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:58:25 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:58:26 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: dial tcp ->10.242.226.70:8300: i/o timeout
2021/04/29 15:58:26 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:58:27 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:58:27 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: dial tcp ->10.242.226.70:8300: i/o timeout
2021/04/29 15:58:28 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:58:28 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/29 15:58:29 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:58:31 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:58:31 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error getting client: failed to get conn: dial tcp ->10.242.226.70:8300: i/o timeout
2021/04/29 15:58:34 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:58:35 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:58:36 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: dial tcp ->10.242.226.70:8300: i/o timeout
2021/04/29 15:58:37 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:58:37 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:58:38 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: dial tcp ->10.242.226.70:8300: i/o timeout
2021/04/29 15:58:39 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:58:39 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:58:41 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:58:42 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/29 15:58:43 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error getting client: failed to get conn: dial tcp ->10.242.226.70:8300: i/o timeout
2021/04/29 15:58:44 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/29 15:58:45 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:58:47 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:58:47 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: dial tcp ->10.242.226.70:8300: i/o timeout
2021/04/29 15:58:48 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:58:49 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: dial tcp ->10.242.226.70:8300: i/o timeout
2021/04/29 15:58:49 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:58:50 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:58:51 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:58:53 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/29 15:58:53 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error getting client: failed to get conn: dial tcp ->10.242.226.70:8300: i/o timeout
2021/04/29 15:58:54 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.64.167
2021/04/29 15:58:54 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.64.167:8300) (DC: dc1)
2021/04/29 15:58:54 [INFO] raft: Updating configuration with AddNonvoter (b6ca2d10-0836-a862-f3e7-c29a89b7571d, 10.242.64.167:8300) to [{Suffrage:Voter ID:04c0514d-f716-e1ff-58b3-22dd44795e60 Address:10.242.121.202:8300} {Suffrage:Voter ID:1b6640de-e429-69bf-958a-cf5edfb07777 Address:10.242.219.205:8300} {Suffrage:Voter ID:5f9a9592-30f1-5e71-d3a7-8589f99be8d1 Address:10.242.226.70:8300} {Suffrage:Nonvoter ID:b6ca2d10-0836-a862-f3e7-c29a89b7571d Address:10.242.64.167:8300}]
2021/04/29 15:58:54 [INFO] raft: Added peer b6ca2d10-0836-a862-f3e7-c29a89b7571d, starting replication
2021/04/29 15:58:54 [ERR] memberlist: Conflicting address for dev-consul-server-2.dc1. Mine: 10.242.226.70:8302 Theirs: 10.242.64.167:8302
2021/04/29 15:58:54 [WARN] serf: Name conflict for 'dev-consul-server-2.dc1' both 10.242.226.70:8302 and 10.242.64.167:8302 are claiming
2021/04/29 15:58:54 [WARN] raft: AppendEntries to {Nonvoter b6ca2d10-0836-a862-f3e7-c29a89b7571d 10.242.64.167:8300} rejected, sending older logs (next: 1)
2021/04/29 15:58:54 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive
2021/04/29 15:58:54 [INFO] raft: pipelining replication to peer {Nonvoter b6ca2d10-0836-a862-f3e7-c29a89b7571d 10.242.64.167:8300}
2021/04/29 15:58:54 [ERR] memberlist: Conflicting address for dev-consul-server-2.dc1. Mine: 10.242.226.70:8302 Theirs: 10.242.64.167:8302
2021/04/29 15:58:54 [WARN] serf: Name conflict for 'dev-consul-server-2.dc1' both 10.242.226.70:8302 and 10.242.64.167:8302 are claiming
2021/04/29 15:58:54 [ERR] memberlist: Conflicting address for dev-consul-server-2.dc1. Mine: 10.242.226.70:8302 Theirs: 10.242.64.167:8302
2021/04/29 15:58:54 [WARN] serf: Name conflict for 'dev-consul-server-2.dc1' both 10.242.226.70:8302 and 10.242.64.167:8302 are claiming
2021/04/29 15:58:55 [ERR] memberlist: Conflicting address for dev-consul-server-2.dc1. Mine: 10.242.226.70:8302 Theirs: 10.242.64.167:8302
2021/04/29 15:58:55 [WARN] serf: Name conflict for 'dev-consul-server-2.dc1' both 10.242.226.70:8302 and 10.242.64.167:8302 are claiming
2021/04/29 15:58:55 [ERR] memberlist: Conflicting address for dev-consul-server-2.dc1. Mine: 10.242.226.70:8302 Theirs: 10.242.64.167:8302
2021/04/29 15:58:55 [WARN] serf: Name conflict for 'dev-consul-server-2.dc1' both 10.242.226.70:8302 and 10.242.64.167:8302 are claiming
2021/04/29 15:58:58 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: dial tcp ->10.242.226.70:8300: i/o timeout
2021/04/29 15:59:00 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: dial tcp ->10.242.226.70:8300: i/o timeout
2021/04/29 15:59:01 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:59:01 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:59:11 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: dial tcp ->10.242.226.70:8300: i/o timeout
2021/04/29 15:59:11 [INFO] autopilot: Promoting Server (ID: "b6ca2d10-0836-a862-f3e7-c29a89b7571d" Address: "10.242.64.167:8300") to voter
2021/04/29 15:59:11 [INFO] raft: Updating configuration with AddStaging (b6ca2d10-0836-a862-f3e7-c29a89b7571d, 10.242.64.167:8300) to [{Suffrage:Voter ID:04c0514d-f716-e1ff-58b3-22dd44795e60 Address:10.242.121.202:8300} {Suffrage:Voter ID:1b6640de-e429-69bf-958a-cf5edfb07777 Address:10.242.219.205:8300} {Suffrage:Voter ID:5f9a9592-30f1-5e71-d3a7-8589f99be8d1 Address:10.242.226.70:8300} {Suffrage:Voter ID:b6ca2d10-0836-a862-f3e7-c29a89b7571d Address:10.242.64.167:8300}]
2021/04/29 15:59:11 [INFO] autopilot: Attempting removal of stale Server (ID: "5f9a9592-30f1-5e71-d3a7-8589f99be8d1" Address: "10.242.226.70:8300")
2021/04/29 15:59:11 [INFO] raft: Updating configuration with RemoveServer (5f9a9592-30f1-5e71-d3a7-8589f99be8d1, ) to [{Suffrage:Voter ID:04c0514d-f716-e1ff-58b3-22dd44795e60 Address:10.242.121.202:8300} {Suffrage:Voter ID:1b6640de-e429-69bf-958a-cf5edfb07777 Address:10.242.219.205:8300} {Suffrage:Voter ID:b6ca2d10-0836-a862-f3e7-c29a89b7571d Address:10.242.64.167:8300}]
2021/04/29 15:59:11 [INFO] raft: Removed peer 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, stopping replication after 879
2021/04/29 15:59:11 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: dial tcp ->10.242.226.70:8300: i/o timeout
2021/04/29 15:59:12 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:59:12 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/29 15:59:12 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.226.70
2021/04/29 15:59:12 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/29 15:59:15 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/29 15:59:16 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:59:22 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: dial tcp ->10.242.226.70:8300: i/o timeout
2021/04/29 15:59:23 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:59:26 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: dial tcp ->10.242.226.70:8300: i/o timeout
2021/04/29 15:59:33 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: dial tcp ->10.242.226.70:8300: i/o timeout
2021/04/29 15:59:34 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.226.70:8302
2021/04/29 15:59:35 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:59:36 [WARN] Unable to get address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1, using fallback address 10.242.226.70:8300: Could not find address for server id 5f9a9592-30f1-5e71-d3a7-8589f99be8d1
2021/04/29 15:59:45 [ERR] raft: Failed to heartbeat to 10.242.226.70:8300: dial tcp ->10.242.226.70:8300: i/o timeout
2021/04/29 15:59:46 [ERR] raft: Failed to AppendEntries to {Voter 5f9a9592-30f1-5e71-d3a7-8589f99be8d1 10.242.226.70:8300}: dial tcp ->10.242.226.70:8300: i/o timeout
2021/04/29 16:00:22 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.64.167
2021/04/29 16:00:22 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"