By type
+ CONSUL_BIND=
+ [ -n ]
+ CONSUL_CLIENT=
+ [ -n ]
+ CONSUL_DATA_DIR=/consul/data
+ CONSUL_CONFIG_DIR=/consul/config
+ [ -n ]
+ [ a = - ]
+ [ agent = agent ]
+ shift
+ set -- consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui
+ [ consul = consul ]
+ stat -c %u /consul/data
+ id -u consul
+ [ 100 != 100 ]
+ stat -c %u /consul/config
+ id -u consul
+ [ 100 != 100 ]
+ [ ! -z ]
+ exec consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui
bootstrap_expect > 0: expecting 3 servers
==> Starting Consul agent...
==> Consul agent running!
Version: 'v1.0.6'
Node ID: 'd942fbe0-30f7-c6b7-2f54-9c43c9c150dd'
Node name: 'dev-consul-server-2'
Datacenter: 'dc1' (Segment: '')
Server: true (Bootstrap: false)
Client Addr: [0.0.0.0] (HTTP: 8500, HTTPS: -1, DNS: 8600)
Cluster Addr: 10.242.37.70 (LAN: 8301, WAN: 8302)
Encrypt: Gossip: false, TLS-Outgoing: false, TLS-Incoming: false
==> Log data will now stream in as it occurs:
2021/06/05 10:40:37 [INFO] raft: Initial configuration (index=0): []
2021/06/05 10:40:37 [INFO] raft: Node at 10.242.37.70:8300 [Follower] entering Follower state (Leader: "")
2021/06/05 10:40:37 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.37.70
2021/06/05 10:40:37 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.37.70
2021/06/05 10:40:37 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.37.70:8300) (DC: dc1)
2021/06/05 10:40:37 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/06/05 10:40:37 [INFO] agent: Started DNS server 0.0.0.0:8600 (udp)
2021/06/05 10:40:37 [INFO] agent: Started DNS server 0.0.0.0:8600 (tcp)
2021/06/05 10:40:37 [INFO] agent: Started HTTP server on [::]:8500 (tcp)
2021/06/05 10:40:37 [INFO] agent: started state syncer
2021/06/05 10:40:37 [INFO] agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce os scaleway softlayer
2021/06/05 10:40:37 [INFO] agent: Joining LAN cluster...
2021/06/05 10:40:37 [INFO] agent: (LAN) joining: [dev-consul-server-0.consul-server dev-consul-server-1.consul-server dev-consul-server-2.consul-server]
2021/06/05 10:40:37 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-5tc7t 10.242.7.74
2021/06/05 10:40:37 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.7.75
2021/06/05 10:40:37 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.7.75:8300) (DC: dc1)
2021/06/05 10:40:37 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.7.75
2021/06/05 10:40:37 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/06/05 10:40:37 [WARN] memberlist: Failed to resolve dev-consul-server-1.consul-server: lookup dev-consul-server-1.consul-server on 10.96.0.10:53: no such host
2021/06/05 10:40:37 [WARN] memberlist: Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host
2021/06/05 10:40:37 [INFO] agent: (LAN) joined: 1 Err:
2021/06/05 10:40:37 [INFO] agent: Join LAN completed. Synced with 1 initial agents
2021/06/05 10:40:44 [WARN] raft: no known peers, aborting election
2021/06/05 10:40:44 [ERR] agent: failed to sync remote state: No cluster leader
2021/06/05 10:40:53 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 10:40:53 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 10:40:53 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 10:40:53 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 10:40:53 [INFO] consul: Existing Raft peers reported by dev-consul-server-0, disabling bootstrap mode
2021/06/05 10:40:54 [DEBUG] raft-net: 10.242.37.70:8300 accepted connection from: 10.242.204.71:43388
2021/06/05 10:40:54 [WARN] raft: Failed to get previous log: 1 log not found (last: 0)
2021/06/05 10:40:54 [INFO] consul: New leader elected: dev-consul-server-1
2021/06/05 10:40:55 [DEBUG] raft-net: 10.242.37.70:8300 accepted connection from: 10.242.204.71:43394
2021/06/05 10:40:56 [INFO] agent: Synced node info
==> Failed to check for updates: Get https://checkpoint-api.hashicorp.com/v1/check/consul?arch=amd64&os=linux&signature=180ac4e2-2440-0883-c306-66044ca05393&version=1.0.6: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/06/05 11:45:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:39446->10.242.204.71:8301: i/o timeout
2021/06/05 11:45:22 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:45:25 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:39494->10.242.204.71:8301: i/o timeout
2021/06/05 11:45:25 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:45:26 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 11:45:26 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 11:45:26 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:45:28 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 11:45:28 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:46:11 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:40236->10.242.204.71:8301: i/o timeout
2021/06/05 11:46:11 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:46:14 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 11:46:14 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 11:46:14 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:46:15 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:40300->10.242.204.71:8301: i/o timeout
2021/06/05 11:46:15 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:46:17 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:44790->10.242.204.71:8302: i/o timeout
2021/06/05 11:46:17 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:46:19 [DEBUG] raft-net: 10.242.37.70:8300 accepted connection from: 10.242.7.75:43216
2021/06/05 11:46:19 [WARN] raft: Rejecting vote request from 10.242.7.75:8300 since we have a leader: 10.242.204.71:8300
2021/06/05 11:46:22 [WARN] raft: Heartbeat timeout from "10.242.204.71:8300" reached, starting election
2021/06/05 11:46:22 [INFO] raft: Node at 10.242.37.70:8300 [Candidate] entering Candidate state in term 3
2021/06/05 11:46:22 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 11:46:25 [INFO] raft: Node at 10.242.37.70:8300 [Follower] entering Follower state (Leader: "")
2021/06/05 11:46:25 [INFO] consul: New leader elected: dev-consul-server-0
2021/06/05 11:46:25 [DEBUG] raft-net: 10.242.37.70:8300 accepted connection from: 10.242.7.75:43334
2021/06/05 11:46:27 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:44948->10.242.204.71:8302: i/o timeout
2021/06/05 11:46:27 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:46:32 [ERR] raft: Failed to make RequestVote RPC to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:41168->10.242.204.71:8300: i/o timeout
2021/06/05 11:46:34 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 11:46:34 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.204.71:43372
2021/06/05 11:46:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:45018->10.242.204.71:8302: i/o timeout
2021/06/05 11:46:37 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:46:38 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 11:46:38 [ERR] http: Request GET /v1/catalog/service/config_binding_service, error: rpc error making call: EOF from=10.242.79.8:39164
2021/06/05 11:46:44 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1)
2021/06/05 11:46:44 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 11:46:44 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:46:47 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:40786->10.242.204.71:8301: i/o timeout
2021/06/05 11:46:47 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:46:50 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:40814->10.242.204.71:8301: i/o timeout
2021/06/05 11:46:50 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:46:50 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 11:46:50 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:47:02 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:45470->10.242.204.71:8302: i/o timeout
2021/06/05 11:47:02 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:47:07 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.204.71:8301
2021/06/05 11:47:12 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:45548->10.242.204.71:8302: i/o timeout
2021/06/05 11:47:12 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:47:24 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 11:47:24 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.204.71:46856
2021/06/05 11:47:26 [INFO] memberlist: Marking dev-consul-server-1.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/05 11:47:26 [INFO] serf: EventMemberFailed: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 11:47:26 [INFO] consul: Handled member-failed event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 11:47:27 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:45874->10.242.204.71:8302: i/o timeout
2021/06/05 11:47:27 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:47:47 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.204.71:8301
2021/06/05 11:47:53 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 11:47:53 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:47:53 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 11:47:53 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 11:48:12 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:42152->10.242.204.71:8301: i/o timeout
2021/06/05 11:48:15 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:42298->10.242.204.71:8301: i/o timeout
2021/06/05 11:48:15 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:48:19 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1)
2021/06/05 11:48:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:42416->10.242.204.71:8301: i/o timeout
2021/06/05 11:48:22 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:48:25 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:42422->10.242.204.71:8301: i/o timeout
2021/06/05 11:48:25 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:48:26 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 11:48:26 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 11:48:26 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:48:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:47088->10.242.204.71:8302: i/o timeout
2021/06/05 11:48:37 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:48:40 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 11:48:40 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:48:45 [WARN] memberlist: Was able to connect to dev-consul-server-1 but other probes failed, network may be misconfigured
2021/06/05 11:48:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:42812->10.242.204.71:8301: i/o timeout
2021/06/05 11:48:49 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:48:50 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 11:48:50 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 11:48:50 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:48:50 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 11:48:50 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:49:05 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:43086->10.242.204.71:8301: i/o timeout
2021/06/05 11:49:05 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:49:08 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:43126->10.242.204.71:8301: i/o timeout
2021/06/05 11:49:08 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:49:17 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:43272->10.242.204.71:8301: i/o timeout
2021/06/05 11:49:17 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:49:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:43300->10.242.204.71:8301: i/o timeout
2021/06/05 11:49:19 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:49:19 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 11:49:19 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 11:49:19 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:49:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:47806->10.242.204.71:8302: i/o timeout
2021/06/05 11:49:22 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:49:23 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.204.71:8301
2021/06/05 11:49:34 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 11:49:34 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:49:35 [WARN] raft: Rejecting vote request from 10.242.204.71:8300 since we have a leader: 10.242.7.75:8300
2021/06/05 11:49:35 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1.dc1)
2021/06/05 11:50:07 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:44102->10.242.204.71:8301: i/o timeout
2021/06/05 11:50:07 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:50:21 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:44318->10.242.204.71:8301: i/o timeout
2021/06/05 11:50:21 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:50:25 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 11:50:25 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 11:50:25 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:50:26 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1)
2021/06/05 11:50:26 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:44402->10.242.204.71:8301: i/o timeout
2021/06/05 11:50:26 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:50:30 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 11:50:30 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:50:36 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:44544->10.242.204.71:8301: i/o timeout
2021/06/05 11:50:36 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:50:36 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 11:50:36 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 11:50:36 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:50:47 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:49188->10.242.204.71:8302: i/o timeout
2021/06/05 11:50:47 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:51:02 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:49412->10.242.204.71:8302: i/o timeout
2021/06/05 11:51:02 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:51:06 [INFO] memberlist: Marking dev-consul-server-1.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/05 11:51:06 [INFO] serf: EventMemberFailed: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 11:51:06 [INFO] consul: Handled member-failed event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 11:51:07 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.204.71:8302
2021/06/05 11:51:13 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 11:51:13 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:51:13 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 11:51:13 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 11:51:15 [WARN] raft: Rejecting vote request from 10.242.204.71:8300 since we have a leader: 10.242.7.75:8300
2021/06/05 11:51:20 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:45336->10.242.204.71:8301: i/o timeout
2021/06/05 11:52:03 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:46042->10.242.204.71:8301: i/o timeout
2021/06/05 11:52:03 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:52:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:46326->10.242.204.71:8301: i/o timeout
2021/06/05 11:52:19 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:52:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:46358->10.242.204.71:8301: i/o timeout
2021/06/05 11:52:22 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:52:22 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 11:52:22 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 11:52:22 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:52:24 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 11:52:24 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:52:27 [WARN] memberlist: Was able to connect to dev-consul-server-1.dc1 but other probes failed, network may be misconfigured
2021/06/05 11:52:27 [WARN] memberlist: Was able to connect to dev-consul-server-1 but other probes failed, network may be misconfigured
2021/06/05 11:52:28 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1.dc1)
2021/06/05 11:52:29 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:46490->10.242.204.71:8301: i/o timeout
2021/06/05 11:52:29 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:52:30 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 11:52:30 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 11:52:30 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:52:49 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 11:52:49 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:52:50 [WARN] raft: Rejecting vote request from 10.242.204.71:8300 since we have a leader: 10.242.7.75:8300
2021/06/05 11:53:15 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:47226->10.242.204.71:8301: i/o timeout
2021/06/05 11:53:15 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:53:18 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 11:53:18 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 11:53:18 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:53:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:47276->10.242.204.71:8301: i/o timeout
2021/06/05 11:53:19 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:53:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:51778->10.242.204.71:8302: i/o timeout
2021/06/05 11:53:32 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 11:53:32 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:53:32 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:51938->10.242.204.71:8302: i/o timeout
2021/06/05 11:53:32 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:53:35 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:47518->10.242.204.71:8301: i/o timeout
2021/06/05 11:53:35 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:53:37 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 11:53:37 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 11:53:37 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:53:38 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:47552->10.242.204.71:8301: i/o timeout
2021/06/05 11:53:38 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:53:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:52088->10.242.204.71:8302: i/o timeout
2021/06/05 11:53:42 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:53:52 [WARN] memberlist: Was able to connect to dev-consul-server-1.dc1 but other probes failed, network may be misconfigured
2021/06/05 11:54:05 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 11:54:05 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:54:06 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:47988->10.242.204.71:8301: i/o timeout
2021/06/05 11:54:06 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:54:07 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:52464->10.242.204.71:8302: i/o timeout
2021/06/05 11:54:07 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:54:08 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1.dc1)
2021/06/05 11:54:09 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:48036->10.242.204.71:8301: i/o timeout
2021/06/05 11:54:09 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:54:10 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 11:54:10 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 11:54:10 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:54:18 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 11:54:18 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:54:20 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:48316->10.242.204.71:8301: i/o timeout
2021/06/05 11:54:20 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:54:23 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:48370->10.242.204.71:8301: i/o timeout
2021/06/05 11:54:23 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:54:24 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 11:54:24 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 11:54:24 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:54:26 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:48384->10.242.204.71:8301: i/o timeout
2021/06/05 11:54:26 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:54:27 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:52904->10.242.204.71:8302: i/o timeout
2021/06/05 11:54:27 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:54:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:53122->10.242.204.71:8302: i/o timeout
2021/06/05 11:54:42 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:54:43 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 11:54:43 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.204.71:52064
2021/06/05 11:54:52 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:53210->10.242.204.71:8302: i/o timeout
2021/06/05 11:54:52 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:54:57 [INFO] serf: EventMemberFailed: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 11:54:57 [INFO] consul: Handled member-failed event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 11:54:57 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 11:54:57 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:54:57 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1)
2021/06/05 11:54:57 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-5tc7t 10.242.7.74
2021/06/05 11:54:57 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 11:54:57 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 11:54:57 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-5tc7t 10.242.7.74
2021/06/05 11:54:57 [WARN] raft: Rejecting vote request from 10.242.204.71:8300 since we have a leader: 10.242.7.75:8300
2021/06/05 11:55:32 [WARN] memberlist: Was able to connect to dev-consul-server-1 but other probes failed, network may be misconfigured
2021/06/05 11:55:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:49536->10.242.204.71:8301: i/o timeout
2021/06/05 11:55:34 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:55:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:54044->10.242.204.71:8302: i/o timeout
2021/06/05 11:55:37 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:55:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:49590->10.242.204.71:8301: i/o timeout
2021/06/05 11:55:37 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:55:37 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 11:55:37 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:55:47 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:54126->10.242.204.71:8302: i/o timeout
2021/06/05 11:55:47 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:56:02 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:54446->10.242.204.71:8302: i/o timeout
2021/06/05 11:56:02 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:56:07 [INFO] memberlist: Marking dev-consul-server-1.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/05 11:56:07 [INFO] serf: EventMemberFailed: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 11:56:07 [INFO] consul: Handled member-failed event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 11:56:12 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:54608->10.242.204.71:8302: i/o timeout
2021/06/05 11:56:12 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:56:13 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.204.71:8302
2021/06/05 11:57:13 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.204.71:8302
2021/06/05 11:58:00 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 11:58:00 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:58:00 [WARN] raft: Rejecting vote request from 10.242.204.71:8300 since we have a leader: 10.242.7.75:8300
2021/06/05 11:58:00 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 11:58:00 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 11:58:01 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1.dc1)
2021/06/05 11:58:09 [WARN] raft: Rejecting vote request from 10.242.204.71:8300 since we have a leader: 10.242.7.75:8300
2021/06/05 11:58:12 [WARN] raft: Heartbeat timeout from "10.242.7.75:8300" reached, starting election
2021/06/05 11:58:12 [INFO] raft: Node at 10.242.37.70:8300 [Candidate] entering Candidate state in term 5
2021/06/05 11:58:12 [INFO] raft: Node at 10.242.37.70:8300 [Follower] entering Follower state (Leader: "")
2021/06/05 11:58:15 [INFO] consul: New leader elected: dev-consul-server-0
2021/06/05 11:58:16 [DEBUG] raft-net: 10.242.37.70:8300 accepted connection from: 10.242.7.75:56642
2021/06/05 11:59:06 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:53334->10.242.204.71:8301: i/o timeout
2021/06/05 11:59:06 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:59:10 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:53414->10.242.204.71:8301: i/o timeout
2021/06/05 11:59:10 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:59:13 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:53462->10.242.204.71:8301: i/o timeout
2021/06/05 11:59:13 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 11:59:14 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 11:59:14 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:59:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:58046->10.242.204.71:8302: i/o timeout
2021/06/05 11:59:22 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:59:32 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:58144->10.242.204.71:8302: i/o timeout
2021/06/05 11:59:32 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:59:33 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.204.71:8301
2021/06/05 11:59:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:58368->10.242.204.71:8302: i/o timeout
2021/06/05 11:59:42 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 11:59:48 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 11:59:48 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 11:59:48 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1.dc1)
2021/06/05 11:59:48 [WARN] raft: Rejecting vote request from 10.242.204.71:8300 since we have a leader: 10.242.7.75:8300
2021/06/05 11:59:55 [INFO] consul: New leader elected: dev-consul-server-0
2021/06/05 11:59:56 [DEBUG] raft-net: 10.242.37.70:8300 accepted connection from: 10.242.7.75:58518
2021/06/05 11:59:57 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1)
2021/06/05 11:59:59 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:54154->10.242.204.71:8301: i/o timeout
2021/06/05 11:59:59 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:00:01 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:54202->10.242.204.71:8301: i/o timeout
2021/06/05 12:00:01 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:00:01 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 12:00:01 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 12:00:01 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:00:07 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:58754->10.242.204.71:8302: i/o timeout
2021/06/05 12:00:07 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:00:10 [WARN] raft: Rejecting vote request from 10.242.204.71:8300 since we have a leader: 10.242.7.75:8300
2021/06/05 12:00:10 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 12:00:10 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:00:15 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:54528->10.242.204.71:8301: i/o timeout
2021/06/05 12:00:15 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:00:16 [WARN] raft: Heartbeat timeout from "10.242.7.75:8300" reached, starting election
2021/06/05 12:00:16 [INFO] raft: Node at 10.242.37.70:8300 [Candidate] entering Candidate state in term 9
2021/06/05 12:00:16 [INFO] raft: Election won. Tally: 2
2021/06/05 12:00:16 [INFO] raft: Node at 10.242.37.70:8300 [Leader] entering Leader state
2021/06/05 12:00:16 [INFO] raft: Added peer 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, starting replication
2021/06/05 12:00:16 [INFO] raft: Added peer 5fa9f731-8cb6-e040-8d5f-1f0ab18b143a, starting replication
2021/06/05 12:00:16 [INFO] consul: cluster leadership acquired
2021/06/05 12:00:16 [INFO] consul: New leader elected: dev-consul-server-2
2021/06/05 12:00:16 [INFO] raft: pipelining replication to peer {Voter 5fa9f731-8cb6-e040-8d5f-1f0ab18b143a 10.242.7.75:8300}
2021/06/05 12:00:16 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/06/05 12:00:18 [WARN] memberlist: Was able to connect to dev-consul-server-1 but other probes failed, network may be misconfigured
2021/06/05 12:00:18 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.501476968s
2021/06/05 12:00:19 [WARN] raft: AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300} rejected, sending older logs (next: 928)
2021/06/05 12:00:19 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:00:19 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/06/05 12:00:19 [INFO] raft: pipelining replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:00:21 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:00:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:00:22 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500222229s
2021/06/05 12:00:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:54656->10.242.204.71:8301: i/o timeout
2021/06/05 12:00:22 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:00:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:00:24 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.947733327s
2021/06/05 12:00:25 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:54676->10.242.204.71:8301: i/o timeout
2021/06/05 12:00:25 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:00:25 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 12:00:25 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 12:00:25 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:00:25 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical
2021/06/05 12:00:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:00:27 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.382452623s
2021/06/05 12:00:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:00:29 [INFO] raft: aborting pipeline replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:00:30 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:00:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:00:30 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:53154->10.242.204.71:8300: i/o timeout
2021/06/05 12:00:31 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:00:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:00:32 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500188203s
2021/06/05 12:00:32 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:59260->10.242.204.71:8302: i/o timeout
2021/06/05 12:00:32 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:00:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:00:34 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.998122617s
2021/06/05 12:00:36 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:00:37 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.481054973s
2021/06/05 12:00:38 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:00:40 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:55520->10.242.204.71:8300: i/o timeout
2021/06/05 12:00:40 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:00:40 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:00:41 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:55552->10.242.204.71:8300: i/o timeout
2021/06/05 12:00:42 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:00:42 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:00:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:59338->10.242.204.71:8302: i/o timeout
2021/06/05 12:00:42 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:00:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:00:46 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:00:48 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:00:50 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:55680->10.242.204.71:8300: i/o timeout
2021/06/05 12:00:50 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:00:50 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:00:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:00:52 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:55730->10.242.204.71:8300: i/o timeout
2021/06/05 12:00:53 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:00:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:00:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:00:56 [INFO] memberlist: Marking dev-consul-server-1.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/05 12:00:56 [INFO] serf: EventMemberFailed: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 12:00:56 [INFO] consul: Handled member-failed event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 12:00:57 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:59674->10.242.204.71:8302: i/o timeout
2021/06/05 12:00:57 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:00:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:00:58 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 12:00:58 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF
2021/06/05 12:00:58 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 12:00:58 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.204.71:57012
2021/06/05 12:01:00 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:55842->10.242.204.71:8300: i/o timeout
2021/06/05 12:01:00 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:01:01 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:01:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:03 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:55900->10.242.204.71:8300: i/o timeout
2021/06/05 12:01:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:04 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:01:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:10 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:56000->10.242.204.71:8300: i/o timeout
2021/06/05 12:01:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:10 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:01:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:13 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.204.71:8302
2021/06/05 12:01:13 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.204.71:8301
2021/06/05 12:01:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:14 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:56060->10.242.204.71:8300: i/o timeout
2021/06/05 12:01:15 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:01:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:20 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:56158->10.242.204.71:8300: i/o timeout
2021/06/05 12:01:20 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:01:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:25 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:56244->10.242.204.71:8300: i/o timeout
2021/06/05 12:01:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:26 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:01:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:30 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:56308->10.242.204.71:8300: i/o timeout
2021/06/05 12:01:30 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:01:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:36 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:36 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:56418->10.242.204.71:8300: i/o timeout
2021/06/05 12:01:37 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:01:38 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:40 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:40 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 12:01:40 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF
2021/06/05 12:01:40 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:56484->10.242.204.71:8300: i/o timeout
2021/06/05 12:01:40 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:01:43 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:01:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:46 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:47 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:56606->10.242.204.71:8300: i/o timeout
2021/06/05 12:01:48 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:48 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:01:50 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:50 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:56666->10.242.204.71:8300: i/o timeout
2021/06/05 12:01:51 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:01:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:01:58 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:56798->10.242.204.71:8300: i/o timeout
2021/06/05 12:02:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:00 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:02:01 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:56868->10.242.204.71:8300: i/o timeout
2021/06/05 12:02:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:02 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:02:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:10 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:57018->10.242.204.71:8300: i/o timeout
2021/06/05 12:02:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:12 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:57056->10.242.204.71:8300: i/o timeout
2021/06/05 12:02:13 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.204.71:8302
2021/06/05 12:02:13 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:02:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:15 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:02:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:22 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 12:02:22 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF
2021/06/05 12:02:23 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:57258->10.242.204.71:8300: i/o timeout
2021/06/05 12:02:25 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:02:25 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:57298->10.242.204.71:8300: i/o timeout
2021/06/05 12:02:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:29 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:02:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:30 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:02:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:36 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:38 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:39 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:57550->10.242.204.71:8300: i/o timeout
2021/06/05 12:02:40 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:40 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:57568->10.242.204.71:8300: i/o timeout
2021/06/05 12:02:42 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:46 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:48 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:50 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:50 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:02:50 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:02:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:02:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:00 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:57930->10.242.204.71:8300: i/o timeout
2021/06/05 12:03:00 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:57932->10.242.204.71:8300: i/o timeout
2021/06/05 12:03:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:04 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 12:03:04 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF
2021/06/05 12:03:07 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:03:07 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/06/05 12:03:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:10 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:03:11 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:03:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:13 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.204.71:8302
2021/06/05 12:03:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:20 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:58312->10.242.204.71:8300: i/o timeout
2021/06/05 12:03:21 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:58330->10.242.204.71:8300: i/o timeout
2021/06/05 12:03:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:23 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.204.71:8301
2021/06/05 12:03:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:30 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:03:31 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:03:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:36 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:38 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:40 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:40 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:58808->10.242.204.71:8300: i/o timeout
2021/06/05 12:03:41 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:58838->10.242.204.71:8300: i/o timeout
2021/06/05 12:03:42 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:46 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:46 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 12:03:46 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF
2021/06/05 12:03:49 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:03:50 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:51 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:03:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:52 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:03:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:03:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:04:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:04:00 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 12:04:00 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 12:04:00 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 12:04:00 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:04:00 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/06/05 12:04:01 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:59206->10.242.204.71:8300: i/o timeout
2021/06/05 12:04:11 [INFO] raft: pipelining replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:05:05 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:05:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:06 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:59886->10.242.204.71:8301: i/o timeout
2021/06/05 12:05:06 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:05:07 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500247599s
2021/06/05 12:05:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:08 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 12:05:08 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:05:08 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical
2021/06/05 12:05:09 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:59942->10.242.204.71:8301: i/o timeout
2021/06/05 12:05:09 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:05:09 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.50021569s
2021/06/05 12:05:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:10 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 12:05:10 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:05:10 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/06/05 12:05:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:12 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.912567667s
2021/06/05 12:05:12 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:36230->10.242.204.71:8302: i/o timeout
2021/06/05 12:05:12 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:05:12 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:60016->10.242.204.71:8301: i/o timeout
2021/06/05 12:05:12 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:05:13 [INFO] raft: aborting pipeline replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:05:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:15 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:60026->10.242.204.71:8301: i/o timeout
2021/06/05 12:05:15 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:05:16 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500784076s
2021/06/05 12:05:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:16 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 12:05:16 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:05:16 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical
2021/06/05 12:05:17 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:59642->10.242.204.71:8300: i/o timeout
2021/06/05 12:05:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:18 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.987759162s
2021/06/05 12:05:18 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:05:19 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1)
2021/06/05 12:05:19 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:05:19 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:05:19 [INFO] raft: pipelining replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:05:20 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:05:21 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:05:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:22 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500186491s
2021/06/05 12:05:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:25 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.959358036s
2021/06/05 12:05:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:27 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:36490->10.242.204.71:8302: i/o timeout
2021/06/05 12:05:27 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:05:27 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.379374798s
2021/06/05 12:05:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:30 [INFO] raft: aborting pipeline replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:05:30 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:05:30 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:60876->10.242.204.71:8300: i/o timeout
2021/06/05 12:05:31 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:05:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:32 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500228804s
2021/06/05 12:05:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:35 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.9538194s
2021/06/05 12:05:36 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:36632->10.242.204.71:8302: i/o timeout
2021/06/05 12:05:37 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:05:37 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.432512961s
2021/06/05 12:05:38 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:40 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:40 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:32820->10.242.204.71:8300: i/o timeout
2021/06/05 12:05:40 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:05:41 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 12:05:41 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.204.71:57592
2021/06/05 12:05:41 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:32842->10.242.204.71:8300: i/o timeout
2021/06/05 12:05:41 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:05:42 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:46 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:47 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:36802->10.242.204.71:8302: i/o timeout
2021/06/05 12:05:47 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:05:48 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:50 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:50 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:32980->10.242.204.71:8300: i/o timeout
2021/06/05 12:05:50 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:05:51 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:33024->10.242.204.71:8300: i/o timeout
2021/06/05 12:05:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:52 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:05:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:57 [INFO] memberlist: Marking dev-consul-server-1.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/05 12:05:57 [INFO] serf: EventMemberFailed: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 12:05:57 [INFO] consul: Handled member-failed event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 12:05:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:05:58 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 12:05:58 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF
2021/06/05 12:06:00 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:33136->10.242.204.71:8300: i/o timeout
2021/06/05 12:06:00 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:06:01 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:06:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:02 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:37034->10.242.204.71:8302: i/o timeout
2021/06/05 12:06:02 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:06:02 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:33188->10.242.204.71:8300: i/o timeout
2021/06/05 12:06:03 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:06:03 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.204.71:8301
2021/06/05 12:06:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:10 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:33298->10.242.204.71:8300: i/o timeout
2021/06/05 12:06:10 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:06:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:13 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:33346->10.242.204.71:8300: i/o timeout
2021/06/05 12:06:13 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:06:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:20 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:33464->10.242.204.71:8300: i/o timeout
2021/06/05 12:06:20 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:06:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:23 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:33516->10.242.204.71:8300: i/o timeout
2021/06/05 12:06:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:24 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:06:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:30 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:33706->10.242.204.71:8300: i/o timeout
2021/06/05 12:06:30 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:06:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:34 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:33790->10.242.204.71:8300: i/o timeout
2021/06/05 12:06:35 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:06:36 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:37 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 12:06:37 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 12:06:37 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 12:06:37 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:06:37 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/06/05 12:06:39 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:06:39 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/06/05 12:06:40 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:40 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:33862->10.242.204.71:8300: i/o timeout
2021/06/05 12:06:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:33324->10.242.204.71:8301: i/o timeout
2021/06/05 12:06:42 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:06:43 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:06:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:45 [WARN] memberlist: Was able to connect to dev-consul-server-1 but other probes failed, network may be misconfigured
2021/06/05 12:06:45 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 12:06:45 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 12:06:45 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:06:45 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical
2021/06/05 12:06:45 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:06:46 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:46 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:06:47 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:06:48 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:48 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:06:48 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:06:49 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:06:50 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:51 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:34044->10.242.204.71:8300: i/o timeout
2021/06/05 12:06:51 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500195367s
2021/06/05 12:06:51 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:06:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:52 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:37948->10.242.204.71:8302: i/o timeout
2021/06/05 12:06:52 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:06:53 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.905425989s
2021/06/05 12:06:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:06:55 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 12:06:55 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:06:55 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/06/05 12:06:56 [INFO] raft: pipelining replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:06:59 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:06:59 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/06/05 12:07:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:07:00 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:33634->10.242.204.71:8301: i/o timeout
2021/06/05 12:07:00 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:07:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:07:03 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500201969s
2021/06/05 12:07:03 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 12:07:03 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:07:03 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical
2021/06/05 12:07:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:07:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:33704->10.242.204.71:8301: i/o timeout
2021/06/05 12:07:04 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:07:05 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.958401613s
2021/06/05 12:07:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:07:07 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:38212->10.242.204.71:8302: i/o timeout
2021/06/05 12:07:07 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:07:08 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.456911756s
2021/06/05 12:07:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:07:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:07:11 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:33934->10.242.204.71:8300: i/o timeout
2021/06/05 12:07:11 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500192111s
2021/06/05 12:07:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:07:12 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:07:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:07:14 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.997841339s
2021/06/05 12:07:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:07:16 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.476646439s
2021/06/05 12:07:17 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:38400->10.242.204.71:8302: i/o timeout
2021/06/05 12:07:17 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:07:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:07:19 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500217368s
2021/06/05 12:07:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:07:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:07:22 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:34614->10.242.204.71:8300: i/o timeout
2021/06/05 12:07:22 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500238524s
2021/06/05 12:07:22 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:07:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:07:25 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.980360723s
2021/06/05 12:07:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:07:27 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:38594->10.242.204.71:8302: i/o timeout
2021/06/05 12:07:27 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:07:27 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.429009243s
2021/06/05 12:07:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:07:28 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 12:07:28 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:07:28 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/06/05 12:07:33 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:08:31 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:08:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:08:39 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:08:39 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/06/05 12:08:43 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:08:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:08:46 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:08:46 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:35492->10.242.204.71:8301: i/o timeout
2021/06/05 12:08:46 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:08:48 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:08:51 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:08:51 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:35570->10.242.204.71:8301: i/o timeout
2021/06/05 12:08:51 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:08:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:08:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:08:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:35604->10.242.204.71:8301: i/o timeout
2021/06/05 12:08:56 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:35654->10.242.204.71:8301: i/o timeout
2021/06/05 12:08:59 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:08:59 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:35694->10.242.204.71:8301: i/o timeout
2021/06/05 12:08:59 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:08:59 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.50024574s
2021/06/05 12:09:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:02 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.959888137s
2021/06/05 12:09:03 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:35748->10.242.204.71:8301: i/o timeout
2021/06/05 12:09:03 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:09:03 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 12:09:03 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 12:09:03 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:09:03 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical
2021/06/05 12:09:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:04 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.400822761s
2021/06/05 12:09:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:07 [INFO] raft: aborting pipeline replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:09:07 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:09:07 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:40274->10.242.204.71:8302: i/o timeout
2021/06/05 12:09:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:08 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:09:09 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500182542s
2021/06/05 12:09:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:12 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.981188156s
2021/06/05 12:09:13 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.204.71:8301
2021/06/05 12:09:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:14 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.476957154s
2021/06/05 12:09:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:16 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:09:17 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:36576->10.242.204.71:8300: i/o timeout
2021/06/05 12:09:17 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:09:17 [WARN] memberlist: Was able to connect to dev-consul-server-1.dc1 but other probes failed, network may be misconfigured
2021/06/05 12:09:17 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 12:09:17 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:09:17 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/06/05 12:09:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:19 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500144516s
2021/06/05 12:09:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:22 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.975984084s
2021/06/05 12:09:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:36180->10.242.204.71:8301: i/o timeout
2021/06/05 12:09:22 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:09:23 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 12:09:23 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 12:09:23 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:09:23 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical
2021/06/05 12:09:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:25 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:09:25 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:36186->10.242.204.71:8301: i/o timeout
2021/06/05 12:09:25 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:09:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:26 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:09:27 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:34806->10.242.204.71:8300: i/o timeout
2021/06/05 12:09:27 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:09:27 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:09:27 [INFO] raft: pipelining replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:09:27 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:09:29 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:09:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:31 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500192062s
2021/06/05 12:09:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:33 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.96755691s
2021/06/05 12:09:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:36 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:36 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.430746614s
2021/06/05 12:09:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:40862->10.242.204.71:8302: i/o timeout
2021/06/05 12:09:37 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:09:37 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:37012->10.242.204.71:8300: i/o timeout
2021/06/05 12:09:38 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:38 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:09:39 [ERR] raft: Failed to pipeline AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: write tcp 10.242.37.70:36844->10.242.204.71:8300: use of closed network connection
2021/06/05 12:09:39 [INFO] raft: aborting pipeline replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:09:39 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:09:40 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:41 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500374413s
2021/06/05 12:09:42 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:43 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.960663584s
2021/06/05 12:09:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:46 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:46 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.459393563s
2021/06/05 12:09:47 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:40950->10.242.204.71:8302: i/o timeout
2021/06/05 12:09:47 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:09:48 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:48 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:37178->10.242.204.71:8300: i/o timeout
2021/06/05 12:09:49 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:37190->10.242.204.71:8300: i/o timeout
2021/06/05 12:09:49 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:09:49 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:09:50 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:53 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.204.71:8301
2021/06/05 12:09:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:57 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:41200->10.242.204.71:8302: i/o timeout
2021/06/05 12:09:57 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:09:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:09:59 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:37348->10.242.204.71:8300: i/o timeout
2021/06/05 12:09:59 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:09:59 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:37360->10.242.204.71:8300: i/o timeout
2021/06/05 12:10:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:00 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:10:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:06 [INFO] memberlist: Marking dev-consul-server-1.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/05 12:10:06 [INFO] serf: EventMemberFailed: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 12:10:06 [INFO] consul: Handled member-failed event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 12:10:07 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:41344->10.242.204.71:8302: i/o timeout
2021/06/05 12:10:07 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:10:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:09 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:37514->10.242.204.71:8300: i/o timeout
2021/06/05 12:10:09 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:10:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:10 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:37534->10.242.204.71:8300: i/o timeout
2021/06/05 12:10:11 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:10:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:19 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:37670->10.242.204.71:8300: i/o timeout
2021/06/05 12:10:19 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:10:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:21 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:37716->10.242.204.71:8300: i/o timeout
2021/06/05 12:10:22 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:10:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:29 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:10:29 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:37818->10.242.204.71:8300: i/o timeout
2021/06/05 12:10:29 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:10:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:32 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:37882->10.242.204.71:8300: i/o timeout
2021/06/05 12:10:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:32 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 12:10:32 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:10:32 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/06/05 12:10:33 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 12:10:33 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 12:10:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:37292->10.242.204.71:8301: i/o timeout
2021/06/05 12:10:33 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:10:33 [INFO] raft: pipelining replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:10:37 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:10:38 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:37392->10.242.204.71:8301: i/o timeout
2021/06/05 12:10:39 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:10:40 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:41 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 12:10:41 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:10:41 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical
2021/06/05 12:10:42 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:37440->10.242.204.71:8301: i/o timeout
2021/06/05 12:10:42 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:10:42 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:10:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:44 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500319153s
2021/06/05 12:10:46 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:47 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.976654023s
2021/06/05 12:10:47 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:42002->10.242.204.71:8302: i/o timeout
2021/06/05 12:10:47 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:10:47 [INFO] raft: aborting pipeline replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:10:47 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:10:48 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:50 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:50 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500288252s
2021/06/05 12:10:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:52 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.9293388s
2021/06/05 12:10:52 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 12:10:52 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:10:52 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/06/05 12:10:53 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1)
2021/06/05 12:10:53 [INFO] raft: pipelining replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:10:55 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:10:55 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/06/05 12:10:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:56 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:37710->10.242.204.71:8301: i/o timeout
2021/06/05 12:10:56 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:10:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:10:59 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500161478s
2021/06/05 12:10:59 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:37728->10.242.204.71:8301: i/o timeout
2021/06/05 12:10:59 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:10:59 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 12:10:59 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 12:10:59 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:10:59 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical
2021/06/05 12:11:00 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:11:01 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:11:03 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:11:03 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500998201s
2021/06/05 12:11:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:11:05 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.975162144s
2021/06/05 12:11:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:11:06 [INFO] raft: aborting pipeline replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:11:06 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:11:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:11:09 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500166856s
2021/06/05 12:11:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:11:11 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.99639167s
2021/06/05 12:11:11 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:11:11 [INFO] raft: pipelining replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:11:12 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 12:11:12 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:11:12 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/06/05 12:11:13 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:11:13 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/06/05 12:11:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:11:17 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:11:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:11:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:38114->10.242.204.71:8301: i/o timeout
2021/06/05 12:11:19 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:11:19 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500182506s
2021/06/05 12:11:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:11:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:11:22 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.998343112s
2021/06/05 12:11:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:38188->10.242.204.71:8301: i/o timeout
2021/06/05 12:11:22 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:12:51 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:12:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:12:52 [WARN] memberlist: Was able to connect to dev-consul-server-1 but other probes failed, network may be misconfigured
2021/06/05 12:12:53 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:39888->10.242.204.71:8301: i/o timeout
2021/06/05 12:12:53 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:12:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:12:54 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500134826s
2021/06/05 12:12:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:12:57 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.975847607s
2021/06/05 12:12:57 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 12:12:57 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 12:12:57 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:12:57 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical
2021/06/05 12:12:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:12:58 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:39952->10.242.204.71:8301: i/o timeout
2021/06/05 12:12:58 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:12:59 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.43275227s
2021/06/05 12:13:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:13:01 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:13:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:13:02 [INFO] raft: aborting pipeline replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:13:02 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:13:03 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.204.71:8301
2021/06/05 12:13:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:13:04 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500231682s
2021/06/05 12:13:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:13:07 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.924236642s
2021/06/05 12:13:07 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:44550->10.242.204.71:8302: i/o timeout
2021/06/05 12:13:07 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:13:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:13:09 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.376312319s
2021/06/05 12:13:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:13:11 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:38036->10.242.204.71:8300: i/o timeout
2021/06/05 12:13:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:13:12 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:40770->10.242.204.71:8300: i/o timeout
2021/06/05 12:13:12 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:13:12 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:13:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:13:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:13:17 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:44634->10.242.204.71:8302: i/o timeout
2021/06/05 12:13:17 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:13:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:13:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:13:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:13:22 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:40940->10.242.204.71:8300: i/o timeout
2021/06/05 12:13:22 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:13:22 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:40942->10.242.204.71:8300: i/o timeout
2021/06/05 12:13:23 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:13:25 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:13:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:13:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:13:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:13:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:13:32 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1)
2021/06/05 12:13:32 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:41096->10.242.204.71:8300: i/o timeout
2021/06/05 12:13:32 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:13:32 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:44948->10.242.204.71:8302: i/o timeout
2021/06/05 12:13:32 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:13:33 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 12:13:33 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:13:33 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/06/05 12:13:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:13:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:40518->10.242.204.71:8301: i/o timeout
2021/06/05 12:13:36 [INFO] raft: pipelining replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:13:41 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:13:42 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:13:42 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500211959s
2021/06/05 12:13:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:40676->10.242.204.71:8301: i/o timeout
2021/06/05 12:13:42 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:13:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:13:45 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.982705584s
2021/06/05 12:13:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:40724->10.242.204.71:8301: i/o timeout
2021/06/05 12:13:45 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:13:45 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 12:13:45 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 12:13:45 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:13:45 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical
2021/06/05 12:13:46 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:13:46 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 12:13:46 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:13:46 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/06/05 12:13:47 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:13:47 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1)
2021/06/05 12:13:50 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500221884s
2021/06/05 12:13:51 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:13:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:13:52 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:40860->10.242.204.71:8301: i/o timeout
2021/06/05 12:13:52 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:13:53 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 12:13:53 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 12:13:53 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:13:53 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical
2021/06/05 12:13:54 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:13:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:13:54 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 12:13:54 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:13:54 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/06/05 12:13:55 [WARN] memberlist: Was able to connect to dev-consul-server-1 but other probes failed, network may be misconfigured
2021/06/05 12:13:57 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:14:01 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:14:01 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500162337s
2021/06/05 12:14:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:14:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:14:06 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:41092->10.242.204.71:8301: i/o timeout
2021/06/05 12:14:06 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:14:07 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:14:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:14:09 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 12:14:09 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:14:09 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical
2021/06/05 12:14:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:14:11 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500215975s
2021/06/05 12:14:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:14:13 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.955915496s
2021/06/05 12:14:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:14:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:14:16 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.439670249s
2021/06/05 12:14:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:14:18 [ERR] raft: Failed to pipeline AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: write tcp 10.242.37.70:41244->10.242.204.71:8300: use of closed network connection
2021/06/05 12:14:18 [INFO] raft: aborting pipeline replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:14:19 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:14:19 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:41110->10.242.204.71:8300: i/o timeout
2021/06/05 12:14:19 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:14:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:14:21 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500241888s
2021/06/05 12:14:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:14:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:45836->10.242.204.71:8302: i/o timeout
2021/06/05 12:14:22 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:14:23 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.98945532s
2021/06/05 12:14:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:14:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:14:26 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.450222304s
2021/06/05 12:14:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:14:29 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:42076->10.242.204.71:8300: i/o timeout
2021/06/05 12:14:29 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:14:29 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:42090->10.242.204.71:8300: i/o timeout
2021/06/05 12:14:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:14:30 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:14:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:14:32 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:46024->10.242.204.71:8302: i/o timeout
2021/06/05 12:14:32 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:14:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:14:36 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:14:38 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:14:39 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:42264->10.242.204.71:8300: i/o timeout
2021/06/05 12:14:39 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:14:40 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:14:40 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:42294->10.242.204.71:8300: i/o timeout
2021/06/05 12:14:41 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:14:41 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 12:14:41 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:14:41 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/06/05 12:14:41 [INFO] raft: pipelining replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:15:03 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:42130->10.242.204.71:8301: i/o timeout
2021/06/05 12:15:03 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:15:07 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:15:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:15:13 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:15:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:15:14 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500191727s
2021/06/05 12:15:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:15:16 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:42426->10.242.204.71:8301: i/o timeout
2021/06/05 12:15:16 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:15:16 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.998771379s
2021/06/05 12:15:17 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 12:15:17 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 12:15:17 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:15:17 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical
2021/06/05 12:15:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:15:18 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:42454->10.242.204.71:8301: i/o timeout
2021/06/05 12:15:18 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:15:19 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.435876851s
2021/06/05 12:15:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:15:22 [INFO] raft: aborting pipeline replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:15:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:15:22 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:15:22 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:42496->10.242.204.71:8300: i/o timeout
2021/06/05 12:15:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:46972->10.242.204.71:8302: i/o timeout
2021/06/05 12:15:22 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:15:23 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:15:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:15:24 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500206636s
2021/06/05 12:15:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:15:27 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.995139906s
2021/06/05 12:15:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:15:29 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.45033057s
2021/06/05 12:15:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:15:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:15:32 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:43282->10.242.204.71:8300: i/o timeout
2021/06/05 12:15:32 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:15:32 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:47138->10.242.204.71:8302: i/o timeout
2021/06/05 12:15:32 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:15:33 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:43288->10.242.204.71:8300: i/o timeout
2021/06/05 12:15:33 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:15:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:15:36 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:15:38 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:15:38 [ERR] memberlist: failed to receive: read tcp 10.242.37.70:8301->10.242.204.71:43352: i/o timeout from=10.242.204.71:43352
2021/06/05 12:15:38 [ERR] memberlist: Failed to send error: write tcp 10.242.37.70:8301->10.242.204.71:43352: i/o timeout from=10.242.204.71:43352
2021/06/05 12:15:40 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:15:42 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:15:42 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:43434->10.242.204.71:8300: i/o timeout
2021/06/05 12:15:42 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:15:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:47296->10.242.204.71:8302: i/o timeout
2021/06/05 12:15:42 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:15:43 [WARN] raft: Rejecting vote request from 10.242.204.71:8300 since we have a leader: 10.242.37.70:8300
2021/06/05 12:15:43 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.204.71:8301
2021/06/05 12:15:43 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:43458->10.242.204.71:8300: i/o timeout
2021/06/05 12:15:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:15:44 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:15:46 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:15:48 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:15:48 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 12:15:48 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:15:48 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/06/05 12:15:51 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:15:51 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/06/05 12:15:51 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/06/05 12:15:51 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:42978->10.242.204.71:8301: i/o timeout
2021/06/05 12:15:51 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:15:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:15:52 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:43602->10.242.204.71:8300: i/o timeout
2021/06/05 12:15:53 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 12:15:53 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:15:53 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical
2021/06/05 12:15:53 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 12:15:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:15:54 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:43648->10.242.204.71:8300: i/o timeout
2021/06/05 12:15:55 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:15:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:15:57 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:47450->10.242.204.71:8302: i/o timeout
2021/06/05 12:15:57 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:15:57 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1.dc1)
2021/06/05 12:15:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:16:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:16:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:16:02 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:43764->10.242.204.71:8300: i/o timeout
2021/06/05 12:16:02 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:16:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:16:04 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:16:06 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500640549s
2021/06/05 12:16:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:16:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:16:08 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.969953124s
2021/06/05 12:16:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:16:10 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.440043149s
2021/06/05 12:16:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:16:12 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:43904->10.242.204.71:8300: i/o timeout
2021/06/05 12:16:12 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:16:12 [WARN] memberlist: Was able to connect to dev-consul-server-1.dc1 but other probes failed, network may be misconfigured
2021/06/05 12:16:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:16:14 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:43810->10.242.204.71:8300: i/o timeout
2021/06/05 12:16:14 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 12:16:14 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:16:14 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/06/05 12:16:15 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:43360->10.242.204.71:8301: i/o timeout
2021/06/05 12:16:15 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:16:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:16:16 [WARN] raft: Rejecting vote request from 10.242.204.71:8300 since we have a leader: 10.242.37.70:8300
2021/06/05 12:16:16 [INFO] raft: pipelining replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:16:25 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:16:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:43730->10.242.204.71:8301: i/o timeout
2021/06/05 12:16:37 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:16:39 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:16:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:43758->10.242.204.71:8301: i/o timeout
2021/06/05 12:16:39 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:16:40 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:16:40 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500833031s
2021/06/05 12:16:41 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 12:16:41 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 12:16:41 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:16:41 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical
2021/06/05 12:16:42 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:16:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:43822->10.242.204.71:8301: i/o timeout
2021/06/05 12:16:42 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:16:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:48268->10.242.204.71:8302: i/o timeout
2021/06/05 12:16:42 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:16:42 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.992722316s
2021/06/05 12:16:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:16:45 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.47027423s
2021/06/05 12:16:46 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:16:47 [INFO] raft: aborting pipeline replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:16:48 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:16:48 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:16:48 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:44108->10.242.204.71:8300: i/o timeout
2021/06/05 12:16:49 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:16:50 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:16:50 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500357392s
2021/06/05 12:16:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:16:52 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:48422->10.242.204.71:8302: i/o timeout
2021/06/05 12:16:52 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:16:52 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.951830119s
2021/06/05 12:16:53 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.204.71:8301
2021/06/05 12:16:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:16:54 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 12:16:54 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.204.71:59782
2021/06/05 12:16:55 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.429284742s
2021/06/05 12:16:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:16:58 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:44648->10.242.204.71:8300: i/o timeout
2021/06/05 12:16:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:16:58 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:16:59 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:44678->10.242.204.71:8300: i/o timeout
2021/06/05 12:17:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:17:00 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:17:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:17:02 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:48518->10.242.204.71:8302: i/o timeout
2021/06/05 12:17:02 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:17:05 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:17:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:17:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:17:08 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:44810->10.242.204.71:8300: i/o timeout
2021/06/05 12:17:08 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:17:09 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 12:17:09 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:17:09 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/06/05 12:17:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:17:11 [INFO] memberlist: Marking dev-consul-server-1.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/05 12:17:11 [INFO] serf: EventMemberFailed: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 12:17:11 [INFO] consul: Handled member-failed event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 12:17:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:17:12 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 12:17:12 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1.dc1)
2021/06/05 12:17:12 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 12:17:12 [INFO] raft: pipelining replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:20:33 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:20:41 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:20:42 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:20:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:48120->10.242.204.71:8301: i/o timeout
2021/06/05 12:20:42 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:20:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:20:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:48138->10.242.204.71:8301: i/o timeout
2021/06/05 12:20:46 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 12:20:46 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 12:20:46 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:20:46 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical
2021/06/05 12:20:47 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:20:47 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:52650->10.242.204.71:8302: i/o timeout
2021/06/05 12:20:47 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:20:47 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.50023607s
2021/06/05 12:20:48 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:20:50 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:20:50 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.980135468s
2021/06/05 12:20:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:20:52 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.479906227s
2021/06/05 12:20:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:20:54 [INFO] raft: aborting pipeline replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:20:54 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:20:55 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:44854->10.242.204.71:8300: i/o timeout
2021/06/05 12:20:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:20:56 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:20:57 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500285413s
2021/06/05 12:20:57 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:52812->10.242.204.71:8302: i/o timeout
2021/06/05 12:20:57 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:20:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:20:59 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.911009271s
2021/06/05 12:21:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:02 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.35291924s
2021/06/05 12:21:02 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 12:21:02 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF
2021/06/05 12:21:03 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.204.71:8301
2021/06/05 12:21:04 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:49064->10.242.204.71:8300: i/o timeout
2021/06/05 12:21:04 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:21:05 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:21:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:06 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:49090->10.242.204.71:8300: i/o timeout
2021/06/05 12:21:06 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:21:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:12 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:53054->10.242.204.71:8302: i/o timeout
2021/06/05 12:21:12 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:21:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:14 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:49228->10.242.204.71:8300: i/o timeout
2021/06/05 12:21:14 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:21:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:16 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:49264->10.242.204.71:8300: i/o timeout
2021/06/05 12:21:17 [INFO] memberlist: Marking dev-consul-server-1.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/05 12:21:17 [INFO] serf: EventMemberFailed: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 12:21:17 [INFO] consul: Handled member-failed event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 12:21:17 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:21:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:53300->10.242.204.71:8302: i/o timeout
2021/06/05 12:21:22 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:21:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:24 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:49388->10.242.204.71:8300: i/o timeout
2021/06/05 12:21:24 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:21:25 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 12:21:25 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.204.71:40452
2021/06/05 12:21:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:27 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:49530->10.242.204.71:8300: i/o timeout
2021/06/05 12:21:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:28 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:21:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:34 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:49654->10.242.204.71:8300: i/o timeout
2021/06/05 12:21:34 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:21:36 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:38 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:38 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:49698->10.242.204.71:8300: i/o timeout
2021/06/05 12:21:39 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:21:40 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:42 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:43 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.204.71:8302
2021/06/05 12:21:43 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.204.71:8301
2021/06/05 12:21:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:44 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 12:21:44 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF
2021/06/05 12:21:44 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:49796->10.242.204.71:8300: i/o timeout
2021/06/05 12:21:44 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:21:47 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:21:48 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:49 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:49856->10.242.204.71:8300: i/o timeout
2021/06/05 12:21:50 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:50 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:21:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:54 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:49968->10.242.204.71:8300: i/o timeout
2021/06/05 12:21:55 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:21:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:21:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:22:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:22:00 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:50050->10.242.204.71:8300: i/o timeout
2021/06/05 12:22:01 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:22:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:22:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:22:05 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:50154->10.242.204.71:8300: i/o timeout
2021/06/05 12:22:05 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:22:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:22:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:22:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:22:11 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:50252->10.242.204.71:8300: i/o timeout
2021/06/05 12:22:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:22:12 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:22:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:22:15 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:50326->10.242.204.71:8300: i/o timeout
2021/06/05 12:22:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:22:16 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:22:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:22:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:22:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:22:22 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:50468->10.242.204.71:8300: i/o timeout
2021/06/05 12:22:23 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.204.71:8301
2021/06/05 12:22:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:22:24 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:22:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:22:26 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 12:22:26 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF
2021/06/05 12:22:26 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:50524->10.242.204.71:8300: i/o timeout
2021/06/05 12:22:27 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:22:29 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:22:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:22:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:22:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:22:34 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:50696->10.242.204.71:8300: i/o timeout
2021/06/05 12:22:36 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:22:37 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:50738->10.242.204.71:8300: i/o timeout
2021/06/05 12:22:38 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:22:38 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:22:39 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 12:22:39 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 12:22:39 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 12:22:39 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:22:39 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/06/05 12:22:40 [INFO] raft: pipelining replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:23:01 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:23:01 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/06/05 12:23:03 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:23:03 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:50634->10.242.204.71:8301: i/o timeout
2021/06/05 12:23:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:06 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500196623s
2021/06/05 12:23:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:08 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:50718->10.242.204.71:8301: i/o timeout
2021/06/05 12:23:08 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:23:09 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.5000896s
2021/06/05 12:23:09 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 12:23:09 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:23:09 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical
2021/06/05 12:23:11 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:23:11 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/06/05 12:23:11 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:50762->10.242.204.71:8301: i/o timeout
2021/06/05 12:23:11 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:23:11 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.951206943s
2021/06/05 12:23:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:14 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.358368669s
2021/06/05 12:23:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:16 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 12:23:16 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:23:16 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/06/05 12:23:16 [ERR] raft: Failed to pipeline AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: write tcp 10.242.37.70:50920->10.242.204.71:8300: use of closed network connection
2021/06/05 12:23:16 [INFO] raft: aborting pipeline replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:23:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:19 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500204788s
2021/06/05 12:23:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:50908->10.242.204.71:8301: i/o timeout
2021/06/05 12:23:19 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:23:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:21 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.966419379s
2021/06/05 12:23:21 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 12:23:21 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 12:23:21 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:23:21 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical
2021/06/05 12:23:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:50924->10.242.204.71:8301: i/o timeout
2021/06/05 12:23:22 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:23:24 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.383961113s
2021/06/05 12:23:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:26 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:50978->10.242.204.71:8300: i/o timeout
2021/06/05 12:23:26 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:23:26 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:51628->10.242.204.71:8300: i/o timeout
2021/06/05 12:23:27 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:23:27 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:55510->10.242.204.71:8302: i/o timeout
2021/06/05 12:23:27 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:23:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:36 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:36 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:51796->10.242.204.71:8300: i/o timeout
2021/06/05 12:23:36 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:23:37 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:51806->10.242.204.71:8300: i/o timeout
2021/06/05 12:23:38 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:38 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:23:38 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 12:23:38 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF
2021/06/05 12:23:41 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:23:42 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:55738->10.242.204.71:8302: i/o timeout
2021/06/05 12:23:42 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:23:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:46 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:46 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:51950->10.242.204.71:8300: i/o timeout
2021/06/05 12:23:46 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:23:48 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:48 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:51964->10.242.204.71:8300: i/o timeout
2021/06/05 12:23:48 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:23:50 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:52 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:55822->10.242.204.71:8302: i/o timeout
2021/06/05 12:23:52 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:23:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:56 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 12:23:56 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.204.71:44280
2021/06/05 12:23:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:56 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:52108->10.242.204.71:8300: i/o timeout
2021/06/05 12:23:56 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:23:57 [INFO] serf: EventMemberFailed: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 12:23:57 [INFO] consul: Handled member-failed event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 12:23:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:23:58 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:52136->10.242.204.71:8300: i/o timeout
2021/06/05 12:23:59 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:24:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:03 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.204.71:8301
2021/06/05 12:24:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:06 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:52266->10.242.204.71:8300: i/o timeout
2021/06/05 12:24:06 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:24:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:08 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 12:24:08 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:24:08 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/06/05 12:24:08 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1)
2021/06/05 12:24:09 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:52310->10.242.204.71:8300: i/o timeout
2021/06/05 12:24:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:11 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:51740->10.242.204.71:8301: i/o timeout
2021/06/05 12:24:11 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:24:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:13 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.204.71:8302
2021/06/05 12:24:13 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/06/05 12:24:13 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 12:24:13 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:24:13 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical
2021/06/05 12:24:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:16 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:52426->10.242.204.71:8300: i/o timeout
2021/06/05 12:24:17 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:24:17 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:24:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:18 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:24:20 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500369574s
2021/06/05 12:24:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:22 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.962505418s
2021/06/05 12:24:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:24 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.413433468s
2021/06/05 12:24:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:27 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:52476->10.242.204.71:8300: i/o timeout
2021/06/05 12:24:27 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 12:24:27 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:24:27 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive
2021/06/05 12:24:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:28 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:52104->10.242.204.71:8301: i/o timeout
2021/06/05 12:24:28 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:24:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:30 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500252976s
2021/06/05 12:24:31 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:52126->10.242.204.71:8301: i/o timeout
2021/06/05 12:24:31 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/06/05 12:24:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:32 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.942358723s
2021/06/05 12:24:32 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.204.71
2021/06/05 12:24:32 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:24:32 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical
2021/06/05 12:24:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:35 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.42228233s
2021/06/05 12:24:36 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:37 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:52846->10.242.204.71:8300: i/o timeout
2021/06/05 12:24:38 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:24:38 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:38 [ERR] memberlist: failed to receive: read tcp 10.242.37.70:8302->10.242.204.71:40982: i/o timeout from=10.242.204.71:40982
2021/06/05 12:24:38 [ERR] memberlist: Failed to send error: write tcp 10.242.37.70:8302->10.242.204.71:40982: i/o timeout from=10.242.204.71:40982
2021/06/05 12:24:38 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:52688->10.242.204.71:8300: i/o timeout
2021/06/05 12:24:39 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:24:40 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:42 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:46 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:48 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:53030->10.242.204.71:8300: i/o timeout
2021/06/05 12:24:48 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:49 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:24:49 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:53056->10.242.204.71:8300: i/o timeout
2021/06/05 12:24:50 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:50 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:24:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:24:59 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:53252->10.242.204.71:8300: i/o timeout
2021/06/05 12:25:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:00 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:53270->10.242.204.71:8300: i/o timeout
2021/06/05 12:25:01 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:25:01 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:25:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:07 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:25:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:09 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:25:09 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:25:09 [INFO] raft: pipelining replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:25:10 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:25:11 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:25:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:12 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500226181s
2021/06/05 12:25:13 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 12:25:13 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 12:25:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:14 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:25:15 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:25:15 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.7.75
2021/06/05 12:25:15 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan"
2021/06/05 12:25:15 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.7.75
2021/06/05 12:25:15 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/06/05 12:25:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:16 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:25:17 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500197466s
2021/06/05 12:25:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:20 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.96438404s
2021/06/05 12:25:21 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:25:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:22 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.460764786s
2021/06/05 12:25:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:25 [INFO] raft: aborting pipeline replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:25:25 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:25:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:26 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:53470->10.242.204.71:8300: i/o timeout
2021/06/05 12:25:26 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:25:27 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:57650->10.242.204.71:8302: i/o timeout
2021/06/05 12:25:27 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:25:27 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 2.500207301s
2021/06/05 12:25:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:30 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 4.997941146s
2021/06/05 12:25:31 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 12:25:31 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 12:25:31 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.204.71:45682
2021/06/05 12:25:31 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF
2021/06/05 12:25:32 [WARN] raft: Failed to contact 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 in 7.457877648s
2021/06/05 12:25:33 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:25:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:35 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:53912->10.242.204.71:8300: i/o timeout
2021/06/05 12:25:35 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:25:36 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:36 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:53936->10.242.204.71:8300: i/o timeout
2021/06/05 12:25:37 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:25:38 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:40 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:42 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:57908->10.242.204.71:8302: i/o timeout
2021/06/05 12:25:42 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:25:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:45 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:54078->10.242.204.71:8300: i/o timeout
2021/06/05 12:25:45 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:25:46 [ERR] memberlist: Push/Pull with dev-consul-server-1.dc1 failed: read tcp 10.242.37.70:57464->10.242.204.71:8302: i/o timeout
2021/06/05 12:25:46 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:47 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:54126->10.242.204.71:8300: i/o timeout
2021/06/05 12:25:48 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:48 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:25:50 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:55 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:54270->10.242.204.71:8300: i/o timeout
2021/06/05 12:25:55 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:25:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:56 [INFO] memberlist: Marking dev-consul-server-1.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/05 12:25:56 [INFO] serf: EventMemberFailed: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 12:25:56 [INFO] consul: Handled member-failed event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 12:25:57 [ERR] memberlist: Failed fallback ping: read tcp 10.242.37.70:58194->10.242.204.71:8302: i/o timeout
2021/06/05 12:25:57 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received
2021/06/05 12:25:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:25:58 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:54320->10.242.204.71:8300: i/o timeout
2021/06/05 12:25:59 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:26:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:05 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:54458->10.242.204.71:8300: i/o timeout
2021/06/05 12:26:05 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:26:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:09 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:54528->10.242.204.71:8300: i/o timeout
2021/06/05 12:26:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:10 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:26:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:12 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 12:26:12 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF
2021/06/05 12:26:15 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:26:15 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:54628->10.242.204.71:8300: i/o timeout
2021/06/05 12:26:15 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:26:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:20 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:54722->10.242.204.71:8300: i/o timeout
2021/06/05 12:26:21 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:26:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:25 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:54818->10.242.204.71:8300: i/o timeout
2021/06/05 12:26:25 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:26:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:31 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:54924->10.242.204.71:8300: i/o timeout
2021/06/05 12:26:32 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:26:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:35 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:55004->10.242.204.71:8300: i/o timeout
2021/06/05 12:26:36 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:36 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:26:38 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:40 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:42 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:55122->10.242.204.71:8300: i/o timeout
2021/06/05 12:26:42 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:43 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.204.71:8302
2021/06/05 12:26:43 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:26:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:46 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:46 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:55186->10.242.204.71:8300: i/o timeout
2021/06/05 12:26:46 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:26:48 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:50 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:53 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:55318->10.242.204.71:8300: i/o timeout
2021/06/05 12:26:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:26:54 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/05 12:26:54 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF
2021/06/05 12:26:55 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:26:56 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:55388->10.242.204.71:8300: i/o timeout
2021/06/05 12:26:57 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/06/05 12:26:57 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/06/05 12:26:57 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/06/05 12:26:58 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:26:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:27:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:27:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:27:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:27:05 [ERR] raft: Failed to heartbeat to 10.242.204.71:8300: read tcp 10.242.37.70:55544->10.242.204.71:8300: i/o timeout
2021/06/05 12:27:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:27:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:27:08 [ERR] raft: Failed to AppendEntries to {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}: read tcp 10.242.37.70:55582->10.242.204.71:8300: i/o timeout
2021/06/05 12:27:08 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:27:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding
2021/06/05 12:27:10 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1.dc1)
2021/06/05 12:27:10 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:27:10 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.204.71
2021/06/05 12:27:10 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/05 12:27:11 [WARN] Unable to get address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9, using fallback address 10.242.204.71:8300: Could not find address for server id 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9
2021/06/05 12:27:11 [INFO] raft: pipelining replication to peer {Voter 56de5cf5-271f-0e8e-fc20-cd7d40f1c7f9 10.242.204.71:8300}
2021/06/05 12:27:11 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.204.71
2021/06/05 12:27:11 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.204.71:8300) (DC: dc1)
2021/06/05 12:27:11 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive