By type
+ CONSUL_BIND= + [ -n ] + CONSUL_CLIENT= + [ -n ] + CONSUL_DATA_DIR=/consul/data + CONSUL_CONFIG_DIR=/consul/config + [ -n ] + [ a = - ] + [ agent = agent ] + shift + set -- consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui + [ consul = consul ] + stat -c %u /consul/data + id -u consul + [ 100 != 100 ] + stat -c %u /consul/config + id -u consul + [ 100 != 100 ] + [ ! -z ] + exec consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui bootstrap_expect > 0: expecting 3 servers ==> Starting Consul agent... ==> Consul agent running! Version: 'v1.0.6' Node ID: 'e514e13e-0e8a-3554-068d-531a24327398' Node name: 'dev-consul-server-1' Datacenter: 'dc1' (Segment: '
') Server: true (Bootstrap: false) Client Addr: [0.0.0.0] (HTTP: 8500, HTTPS: -1, DNS: 8600) Cluster Addr: 10.242.167.206 (LAN: 8301, WAN: 8302) Encrypt: Gossip: false, TLS-Outgoing: false, TLS-Incoming: false ==> Log data will now stream in as it occurs: 2021/05/24 10:41:28 [INFO] raft: Initial configuration (index=0): [] 2021/05/24 10:41:28 [INFO] raft: Node at 10.242.167.206:8300 [Follower] entering Follower state (Leader: "") 2021/05/24 10:41:28 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.167.206 2021/05/24 10:41:28 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.167.206 2021/05/24 10:41:28 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan" 2021/05/24 10:41:28 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.167.206:8300) (DC: dc1) 2021/05/24 10:41:28 [INFO] agent: Started DNS server 0.0.0.0:8600 (tcp) 2021/05/24 10:41:28 [INFO] agent: Started DNS server 0.0.0.0:8600 (udp) 2021/05/24 10:41:28 [INFO] agent: Started HTTP server on [::]:8500 (tcp) 2021/05/24 10:41:28 [INFO] agent: started state syncer 2021/05/24 10:41:28 [INFO] agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce os scaleway softlayer 2021/05/24 10:41:28 [INFO] agent: Joining LAN cluster... 2021/05/24 10:41:28 [INFO] agent: (LAN) joining: [dev-consul-server-0.consul-server dev-consul-server-1.consul-server dev-consul-server-2.consul-server] 2021/05/24 10:41:28 [WARN] memberlist: Failed to resolve dev-consul-server-0.consul-server: lookup dev-consul-server-0.consul-server on 10.96.0.10:53: no such host 2021/05/24 10:41:28 [WARN] memberlist: Failed to resolve dev-consul-server-1.consul-server: lookup dev-consul-server-1.consul-server on 10.96.0.10:53: no such host 2021/05/24 10:41:28 [WARN] memberlist: Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host 2021/05/24 10:41:28 [INFO] agent: (LAN) joined: 0 Err: 3 error(s) occurred: * Failed to resolve dev-consul-server-0.consul-server: lookup dev-consul-server-0.consul-server on 10.96.0.10:53: no such host * Failed to resolve dev-consul-server-1.consul-server: lookup dev-consul-server-1.consul-server on 10.96.0.10:53: no such host * Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host 2021/05/24 10:41:28 [WARN] agent: Join LAN failed: , retrying in 30s 2021/05/24 10:41:35 [ERR] agent: failed to sync remote state: No cluster leader 2021/05/24 10:41:37 [WARN] raft: no known peers, aborting election 2021/05/24 10:41:43 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.24.139 2021/05/24 10:41:43 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 10:41:43 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.24.139 2021/05/24 10:41:43 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan" ==> Failed to check for updates: Get https://checkpoint-api.hashicorp.com/v1/check/consul?arch=amd64&os=linux&signature=b95c3633-8b04-a7ac-e660-374377af51c8&version=1.0.6: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/05/24 10:41:52 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-zwnvv 10.242.167.200 2021/05/24 10:41:58 [INFO] agent: (LAN) joining: [dev-consul-server-0.consul-server dev-consul-server-1.consul-server dev-consul-server-2.consul-server] 2021/05/24 10:41:58 [WARN] memberlist: Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host 2021/05/24 10:41:58 [INFO] agent: (LAN) joined: 2 Err: 2021/05/24 10:41:58 [INFO] agent: Join LAN completed. Synced with 2 initial agents 2021/05/24 10:42:05 [ERR] agent: Coordinate update error: No cluster leader 2021/05/24 10:42:09 [ERR] agent: failed to sync remote state: No cluster leader 2021/05/24 10:42:30 [ERR] agent: Coordinate update error: No cluster leader 2021/05/24 10:42:35 [ERR] agent: failed to sync remote state: No cluster leader 2021/05/24 10:42:42 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.26.4 2021/05/24 10:42:42 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.26.4:8300) (DC: dc1) 2021/05/24 10:42:42 [INFO] consul: Existing Raft peers reported by dev-consul-server-0, disabling bootstrap mode 2021/05/24 10:42:42 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.26.4 2021/05/24 10:42:42 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan" 2021/05/24 10:42:44 [DEBUG] raft-net: 10.242.167.206:8300 accepted connection from: 10.242.24.139:34714 2021/05/24 10:42:44 [WARN] raft: Failed to get previous log: 1 log not found (last: 0) 2021/05/24 10:42:44 [INFO] consul: New leader elected: dev-consul-server-0 2021/05/24 10:42:45 [DEBUG] raft-net: 10.242.167.206:8300 accepted connection from: 10.242.24.139:34732 2021/05/24 10:42:47 [INFO] agent: Synced node info 2021/05/24 11:09:40 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:50384->10.242.24.139:8301: i/o timeout 2021/05/24 11:09:40 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:09:47 [WARN] memberlist: Was able to connect to dev-consul-server-0 but other probes failed, network may be misconfigured 2021/05/24 11:09:48 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:50516->10.242.24.139:8301: i/o timeout 2021/05/24 11:09:48 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:09:50 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations) 2021/05/24 11:09:50 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.24.139 2021/05/24 11:09:50 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:09:53 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:50406->10.242.24.139:8302: i/o timeout 2021/05/24 11:09:53 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:09:58 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.24.139 2021/05/24 11:09:58 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:10:00 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:50732->10.242.24.139:8301: i/o timeout 2021/05/24 11:10:00 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:10:01 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0) 2021/05/24 11:10:10 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:50870->10.242.24.139:8301: i/o timeout 2021/05/24 11:10:10 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:10:13 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:50886->10.242.24.139:8301: i/o timeout 2021/05/24 11:10:13 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:10:14 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.24.139 2021/05/24 11:10:14 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:10:15 [WARN] raft: Heartbeat timeout from "10.242.24.139:8300" reached, starting election 2021/05/24 11:10:15 [INFO] raft: Node at 10.242.167.206:8300 [Candidate] entering Candidate state in term 3 2021/05/24 11:10:15 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:10:16 [INFO] raft: Duplicate RequestVote for same term: 3 2021/05/24 11:10:16 [DEBUG] raft-net: 10.242.167.206:8300 accepted connection from: 10.242.26.4:45406 2021/05/24 11:10:18 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:50790->10.242.24.139:8302: i/o timeout 2021/05/24 11:10:18 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:10:21 [ERR] http: Request GET /v1/catalog/service/config_binding_service, error: No cluster leader from=10.242.26.6:52476 2021/05/24 11:10:22 [WARN] raft: Election timeout reached, restarting election 2021/05/24 11:10:22 [INFO] raft: Node at 10.242.167.206:8300 [Candidate] entering Candidate state in term 4 2021/05/24 11:10:22 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:10:23 [INFO] raft: Election won. Tally: 2 2021/05/24 11:10:23 [INFO] raft: Node at 10.242.167.206:8300 [Leader] entering Leader state 2021/05/24 11:10:23 [INFO] consul: cluster leadership acquired 2021/05/24 11:10:23 [INFO] consul: New leader elected: dev-consul-server-1 2021/05/24 11:10:23 [INFO] raft: Added peer 2064e5b4-3552-66e0-b810-8b53b6a67b93, starting replication 2021/05/24 11:10:23 [INFO] raft: Added peer e0f6e875-c5f9-02ca-bce6-61a8fa3d2e53, starting replication 2021/05/24 11:10:23 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:10:23 [INFO] raft: pipelining replication to peer {Voter e0f6e875-c5f9-02ca-bce6-61a8fa3d2e53 10.242.26.4:8300} 2021/05/24 11:10:23 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical 2021/05/24 11:10:23 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:10:23 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.24.139:34696 2021/05/24 11:10:23 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:10:25 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 2.503231218s 2021/05/24 11:10:25 [ERR] raft: Failed to make RequestVote RPC to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:46824->10.242.24.139:8300: i/o timeout 2021/05/24 11:10:26 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:10:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:10:28 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 4.952351495s 2021/05/24 11:10:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:10:30 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 7.399738007s 2021/05/24 11:10:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:10:31 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.24.139 2021/05/24 11:10:31 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:10:31 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive 2021/05/24 11:10:32 [ERR] raft: Failed to make RequestVote RPC to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:46966->10.242.24.139:8300: i/o timeout 2021/05/24 11:10:32 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:51246->10.242.24.139:8301: i/o timeout 2021/05/24 11:10:32 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:10:33 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:46968->10.242.24.139:8300: i/o timeout 2021/05/24 11:10:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:10:33 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:46984->10.242.24.139:8300: i/o timeout 2021/05/24 11:10:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:10:35 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:51342->10.242.24.139:8301: i/o timeout 2021/05/24 11:10:35 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:10:36 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations) 2021/05/24 11:10:36 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.24.139 2021/05/24 11:10:36 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:10:36 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical 2021/05/24 11:10:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:10:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:10:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:10:43 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:47122->10.242.24.139:8300: i/o timeout 2021/05/24 11:10:43 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:10:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:10:44 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:47194->10.242.24.139:8300: i/o timeout 2021/05/24 11:10:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:10:45 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:10:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:10:48 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:51322->10.242.24.139:8302: i/o timeout 2021/05/24 11:10:48 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:10:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:10:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:10:53 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:47312->10.242.24.139:8300: i/o timeout 2021/05/24 11:10:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:10:53 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:10:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:10:55 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:47346->10.242.24.139:8300: i/o timeout 2021/05/24 11:10:55 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:10:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:10:58 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:51500->10.242.24.139:8302: i/o timeout 2021/05/24 11:10:58 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:10:58 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:10:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:03 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:47500->10.242.24.139:8300: i/o timeout 2021/05/24 11:11:03 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:11:03 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:11:03 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:11:05 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:47536->10.242.24.139:8300: i/o timeout 2021/05/24 11:11:06 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:11:06 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:11:06 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:11:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:07 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations) 2021/05/24 11:11:07 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.24.139 2021/05/24 11:11:07 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan" 2021/05/24 11:11:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:13 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:47652->10.242.24.139:8300: i/o timeout 2021/05/24 11:11:13 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:11:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:16 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:47738->10.242.24.139:8300: i/o timeout 2021/05/24 11:11:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:17 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:11:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:23 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:47852->10.242.24.139:8300: i/o timeout 2021/05/24 11:11:23 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:11:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:27 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:47900->10.242.24.139:8300: i/o timeout 2021/05/24 11:11:28 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:11:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:33 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:48036->10.242.24.139:8300: i/o timeout 2021/05/24 11:11:33 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:11:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:38 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:48096->10.242.24.139:8300: i/o timeout 2021/05/24 11:11:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:39 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:11:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:43 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:48230->10.242.24.139:8300: i/o timeout 2021/05/24 11:11:44 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:11:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:45 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:11:45 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:11:48 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:11:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:49 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:48312->10.242.24.139:8300: i/o timeout 2021/05/24 11:11:50 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:11:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:54 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:48398->10.242.24.139:8300: i/o timeout 2021/05/24 11:11:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:55 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:11:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:11:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:00 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:48508->10.242.24.139:8300: i/o timeout 2021/05/24 11:12:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:02 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:12:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:05 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:48600->10.242.24.139:8300: i/o timeout 2021/05/24 11:12:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:08 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:12:08 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:12:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:12 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:48702->10.242.24.139:8300: i/o timeout 2021/05/24 11:12:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:16 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:12:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:18 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:48810->10.242.24.139:8300: i/o timeout 2021/05/24 11:12:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:23 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:12:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:26 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:48944->10.242.24.139:8300: i/o timeout 2021/05/24 11:12:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:27 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:12:27 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:12:30 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:12:30 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:12:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:31 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:12:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:33 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:49070->10.242.24.139:8300: i/o timeout 2021/05/24 11:12:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:35 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.24.139 2021/05/24 11:12:35 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:12:35 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive 2021/05/24 11:12:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:38 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:53468->10.242.24.139:8301: i/o timeout 2021/05/24 11:12:38 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:12:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:40 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.24.139 2021/05/24 11:12:40 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:12:40 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical 2021/05/24 11:12:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:41 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:49212->10.242.24.139:8300: i/o timeout 2021/05/24 11:12:41 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:53504->10.242.24.139:8301: i/o timeout 2021/05/24 11:12:41 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:12:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:43 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:12:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:52 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:12:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:53 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:49430->10.242.24.139:8300: i/o timeout 2021/05/24 11:12:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:12:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:13:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:13:02 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:49588->10.242.24.139:8300: i/o timeout 2021/05/24 11:13:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:13:03 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.24.139 2021/05/24 11:13:03 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan" 2021/05/24 11:13:03 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0.dc1) 2021/05/24 11:13:03 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-zwnvv 10.242.167.200 2021/05/24 11:13:03 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.24.139 2021/05/24 11:13:03 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:13:03 [INFO] consul: member 'dev-consul-7467bf7b46-zwnvv' failed, marking health critical 2021/05/24 11:13:03 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive 2021/05/24 11:13:03 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-zwnvv 10.242.167.200 2021/05/24 11:13:03 [INFO] consul: member 'dev-consul-7467bf7b46-zwnvv' joined, marking health alive 2021/05/24 11:13:05 [INFO] raft: pipelining replication to peer {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300} 2021/05/24 11:13:42 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:13:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:54566->10.242.24.139:8301: i/o timeout 2021/05/24 11:13:42 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:13:42 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 2.500220786s 2021/05/24 11:13:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:13:50 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:13:50 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:54728->10.242.24.139:8301: i/o timeout 2021/05/24 11:13:50 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:13:51 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 2.500289572s 2021/05/24 11:13:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:13:53 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:54576->10.242.24.139:8302: i/o timeout 2021/05/24 11:13:53 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:13:53 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:54760->10.242.24.139:8301: i/o timeout 2021/05/24 11:13:53 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:13:54 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 2.500302722s 2021/05/24 11:13:54 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.24.139 2021/05/24 11:13:54 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:13:54 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical 2021/05/24 11:13:58 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:13:58 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:13:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:13:59 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:14:00 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 2.504822598s 2021/05/24 11:14:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:03 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 4.916221557s 2021/05/24 11:14:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:05 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 7.376239063s 2021/05/24 11:14:06 [ERR] raft: Failed to pipeline AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: write tcp 10.242.167.206:49766->10.242.24.139:8300: use of closed network connection 2021/05/24 11:14:06 [INFO] raft: aborting pipeline replication to peer {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300} 2021/05/24 11:14:06 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:14:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:08 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:54838->10.242.24.139:8302: i/o timeout 2021/05/24 11:14:08 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:14:09 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 2.50134702s 2021/05/24 11:14:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:09 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:49956->10.242.24.139:8300: i/o timeout 2021/05/24 11:14:09 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:14:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:11 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 4.991163628s 2021/05/24 11:14:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:13 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:14:13 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:14:13 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:14:13 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.24.139:39012 2021/05/24 11:14:14 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 7.452475632s 2021/05/24 11:14:16 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:14:16 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:14:16 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:50878->10.242.24.139:8300: i/o timeout 2021/05/24 11:14:16 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:14:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:18 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:54980->10.242.24.139:8302: i/o timeout 2021/05/24 11:14:18 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:14:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:19 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:50928->10.242.24.139:8300: i/o timeout 2021/05/24 11:14:20 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:14:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:23 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations) 2021/05/24 11:14:23 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.24.139 2021/05/24 11:14:23 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan" 2021/05/24 11:14:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:26 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:51020->10.242.24.139:8300: i/o timeout 2021/05/24 11:14:26 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:14:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:30 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:51124->10.242.24.139:8300: i/o timeout 2021/05/24 11:14:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:31 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:14:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:36 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:51196->10.242.24.139:8300: i/o timeout 2021/05/24 11:14:36 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:14:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:41 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:51278->10.242.24.139:8300: i/o timeout 2021/05/24 11:14:42 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:14:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:43 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.24.139 2021/05/24 11:14:43 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan" 2021/05/24 11:14:43 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.24.139 2021/05/24 11:14:43 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:14:43 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive 2021/05/24 11:14:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:46 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:51384->10.242.24.139:8300: i/o timeout 2021/05/24 11:14:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:47 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:55670->10.242.24.139:8301: i/o timeout 2021/05/24 11:14:47 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:14:48 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 2.500251548s 2021/05/24 11:14:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:49 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.24.139 2021/05/24 11:14:49 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:14:49 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical 2021/05/24 11:14:50 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:14:50 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:14:50 [INFO] raft: pipelining replication to peer {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300} 2021/05/24 11:14:50 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.24.139 2021/05/24 11:14:50 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:14:50 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive 2021/05/24 11:14:51 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:55780->10.242.24.139:8301: i/o timeout 2021/05/24 11:14:51 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:14:52 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:14:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:53 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 2.500466082s 2021/05/24 11:14:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:55 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 4.971866362s 2021/05/24 11:14:55 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:55830->10.242.24.139:8301: i/o timeout 2021/05/24 11:14:55 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:14:55 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations) 2021/05/24 11:14:55 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.24.139 2021/05/24 11:14:55 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:14:55 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical 2021/05/24 11:14:57 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0) 2021/05/24 11:14:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:14:58 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:14:58 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.24.139 2021/05/24 11:14:58 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:14:58 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive 2021/05/24 11:14:59 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:55886->10.242.24.139:8301: i/o timeout 2021/05/24 11:14:59 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:15:00 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:15:00 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:15:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:09 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:56070->10.242.24.139:8301: i/o timeout 2021/05/24 11:15:09 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:15:10 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:15:10 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:15:10 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 2.506442837s 2021/05/24 11:15:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:13 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 4.977275885s 2021/05/24 11:15:13 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:55938->10.242.24.139:8302: i/o timeout 2021/05/24 11:15:13 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:15:13 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:56138->10.242.24.139:8301: i/o timeout 2021/05/24 11:15:13 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:15:13 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations) 2021/05/24 11:15:13 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.24.139 2021/05/24 11:15:13 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:15:13 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical 2021/05/24 11:15:14 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:15:15 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.24.139 2021/05/24 11:15:15 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:15:15 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive 2021/05/24 11:15:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:16 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:56176->10.242.24.139:8301: i/o timeout 2021/05/24 11:15:16 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:15:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:56202->10.242.24.139:8301: i/o timeout 2021/05/24 11:15:19 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:15:20 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:15:20 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:15:20 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.24.139 2021/05/24 11:15:20 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:15:20 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical 2021/05/24 11:15:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:21 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 2.501520549s 2021/05/24 11:15:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:23 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:56008->10.242.24.139:8302: i/o timeout 2021/05/24 11:15:24 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 4.937606957s 2021/05/24 11:15:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:26 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 7.378694129s 2021/05/24 11:15:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:28 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:51462->10.242.24.139:8300: i/o timeout 2021/05/24 11:15:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:29 [ERR] raft: Failed to pipeline AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: write tcp 10.242.167.206:51530->10.242.24.139:8300: use of closed network connection 2021/05/24 11:15:29 [INFO] raft: aborting pipeline replication to peer {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300} 2021/05/24 11:15:29 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:15:29 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:15:29 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:15:29 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:15:31 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 2.500504886s 2021/05/24 11:15:32 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:15:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:56264->10.242.24.139:8302: i/o timeout 2021/05/24 11:15:33 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:15:34 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 4.986214523s 2021/05/24 11:15:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:36 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 7.445509445s 2021/05/24 11:15:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:39 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:52264->10.242.24.139:8300: i/o timeout 2021/05/24 11:15:39 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:15:39 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:52278->10.242.24.139:8300: i/o timeout 2021/05/24 11:15:40 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:15:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:43 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations) 2021/05/24 11:15:43 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.24.139 2021/05/24 11:15:43 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan" 2021/05/24 11:15:43 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:56366->10.242.24.139:8302: i/o timeout 2021/05/24 11:15:43 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:15:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:49 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:52454->10.242.24.139:8300: i/o timeout 2021/05/24 11:15:49 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:15:50 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:52474->10.242.24.139:8300: i/o timeout 2021/05/24 11:15:51 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:15:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:54 [ERR] memberlist: failed to receive: read tcp 10.242.167.206:8301->10.242.24.139:35014: i/o timeout from=10.242.24.139:35014 2021/05/24 11:15:54 [ERR] memberlist: Failed to send error: write tcp 10.242.167.206:8301->10.242.24.139:35014: i/o timeout from=10.242.24.139:35014 2021/05/24 11:15:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:58 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0) 2021/05/24 11:15:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:15:59 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:52622->10.242.24.139:8300: i/o timeout 2021/05/24 11:15:59 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:16:01 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:52648->10.242.24.139:8300: i/o timeout 2021/05/24 11:16:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:01 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:16:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:09 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:52776->10.242.24.139:8300: i/o timeout 2021/05/24 11:16:09 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:16:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:11 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:16:11 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:16:11 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:52814->10.242.24.139:8300: i/o timeout 2021/05/24 11:16:12 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:16:14 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:16:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:19 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:52958->10.242.24.139:8300: i/o timeout 2021/05/24 11:16:19 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:16:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:22 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:53006->10.242.24.139:8300: i/o timeout 2021/05/24 11:16:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:23 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:16:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:28 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:16:28 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.24.139:40254 2021/05/24 11:16:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:29 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:53138->10.242.24.139:8300: i/o timeout 2021/05/24 11:16:29 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:16:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:33 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:53182->10.242.24.139:8300: i/o timeout 2021/05/24 11:16:34 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:16:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:39 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:53294->10.242.24.139:8300: i/o timeout 2021/05/24 11:16:40 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:16:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:44 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:53390->10.242.24.139:8300: i/o timeout 2021/05/24 11:16:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:45 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:16:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:48 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:16:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:50 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:53466->10.242.24.139:8300: i/o timeout 2021/05/24 11:16:50 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:16:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:53 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:16:53 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:16:55 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:53554->10.242.24.139:8300: i/o timeout 2021/05/24 11:16:56 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:16:56 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:16:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:16:57 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:16:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:00 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:53658->10.242.24.139:8300: i/o timeout 2021/05/24 11:17:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:01 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:17:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:07 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:53750->10.242.24.139:8300: i/o timeout 2021/05/24 11:17:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:11 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:17:11 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:53836->10.242.24.139:8300: i/o timeout 2021/05/24 11:17:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:14 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:17:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:21 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:53996->10.242.24.139:8300: i/o timeout 2021/05/24 11:17:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:24 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:54052->10.242.24.139:8300: i/o timeout 2021/05/24 11:17:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:27 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:17:28 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:17:28 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:17:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:29 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:17:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:35 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:17:35 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:17:37 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:54244->10.242.24.139:8300: i/o timeout 2021/05/24 11:17:38 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:17:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:39 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:54296->10.242.24.139:8300: i/o timeout 2021/05/24 11:17:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:48 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:17:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:49 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:17:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:58 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:54596->10.242.24.139:8300: i/o timeout 2021/05/24 11:17:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:17:59 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:54664->10.242.24.139:8300: i/o timeout 2021/05/24 11:18:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:08 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:18:08 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:18:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:10 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:18:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:17 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:18:17 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:18:18 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:54968->10.242.24.139:8300: i/o timeout 2021/05/24 11:18:20 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:18:20 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:54990->10.242.24.139:8300: i/o timeout 2021/05/24 11:18:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:28 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:18:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:29 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:18:30 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:18:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:39 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:55340->10.242.24.139:8300: i/o timeout 2021/05/24 11:18:40 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:55344->10.242.24.139:8300: i/o timeout 2021/05/24 11:18:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:50 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:18:50 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:18:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:18:59 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:18:59 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:19:00 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:55704->10.242.24.139:8300: i/o timeout 2021/05/24 11:19:00 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:55720->10.242.24.139:8300: i/o timeout 2021/05/24 11:19:02 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:19:02 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:19:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:10 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:19:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:11 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:19:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:20 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:56044->10.242.24.139:8300: i/o timeout 2021/05/24 11:19:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:21 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:56058->10.242.24.139:8300: i/o timeout 2021/05/24 11:19:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:28 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:19:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:31 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:19:32 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:19:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:41 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:19:41 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:19:41 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:56378->10.242.24.139:8300: i/o timeout 2021/05/24 11:19:42 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:56404->10.242.24.139:8300: i/o timeout 2021/05/24 11:19:44 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:19:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:51 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:19:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:53 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:19:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:19:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:01 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:56738->10.242.24.139:8300: i/o timeout 2021/05/24 11:20:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:03 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:56762->10.242.24.139:8300: i/o timeout 2021/05/24 11:20:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:11 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:20:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:14 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:20:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:18 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:20:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:21 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:57074->10.242.24.139:8300: i/o timeout 2021/05/24 11:20:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:23 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:20:23 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:20:24 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:57120->10.242.24.139:8300: i/o timeout 2021/05/24 11:20:26 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:20:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:28 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:20:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:31 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:20:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:36 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:20:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:41 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:57404->10.242.24.139:8300: i/o timeout 2021/05/24 11:20:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:46 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:57494->10.242.24.139:8300: i/o timeout 2021/05/24 11:20:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:52 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:20:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:56 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:20:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:20:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:02 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:57760->10.242.24.139:8300: i/o timeout 2021/05/24 11:21:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:05 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:21:05 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:21:06 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:57812->10.242.24.139:8300: i/o timeout 2021/05/24 11:21:08 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:21:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:12 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:21:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:17 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:21:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:22 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:58084->10.242.24.139:8300: i/o timeout 2021/05/24 11:21:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:27 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:58164->10.242.24.139:8300: i/o timeout 2021/05/24 11:21:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:32 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:21:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:38 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:21:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:42 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:58414->10.242.24.139:8300: i/o timeout 2021/05/24 11:21:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:47 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:21:47 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:21:48 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:58528->10.242.24.139:8300: i/o timeout 2021/05/24 11:21:50 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:21:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:52 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:21:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:58 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:21:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:21:59 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:22:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:02 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:58764->10.242.24.139:8300: i/o timeout 2021/05/24 11:22:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:09 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:58924->10.242.24.139:8300: i/o timeout 2021/05/24 11:22:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:12 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:22:13 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:22:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:20 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:22:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:23 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:59176->10.242.24.139:8300: i/o timeout 2021/05/24 11:22:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:29 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:22:29 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:22:30 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:59348->10.242.24.139:8300: i/o timeout 2021/05/24 11:22:32 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:22:32 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:22:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:33 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:22:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:40 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:22:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:41 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/05/24 11:22:41 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:22:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:43 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:59530->10.242.24.139:8300: i/o timeout 2021/05/24 11:22:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:51 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:59690->10.242.24.139:8300: i/o timeout 2021/05/24 11:22:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:53 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:22:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:22:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:02 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:23:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:03 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:59934->10.242.24.139:8300: i/o timeout 2021/05/24 11:23:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:11 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:23:11 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:23:12 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:60102->10.242.24.139:8300: i/o timeout 2021/05/24 11:23:13 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:23:14 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:23:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:23 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:23:23 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:60320->10.242.24.139:8300: i/o timeout 2021/05/24 11:23:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:28 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:23:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:33 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:60532->10.242.24.139:8300: i/o timeout 2021/05/24 11:23:34 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:23:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:44 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:60734->10.242.24.139:8300: i/o timeout 2021/05/24 11:23:44 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:23:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:52 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:23:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:53 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:23:53 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:23:54 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:23:54 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:60954->10.242.24.139:8300: i/o timeout 2021/05/24 11:23:56 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:23:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:23:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:00 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:24:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:02 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:24:02 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/24 11:24:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:04 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:32914->10.242.24.139:8300: i/o timeout 2021/05/24 11:24:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:05 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:24:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:12 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:24:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:13 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/05/24 11:24:14 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:24:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:15 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/05/24 11:24:15 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:33148->10.242.24.139:8300: i/o timeout 2021/05/24 11:24:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:24 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:33310->10.242.24.139:8300: i/o timeout 2021/05/24 11:24:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:26 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:24:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:28 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:24:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:32 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:24:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:34 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:24:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:35 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:24:35 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:24:36 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:33540->10.242.24.139:8300: i/o timeout 2021/05/24 11:24:38 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:24:38 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:24:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:44 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:33700->10.242.24.139:8300: i/o timeout 2021/05/24 11:24:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:47 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:24:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:55 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:24:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:24:57 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:33936->10.242.24.139:8300: i/o timeout 2021/05/24 11:24:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:05 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:34094->10.242.24.139:8300: i/o timeout 2021/05/24 11:25:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:08 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:25:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:15 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:25:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:17 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:25:17 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:25:18 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:34360->10.242.24.139:8300: i/o timeout 2021/05/24 11:25:20 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:25:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:24 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:25:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:25 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:34466->10.242.24.139:8300: i/o timeout 2021/05/24 11:25:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:29 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:25:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:35 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:25:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:39 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:34740->10.242.24.139:8300: i/o timeout 2021/05/24 11:25:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:44 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:25:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:45 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:34856->10.242.24.139:8300: i/o timeout 2021/05/24 11:25:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:50 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:25:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:55 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:25:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:58 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:25:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:25:59 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:25:59 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:26:00 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:35150->10.242.24.139:8300: i/o timeout 2021/05/24 11:26:02 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:26:02 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:26:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:05 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:35222->10.242.24.139:8300: i/o timeout 2021/05/24 11:26:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:11 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:26:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:16 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:26:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:21 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:35544->10.242.24.139:8300: i/o timeout 2021/05/24 11:26:22 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:26:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:24 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:26:25 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/05/24 11:26:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:26 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:35594->10.242.24.139:8300: i/o timeout 2021/05/24 11:26:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:29 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:26:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:32 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:26:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:36 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:26:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:41 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:26:41 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:26:42 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:35894->10.242.24.139:8300: i/o timeout 2021/05/24 11:26:44 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:26:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:46 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:35990->10.242.24.139:8300: i/o timeout 2021/05/24 11:26:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:53 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:26:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:56 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:26:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:26:58 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:26:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:03 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:36300->10.242.24.139:8300: i/o timeout 2021/05/24 11:27:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:06 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:36344->10.242.24.139:8300: i/o timeout 2021/05/24 11:27:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:14 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:27:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:16 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:27:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:23 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:27:23 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:27:24 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:36676->10.242.24.139:8300: i/o timeout 2021/05/24 11:27:26 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:27:26 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:36696->10.242.24.139:8300: i/o timeout 2021/05/24 11:27:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:35 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:27:37 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:27:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:39 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:27:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:45 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:37074->10.242.24.139:8300: i/o timeout 2021/05/24 11:27:47 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:37104->10.242.24.139:8300: i/o timeout 2021/05/24 11:27:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:55 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:27:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:27:57 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:27:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:05 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:28:05 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:28:05 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:37448->10.242.24.139:8300: i/o timeout 2021/05/24 11:28:07 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:37470->10.242.24.139:8300: i/o timeout 2021/05/24 11:28:08 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:28:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:17 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:28:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:17 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:28:19 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:28:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:27 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:37820->10.242.24.139:8300: i/o timeout 2021/05/24 11:28:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:27 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:37840->10.242.24.139:8300: i/o timeout 2021/05/24 11:28:28 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:28:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:37 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:28:38 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:28:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:47 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:28:47 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:28:47 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:38226->10.242.24.139:8300: i/o timeout 2021/05/24 11:28:48 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:38234->10.242.24.139:8300: i/o timeout 2021/05/24 11:28:50 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:28:50 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:28:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:28:57 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:28:59 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:28:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:07 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:38588->10.242.24.139:8300: i/o timeout 2021/05/24 11:29:09 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:38624->10.242.24.139:8300: i/o timeout 2021/05/24 11:29:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:18 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:29:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:20 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:29:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:28 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:38950->10.242.24.139:8300: i/o timeout 2021/05/24 11:29:28 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:29:29 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:29:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:29 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:29:29 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:29:30 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:39012->10.242.24.139:8300: i/o timeout 2021/05/24 11:29:32 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:29:32 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:29:32 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/24 11:29:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:38 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:29:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:41 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:29:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:48 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:39348->10.242.24.139:8300: i/o timeout 2021/05/24 11:29:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:51 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:39414->10.242.24.139:8300: i/o timeout 2021/05/24 11:29:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:29:58 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:29:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:02 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:30:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:08 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:39718->10.242.24.139:8300: i/o timeout 2021/05/24 11:30:09 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:30:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:11 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:30:11 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:30:12 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:39790->10.242.24.139:8300: i/o timeout 2021/05/24 11:30:14 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:30:14 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:30:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:18 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:30:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:20 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.24.139 2021/05/24 11:30:20 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan" 2021/05/24 11:30:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:23 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:30:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:28 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:40100->10.242.24.139:8300: i/o timeout 2021/05/24 11:30:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:33 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:40196->10.242.24.139:8300: i/o timeout 2021/05/24 11:30:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:44302->10.242.24.139:8302: i/o timeout 2021/05/24 11:30:33 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:30:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:39 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:30:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:43 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:44514->10.242.24.139:8302: i/o timeout 2021/05/24 11:30:43 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:30:44 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:30:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:49 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:40506->10.242.24.139:8300: i/o timeout 2021/05/24 11:30:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:53 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:30:53 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:30:54 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:40586->10.242.24.139:8300: i/o timeout 2021/05/24 11:30:56 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:30:56 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:30:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:58 [ERR] memberlist: Failed fallback ping: read tcp 10.242.167.206:44770->10.242.24.139:8302: i/o timeout 2021/05/24 11:30:58 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:30:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:30:59 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:31:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:02 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations) 2021/05/24 11:31:02 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.24.139 2021/05/24 11:31:02 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan" 2021/05/24 11:31:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:05 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:31:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:09 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:40880->10.242.24.139:8300: i/o timeout 2021/05/24 11:31:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:15 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:40986->10.242.24.139:8300: i/o timeout 2021/05/24 11:31:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:19 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:31:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:26 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:31:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:29 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:41270->10.242.24.139:8300: i/o timeout 2021/05/24 11:31:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:35 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:31:35 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:31:36 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:41374->10.242.24.139:8300: i/o timeout 2021/05/24 11:31:38 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:31:38 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:31:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:39 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:31:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:47 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:31:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:49 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:41650->10.242.24.139:8300: i/o timeout 2021/05/24 11:31:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:31:57 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:41762->10.242.24.139:8300: i/o timeout 2021/05/24 11:31:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:00 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:32:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:08 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:32:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:10 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:42034->10.242.24.139:8300: i/o timeout 2021/05/24 11:32:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:17 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:32:17 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:32:18 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:42194->10.242.24.139:8300: i/o timeout 2021/05/24 11:32:19 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:32:20 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:32:20 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:32:20 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:32:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:29 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:32:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:29 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:32:30 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:42418->10.242.24.139:8300: i/o timeout 2021/05/24 11:32:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:39 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:42590->10.242.24.139:8300: i/o timeout 2021/05/24 11:32:40 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:32:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:50 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:42800->10.242.24.139:8300: i/o timeout 2021/05/24 11:32:50 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:32:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:32:59 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:32:59 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:33:00 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:42990->10.242.24.139:8300: i/o timeout 2021/05/24 11:33:00 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:33:02 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:33:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:10 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:43178->10.242.24.139:8300: i/o timeout 2021/05/24 11:33:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:11 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:33:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:21 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:33:21 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:43394->10.242.24.139:8300: i/o timeout 2021/05/24 11:33:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:29 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:33:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:31 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:43574->10.242.24.139:8300: i/o timeout 2021/05/24 11:33:32 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:33:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:41 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:33:41 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:33:41 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:33:42 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:43772->10.242.24.139:8300: i/o timeout 2021/05/24 11:33:44 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:33:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:51 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:43948->10.242.24.139:8300: i/o timeout 2021/05/24 11:33:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:53 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:33:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:33:59 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:33:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:01 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:34:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:03 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:44176->10.242.24.139:8300: i/o timeout 2021/05/24 11:34:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:09 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:34:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:11 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:44318->10.242.24.139:8300: i/o timeout 2021/05/24 11:34:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:14 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:34:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:21 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:34:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:23 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:34:23 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:34:24 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:44574->10.242.24.139:8300: i/o timeout 2021/05/24 11:34:26 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:34:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:31 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:44730->10.242.24.139:8300: i/o timeout 2021/05/24 11:34:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:35 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:34:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:42 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:34:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:45 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:44970->10.242.24.139:8300: i/o timeout 2021/05/24 11:34:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:52 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:45102->10.242.24.139:8300: i/o timeout 2021/05/24 11:34:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:56 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:34:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:34:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:02 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:35:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:05 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:35:05 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:35:06 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:45348->10.242.24.139:8300: i/o timeout 2021/05/24 11:35:08 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:35:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:12 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:45466->10.242.24.139:8300: i/o timeout 2021/05/24 11:35:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:17 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:35:19 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:35:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:22 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:35:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:27 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:45740->10.242.24.139:8300: i/o timeout 2021/05/24 11:35:29 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:35:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:32 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:45860->10.242.24.139:8300: i/o timeout 2021/05/24 11:35:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:38 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:35:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:42 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:35:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:47 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:35:47 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:35:48 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:46154->10.242.24.139:8300: i/o timeout 2021/05/24 11:35:50 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:35:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:52 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:46236->10.242.24.139:8300: i/o timeout 2021/05/24 11:35:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:35:59 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:36:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:03 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:36:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:09 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:46558->10.242.24.139:8300: i/o timeout 2021/05/24 11:36:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:13 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:46596->10.242.24.139:8300: i/o timeout 2021/05/24 11:36:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:20 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:36:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:23 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:36:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:29 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:36:29 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:36:30 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:46952->10.242.24.139:8300: i/o timeout 2021/05/24 11:36:32 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:36:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:33 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:46986->10.242.24.139:8300: i/o timeout 2021/05/24 11:36:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:41 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:36:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:43 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:36:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:51 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:47356->10.242.24.139:8300: i/o timeout 2021/05/24 11:36:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:53 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:47390->10.242.24.139:8300: i/o timeout 2021/05/24 11:36:55 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:36:59 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:36:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:02 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:37:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:03 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:37:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:11 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:37:11 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:37:12 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:47742->10.242.24.139:8300: i/o timeout 2021/05/24 11:37:13 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:47750->10.242.24.139:8300: i/o timeout 2021/05/24 11:37:14 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:37:14 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:37:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:23 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:37:24 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:37:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:31 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:33 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:48140->10.242.24.139:8300: i/o timeout 2021/05/24 11:37:34 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:48148->10.242.24.139:8300: i/o timeout 2021/05/24 11:37:35 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:43 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:44 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:37:45 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:37:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:53 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:37:53 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: EOF 2021/05/24 11:37:54 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:48516->10.242.24.139:8300: i/o timeout 2021/05/24 11:37:55 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:48530->10.242.24.139:8300: i/o timeout 2021/05/24 11:37:56 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:37:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:37:59 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:37:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:38:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:38:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:38:04 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:38:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:38:06 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:38:07 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:38:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:38:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:38:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:38:14 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.167.206:48906->10.242.24.139:8300: i/o timeout 2021/05/24 11:38:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:38:16 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: read tcp 10.242.167.206:48942->10.242.24.139:8300: i/o timeout 2021/05/24 11:38:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:38:19 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:38:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:38:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:38:24 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.24.139 2021/05/24 11:38:24 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan" 2021/05/24 11:38:24 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0.dc1) 2021/05/24 11:38:24 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.24.139 2021/05/24 11:38:24 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:38:24 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive 2021/05/24 11:38:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:38:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:38:27 [WARN] raft: Rejecting vote request from 10.242.24.139:8300 since we have a leader: 10.242.167.206:8300 2021/05/24 11:38:27 [ERR] raft: peer {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300} has newer term, stopping replication 2021/05/24 11:38:27 [INFO] raft: Node at 10.242.167.206:8300 [Follower] entering Follower state (Leader: "") 2021/05/24 11:38:27 [INFO] raft: aborting pipeline replication to peer {Voter e0f6e875-c5f9-02ca-bce6-61a8fa3d2e53 10.242.26.4:8300} 2021/05/24 11:38:27 [INFO] consul: cluster leadership lost 2021/05/24 11:38:33 [WARN] raft: Rejecting vote request from 10.242.24.139:8300 since our last index is greater (671, 461) 2021/05/24 11:38:35 [WARN] raft: Heartbeat timeout from "" reached, starting election 2021/05/24 11:38:35 [INFO] raft: Node at 10.242.167.206:8300 [Candidate] entering Candidate state in term 7 2021/05/24 11:38:35 [INFO] raft: Election won. Tally: 2 2021/05/24 11:38:35 [INFO] raft: Node at 10.242.167.206:8300 [Leader] entering Leader state 2021/05/24 11:38:35 [INFO] raft: Added peer 2064e5b4-3552-66e0-b810-8b53b6a67b93, starting replication 2021/05/24 11:38:35 [INFO] raft: Added peer e0f6e875-c5f9-02ca-bce6-61a8fa3d2e53, starting replication 2021/05/24 11:38:35 [INFO] consul: cluster leadership acquired 2021/05/24 11:38:35 [INFO] consul: New leader elected: dev-consul-server-1 2021/05/24 11:38:35 [INFO] raft: pipelining replication to peer {Voter e0f6e875-c5f9-02ca-bce6-61a8fa3d2e53 10.242.26.4:8300} 2021/05/24 11:38:35 [WARN] raft: AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300} rejected, sending older logs (next: 462) 2021/05/24 11:38:36 [INFO] raft: pipelining replication to peer {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300} 2021/05/24 11:38:41 [INFO] raft: aborting pipeline replication to peer {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300} 2021/05/24 11:38:41 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: EOF 2021/05/24 11:38:41 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: dial tcp ->10.242.24.139:8300: getsockopt: connection refused 2021/05/24 11:38:41 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: dial tcp ->10.242.24.139:8300: getsockopt: connection refused 2021/05/24 11:38:41 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: dial tcp ->10.242.24.139:8300: getsockopt: connection refused 2021/05/24 11:38:41 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error making call: stream closed 2021/05/24 11:38:41 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: dial tcp ->10.242.24.139:8300: getsockopt: connection refused 2021/05/24 11:38:42 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: dial tcp ->10.242.24.139:8300: getsockopt: connection refused 2021/05/24 11:38:42 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: dial tcp ->10.242.24.139:8300: getsockopt: connection refused 2021/05/24 11:38:42 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: dial tcp ->10.242.24.139:8300: getsockopt: connection refused 2021/05/24 11:38:42 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: dial tcp ->10.242.24.139:8300: getsockopt: connection refused 2021/05/24 11:38:42 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: dial tcp ->10.242.24.139:8300: getsockopt: connection refused 2021/05/24 11:38:42 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:38:43 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: dial tcp ->10.242.24.139:8300: getsockopt: connection refused 2021/05/24 11:38:43 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 2.500276634s 2021/05/24 11:38:44 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:38:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:38:46 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 4.936775526s 2021/05/24 11:38:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:38:48 [WARN] raft: Failed to contact 2064e5b4-3552-66e0-b810-8b53b6a67b93 in 7.412871238s 2021/05/24 11:38:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:38:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:38:53 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:38:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:38:53 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error getting client: failed to get conn: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:38:54 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:38:54 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations) 2021/05/24 11:38:54 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.24.139 2021/05/24 11:38:54 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:38:54 [INFO] consul: member 'dev-consul-server-0' failed, marking health critical 2021/05/24 11:38:54 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:38:56 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:38:56 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:38:57 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:38:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:38:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:04 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:39:04 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:39:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:05 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error getting client: failed to get conn: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:39:07 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:39:08 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:39:08 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:39:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:12 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:39:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:14 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:39:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:15 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:39:17 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:17 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error getting client: failed to get conn: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:39:20 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:39:21 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:22 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:39:23 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:24 [ERR] memberlist: Conflicting address for dev-consul-server-0. Mine: 10.242.24.139:8301 Theirs: 10.242.24.185:8301 2021/05/24 11:39:24 [WARN] serf: Name conflict for 'dev-consul-server-0' both 10.242.24.139:8301 and 10.242.24.185:8301 are claiming 2021/05/24 11:39:24 [ERR] memberlist: Conflicting address for dev-consul-server-0.dc1. Mine: 10.242.24.139:8302 Theirs: 10.242.24.185:8302 2021/05/24 11:39:24 [WARN] serf: Name conflict for 'dev-consul-server-0.dc1' both 10.242.24.139:8302 and 10.242.24.185:8302 are claiming 2021/05/24 11:39:24 [ERR] memberlist: Conflicting address for dev-consul-server-0. Mine: 10.242.24.139:8301 Theirs: 10.242.24.185:8301 2021/05/24 11:39:24 [WARN] serf: Name conflict for 'dev-consul-server-0' both 10.242.24.139:8301 and 10.242.24.185:8301 are claiming 2021/05/24 11:39:24 [ERR] memberlist: Conflicting address for dev-consul-server-0. Mine: 10.242.24.139:8301 Theirs: 10.242.24.185:8301 2021/05/24 11:39:24 [WARN] serf: Name conflict for 'dev-consul-server-0' both 10.242.24.139:8301 and 10.242.24.185:8301 are claiming 2021/05/24 11:39:24 [ERR] memberlist: Conflicting address for dev-consul-server-0.dc1. Mine: 10.242.24.139:8302 Theirs: 10.242.24.185:8302 2021/05/24 11:39:24 [WARN] serf: Name conflict for 'dev-consul-server-0.dc1' both 10.242.24.139:8302 and 10.242.24.185:8302 are claiming 2021/05/24 11:39:24 [ERR] memberlist: Conflicting address for dev-consul-server-0.dc1. Mine: 10.242.24.139:8302 Theirs: 10.242.24.185:8302 2021/05/24 11:39:24 [WARN] serf: Name conflict for 'dev-consul-server-0.dc1' both 10.242.24.139:8302 and 10.242.24.185:8302 are claiming 2021/05/24 11:39:25 [ERR] memberlist: Conflicting address for dev-consul-server-0.dc1. Mine: 10.242.24.139:8302 Theirs: 10.242.24.185:8302 2021/05/24 11:39:25 [WARN] serf: Name conflict for 'dev-consul-server-0.dc1' both 10.242.24.139:8302 and 10.242.24.185:8302 are claiming 2021/05/24 11:39:25 [ERR] memberlist: Conflicting address for dev-consul-server-0.dc1. Mine: 10.242.24.139:8302 Theirs: 10.242.24.185:8302 2021/05/24 11:39:25 [WARN] serf: Name conflict for 'dev-consul-server-0.dc1' both 10.242.24.139:8302 and 10.242.24.185:8302 are claiming 2021/05/24 11:39:25 [ERR] memberlist: Conflicting address for dev-consul-server-0.dc1. Mine: 10.242.24.139:8302 Theirs: 10.242.24.185:8302 2021/05/24 11:39:25 [WARN] serf: Name conflict for 'dev-consul-server-0.dc1' both 10.242.24.139:8302 and 10.242.24.185:8302 are claiming 2021/05/24 11:39:25 [ERR] memberlist: Conflicting address for dev-consul-server-0.dc1. Mine: 10.242.24.139:8302 Theirs: 10.242.24.185:8302 2021/05/24 11:39:25 [WARN] serf: Name conflict for 'dev-consul-server-0.dc1' both 10.242.24.139:8302 and 10.242.24.185:8302 are claiming 2021/05/24 11:39:25 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:25 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:39:26 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:39:26 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:39:27 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:29 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:29 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error getting client: failed to get conn: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:39:32 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:39:32 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:39:32 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:39:33 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:36 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:36 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:39:37 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:37 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:39:39 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:41 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:41 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error getting client: failed to get conn: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:39:42 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:39:44 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:39:44 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:39:45 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations) 2021/05/24 11:39:45 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.24.139 2021/05/24 11:39:45 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan" 2021/05/24 11:39:45 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:47 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:47 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:39:49 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:39:49 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:51 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:52 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:39:53 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:53 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error getting client: failed to get conn: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:39:54 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:39:56 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:39:57 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:59 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:39:59 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:39:59 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:40:00 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:40:01 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:40:02 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:40:03 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:40:05 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:40:05 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error getting client: failed to get conn: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:40:08 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:40:09 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:40:09 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:40:10 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:40:11 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:40:13 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:40:13 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:40:14 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:40:15 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/05/24 11:40:16 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.24.185 2021/05/24 11:40:16 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.24.185:8300) (DC: dc1) 2021/05/24 11:40:16 [INFO] raft: Updating configuration with AddNonvoter (d21ab4bb-a7b8-a311-085e-8a4face926ef, 10.242.24.185:8300) to [{Suffrage:Voter ID:2064e5b4-3552-66e0-b810-8b53b6a67b93 Address:10.242.24.139:8300} {Suffrage:Voter ID:e514e13e-0e8a-3554-068d-531a24327398 Address:10.242.167.206:8300} {Suffrage:Voter ID:e0f6e875-c5f9-02ca-bce6-61a8fa3d2e53 Address:10.242.26.4:8300} {Suffrage:Nonvoter ID:d21ab4bb-a7b8-a311-085e-8a4face926ef Address:10.242.24.185:8300}] 2021/05/24 11:40:16 [INFO] raft: Added peer d21ab4bb-a7b8-a311-085e-8a4face926ef, starting replication 2021/05/24 11:40:16 [WARN] raft: AppendEntries to {Nonvoter d21ab4bb-a7b8-a311-085e-8a4face926ef 10.242.24.185:8300} rejected, sending older logs (next: 1) 2021/05/24 11:40:16 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive 2021/05/24 11:40:16 [INFO] raft: pipelining replication to peer {Nonvoter d21ab4bb-a7b8-a311-085e-8a4face926ef 10.242.24.185:8300} 2021/05/24 11:40:17 [WARN] consul: error getting server health from "dev-consul-server-0": rpc error getting client: failed to get conn: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:40:23 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:40:24 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:40:30 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:40:32 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:40:33 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:40:35 [INFO] autopilot: Promoting Server (ID: "d21ab4bb-a7b8-a311-085e-8a4face926ef" Address: "10.242.24.185:8300") to voter 2021/05/24 11:40:35 [INFO] raft: Updating configuration with AddStaging (d21ab4bb-a7b8-a311-085e-8a4face926ef, 10.242.24.185:8300) to [{Suffrage:Voter ID:2064e5b4-3552-66e0-b810-8b53b6a67b93 Address:10.242.24.139:8300} {Suffrage:Voter ID:e514e13e-0e8a-3554-068d-531a24327398 Address:10.242.167.206:8300} {Suffrage:Voter ID:e0f6e875-c5f9-02ca-bce6-61a8fa3d2e53 Address:10.242.26.4:8300} {Suffrage:Voter ID:d21ab4bb-a7b8-a311-085e-8a4face926ef Address:10.242.24.185:8300}] 2021/05/24 11:40:38 [INFO] autopilot: Attempting removal of stale Server (ID: "2064e5b4-3552-66e0-b810-8b53b6a67b93" Address: "10.242.24.139:8300") 2021/05/24 11:40:38 [INFO] raft: Updating configuration with RemoveServer (2064e5b4-3552-66e0-b810-8b53b6a67b93, ) to [{Suffrage:Voter ID:e514e13e-0e8a-3554-068d-531a24327398 Address:10.242.167.206:8300} {Suffrage:Voter ID:e0f6e875-c5f9-02ca-bce6-61a8fa3d2e53 Address:10.242.26.4:8300} {Suffrage:Voter ID:d21ab4bb-a7b8-a311-085e-8a4face926ef Address:10.242.24.185:8300}] 2021/05/24 11:40:38 [INFO] raft: Removed peer 2064e5b4-3552-66e0-b810-8b53b6a67b93, stopping replication after 702 2021/05/24 11:40:40 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:40:43 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:40:44 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:40:51 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:40:53 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:40:54 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:40:54 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:41:01 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:41:03 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:41:12 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:41:13 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:41:18 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:41:19 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/05/24 11:41:21 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/05/24 11:41:22 [ERR] raft: Failed to heartbeat to 10.242.24.139:8300: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:41:23 [ERR] raft: Failed to AppendEntries to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: dial tcp ->10.242.24.139:8300: i/o timeout 2021/05/24 11:41:26 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:41:34 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.24.185 2021/05/24 11:41:34 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan" 2021/05/24 11:41:34 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:41:35 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/05/24 11:41:37 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/05/24 11:41:39 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/05/24 11:42:04 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:42:04 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/24 11:42:04 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:42:10 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:42:11 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/05/24 11:44:32 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:44:33 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/05/24 11:44:35 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/05/24 11:44:38 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:44:38 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/24 11:44:50 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:46:04 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/24 11:46:04 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded