+ CONSUL_BIND= + [ -n ] + CONSUL_CLIENT= + [ -n ] + CONSUL_DATA_DIR=/consul/data + CONSUL_CONFIG_DIR=/consul/config + [ -n ] + [ a = - ] + [ agent = agent ] + shift + set -- consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui + [ consul = consul ] + stat -c %u /consul/data + id -u consul + [ 100 != 100 ] + stat -c %u /consul/config + id -u consul + [ 100 != 100 ] + [ ! -z ] + exec consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui bootstrap_expect > 0: expecting 3 servers ==> Starting Consul agent... ==> Consul agent running! Version: 'v1.0.6' Node ID: 'a8266095-5003-5418-e43d-1620a1a8ef39' Node name: 'dev-consul-server-0' Datacenter: 'dc1' (Segment: '') Server: true (Bootstrap: false) Client Addr: [0.0.0.0] (HTTP: 8500, HTTPS: -1, DNS: 8600) Cluster Addr: 10.242.134.70 (LAN: 8301, WAN: 8302) Encrypt: Gossip: false, TLS-Outgoing: false, TLS-Incoming: false ==> Log data will now stream in as it occurs: 2021/05/07 22:37:40 [INFO] raft: Initial configuration (index=0): [] 2021/05/07 22:37:40 [INFO] raft: Node at 10.242.134.70:8300 [Follower] entering Follower state (Leader: "") 2021/05/07 22:37:40 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.134.70 2021/05/07 22:37:40 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.134.70 2021/05/07 22:37:40 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan" 2021/05/07 22:37:40 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.134.70:8300) (DC: dc1) 2021/05/07 22:37:40 [INFO] agent: Started DNS server 0.0.0.0:8600 (udp) 2021/05/07 22:37:40 [INFO] agent: Started DNS server 0.0.0.0:8600 (tcp) 2021/05/07 22:37:40 [INFO] agent: Started HTTP server on [::]:8500 (tcp) 2021/05/07 22:37:40 [INFO] agent: started state syncer 2021/05/07 22:37:40 [INFO] agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce os scaleway softlayer 2021/05/07 22:37:40 [INFO] agent: Joining LAN cluster... 2021/05/07 22:37:40 [INFO] agent: (LAN) joining: [dev-consul-server-0.consul-server dev-consul-server-1.consul-server dev-consul-server-2.consul-server] 2021/05/07 22:37:40 [WARN] memberlist: Failed to resolve dev-consul-server-0.consul-server: lookup dev-consul-server-0.consul-server on 10.96.0.10:53: no such host 2021/05/07 22:37:41 [WARN] memberlist: Failed to resolve dev-consul-server-1.consul-server: lookup dev-consul-server-1.consul-server on 10.96.0.10:53: no such host 2021/05/07 22:37:41 [WARN] memberlist: Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host 2021/05/07 22:37:41 [INFO] agent: (LAN) joined: 0 Err: 3 error(s) occurred: * Failed to resolve dev-consul-server-0.consul-server: lookup dev-consul-server-0.consul-server on 10.96.0.10:53: no such host * Failed to resolve dev-consul-server-1.consul-server: lookup dev-consul-server-1.consul-server on 10.96.0.10:53: no such host * Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host 2021/05/07 22:37:41 [WARN] agent: Join LAN failed: , retrying in 30s 2021/05/07 22:37:47 [ERR] agent: failed to sync remote state: No cluster leader ==> Failed to check for updates: Get https://checkpoint-api.hashicorp.com/v1/check/consul?arch=amd64&os=linux&signature=d52c3448-65c2-999a-98a7-0291c9430aa9&version=1.0.6: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/05/07 22:37:49 [WARN] raft: no known peers, aborting election 2021/05/07 22:37:53 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.251.82 2021/05/07 22:37:53 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.251.82:8300) (DC: dc1) 2021/05/07 22:37:53 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.251.82 2021/05/07 22:37:53 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan" 2021/05/07 22:38:06 [ERR] agent: Coordinate update error: No cluster leader 2021/05/07 22:38:11 [INFO] agent: (LAN) joining: [dev-consul-server-0.consul-server dev-consul-server-1.consul-server dev-consul-server-2.consul-server] 2021/05/07 22:38:11 [WARN] memberlist: Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host 2021/05/07 22:38:11 [INFO] agent: (LAN) joined: 2 Err: 2021/05/07 22:38:11 [INFO] agent: Join LAN completed. Synced with 2 initial agents 2021/05/07 22:38:11 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-pgbp7 10.242.251.74 2021/05/07 22:38:15 [ERR] agent: failed to sync remote state: No cluster leader 2021/05/07 22:38:28 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.169.136 2021/05/07 22:38:28 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.169.136:8300) (DC: dc1) 2021/05/07 22:38:28 [INFO] consul: Found expected number of peers, attempting bootstrap: 10.242.134.70:8300,10.242.251.82:8300,10.242.169.136:8300 2021/05/07 22:38:28 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.169.136 2021/05/07 22:38:28 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan" 2021/05/07 22:38:28 [WARN] raft: Heartbeat timeout from "" reached, starting election 2021/05/07 22:38:28 [INFO] raft: Node at 10.242.134.70:8300 [Candidate] entering Candidate state in term 2 2021/05/07 22:38:28 [INFO] raft: Election won. Tally: 2 2021/05/07 22:38:28 [INFO] raft: Node at 10.242.134.70:8300 [Leader] entering Leader state 2021/05/07 22:38:28 [INFO] raft: Added peer 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, starting replication 2021/05/07 22:38:28 [INFO] raft: Added peer 4b16da66-7a8a-3eae-065c-181a00688338, starting replication 2021/05/07 22:38:28 [INFO] consul: cluster leadership acquired 2021/05/07 22:38:28 [INFO] consul: New leader elected: dev-consul-server-0 2021/05/07 22:38:28 [INFO] raft: pipelining replication to peer {Voter 4b16da66-7a8a-3eae-065c-181a00688338 10.242.169.136:8300} 2021/05/07 22:38:28 [WARN] raft: AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300} rejected, sending older logs (next: 1) 2021/05/07 22:38:28 [INFO] raft: pipelining replication to peer {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300} 2021/05/07 22:38:28 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive 2021/05/07 22:38:28 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive 2021/05/07 22:38:28 [INFO] consul: member 'dev-consul-7467bf7b46-pgbp7' joined, marking health alive 2021/05/07 22:38:28 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive 2021/05/07 22:38:30 [INFO] agent: Synced node info 2021/05/07 22:52:55 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 22:52:55 [WARN] raft: Failed to contact 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 in 2.500260911s 2021/05/07 22:52:57 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 22:52:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:52:59 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:44002->10.242.251.82:8301: i/o timeout 2021/05/07 22:52:59 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received 2021/05/07 22:52:59 [WARN] raft: Failed to contact 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 in 2.500267105s 2021/05/07 22:53:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:01 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:50222->10.242.251.74:8301: i/o timeout 2021/05/07 22:53:01 [INFO] memberlist: Suspect dev-consul-7467bf7b46-pgbp7 has failed, no acks received 2021/05/07 22:53:03 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:44018->10.242.251.82:8301: i/o timeout 2021/05/07 22:53:03 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received 2021/05/07 22:53:05 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 22:53:06 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:50240->10.242.251.74:8301: i/o timeout 2021/05/07 22:53:06 [INFO] memberlist: Suspect dev-consul-7467bf7b46-pgbp7 has failed, no acks received 2021/05/07 22:53:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:09 [WARN] raft: Failed to contact 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 in 2.500240141s 2021/05/07 22:53:10 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:44056->10.242.251.82:8301: i/o timeout 2021/05/07 22:53:10 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received 2021/05/07 22:53:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:10 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (1 peer confirmations) 2021/05/07 22:53:10 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.251.82 2021/05/07 22:53:10 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.251.82:8300) (DC: dc1) 2021/05/07 22:53:10 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical 2021/05/07 22:53:12 [WARN] raft: Failed to contact 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 in 4.998493483s 2021/05/07 22:53:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:50290->10.242.251.74:8301: i/o timeout 2021/05/07 22:53:14 [INFO] memberlist: Suspect dev-consul-7467bf7b46-pgbp7 has failed, no acks received 2021/05/07 22:53:14 [INFO] raft: aborting pipeline replication to peer {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300} 2021/05/07 22:53:14 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:53:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:15 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/07 22:53:15 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.251.74:46412 2021/05/07 22:53:15 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:52838->10.242.251.82:8302: i/o timeout 2021/05/07 22:53:15 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received 2021/05/07 22:53:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:17 [WARN] raft: Failed to contact 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 in 2.500399918s 2021/05/07 22:53:17 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:50330->10.242.251.74:8301: i/o timeout 2021/05/07 22:53:17 [INFO] memberlist: Suspect dev-consul-7467bf7b46-pgbp7 has failed, no acks received 2021/05/07 22:53:17 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:59818->10.242.251.82:8300: i/o timeout 2021/05/07 22:53:17 [INFO] memberlist: Marking dev-consul-7467bf7b46-pgbp7 as failed, suspect timeout reached (1 peer confirmations) 2021/05/07 22:53:17 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-pgbp7 10.242.251.74 2021/05/07 22:53:17 [INFO] consul: member 'dev-consul-7467bf7b46-pgbp7' failed, marking health critical 2021/05/07 22:53:18 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:53:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:19 [WARN] raft: Failed to contact 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 in 4.95922875s 2021/05/07 22:53:21 [WARN] raft: Failed to contact 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 in 7.440753978s 2021/05/07 22:53:23 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 22:53:24 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:36230->10.242.251.82:8300: i/o timeout 2021/05/07 22:53:24 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:53:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:25 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:52894->10.242.251.82:8302: i/o timeout 2021/05/07 22:53:25 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received 2021/05/07 22:53:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:28 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:36258->10.242.251.82:8300: i/o timeout 2021/05/07 22:53:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:29 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:53:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:34 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:36284->10.242.251.82:8300: i/o timeout 2021/05/07 22:53:34 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:53:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:35 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:52954->10.242.251.82:8302: i/o timeout 2021/05/07 22:53:35 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received 2021/05/07 22:53:36 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:37 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.251.82 2021/05/07 22:53:37 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.251.82:8300) (DC: dc1) 2021/05/07 22:53:37 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive 2021/05/07 22:53:38 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:39 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:36314->10.242.251.82:8300: i/o timeout 2021/05/07 22:53:40 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:44262->10.242.251.82:8301: i/o timeout 2021/05/07 22:53:40 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received 2021/05/07 22:53:40 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:44270->10.242.251.82:8301: i/o timeout 2021/05/07 22:53:42 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received 2021/05/07 22:53:42 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:43 [INFO] memberlist: Marking dev-consul-server-1.dc1 as failed, suspect timeout reached (0 peer confirmations) 2021/05/07 22:53:43 [INFO] serf: EventMemberFailed: dev-consul-server-1.dc1 10.242.251.82 2021/05/07 22:53:43 [INFO] consul: Handled member-failed event for server "dev-consul-server-1.dc1" in area "wan" 2021/05/07 22:53:44 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:44276->10.242.251.82:8301: i/o timeout 2021/05/07 22:53:44 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received 2021/05/07 22:53:44 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:36346->10.242.251.82:8300: i/o timeout 2021/05/07 22:53:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:53032->10.242.251.82:8302: i/o timeout 2021/05/07 22:53:45 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received 2021/05/07 22:53:46 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:44310->10.242.251.82:8301: i/o timeout 2021/05/07 22:53:46 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received 2021/05/07 22:53:46 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:48 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:44318->10.242.251.82:8301: i/o timeout 2021/05/07 22:53:48 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received 2021/05/07 22:53:48 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:49 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:36394->10.242.251.82:8300: i/o timeout 2021/05/07 22:53:50 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:50 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.251.82 2021/05/07 22:53:50 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.251.82:8300) (DC: dc1) 2021/05/07 22:53:50 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical 2021/05/07 22:53:51 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:44326->10.242.251.82:8301: i/o timeout 2021/05/07 22:53:51 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received 2021/05/07 22:53:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:54 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:36424->10.242.251.82:8300: i/o timeout 2021/05/07 22:53:54 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:53:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:53:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:00 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:36458->10.242.251.82:8300: i/o timeout 2021/05/07 22:54:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:01 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:54:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:04 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:36484->10.242.251.82:8300: i/o timeout 2021/05/07 22:54:04 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:54:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:10 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.251.82:8301 2021/05/07 22:54:10 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.251.82:8302 2021/05/07 22:54:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:11 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:36514->10.242.251.82:8300: i/o timeout 2021/05/07 22:54:12 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:54:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:14 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:36534->10.242.251.82:8300: i/o timeout 2021/05/07 22:54:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:14 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:54:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:17 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/07 22:54:17 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.251.82:40338 2021/05/07 22:54:18 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/07 22:54:18 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF 2021/05/07 22:54:19 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 22:54:19 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/07 22:54:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:22 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:36588->10.242.251.82:8300: i/o timeout 2021/05/07 22:54:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:23 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:54:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:24 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:36602->10.242.251.82:8300: i/o timeout 2021/05/07 22:54:25 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:54:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:33 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:36644->10.242.251.82:8300: i/o timeout 2021/05/07 22:54:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:34 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:54:35 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:36658->10.242.251.82:8300: i/o timeout 2021/05/07 22:54:35 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:54:36 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:38 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:40 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:42 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:44 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:36724->10.242.251.82:8300: i/o timeout 2021/05/07 22:54:45 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:36754->10.242.251.82:8300: i/o timeout 2021/05/07 22:54:46 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:46 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:54:47 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:54:48 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-pgbp7 10.242.251.74 2021/05/07 22:54:48 [INFO] consul: member 'dev-consul-7467bf7b46-pgbp7' joined, marking health alive 2021/05/07 22:54:48 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:49 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.251.82 2021/05/07 22:54:49 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.251.82:8300) (DC: dc1) 2021/05/07 22:54:49 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive 2021/05/07 22:54:50 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:50912->10.242.251.74:8301: i/o timeout 2021/05/07 22:54:50 [INFO] memberlist: Suspect dev-consul-7467bf7b46-pgbp7 has failed, no acks received 2021/05/07 22:54:50 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:53 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:44710->10.242.251.82:8301: i/o timeout 2021/05/07 22:54:53 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received 2021/05/07 22:54:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:55 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:50938->10.242.251.74:8301: i/o timeout 2021/05/07 22:54:55 [INFO] memberlist: Suspect dev-consul-7467bf7b46-pgbp7 has failed, no acks received 2021/05/07 22:54:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:56 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:36822->10.242.251.82:8300: i/o timeout 2021/05/07 22:54:57 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:36826->10.242.251.82:8300: i/o timeout 2021/05/07 22:54:57 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:44750->10.242.251.82:8301: i/o timeout 2021/05/07 22:54:57 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received 2021/05/07 22:54:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:54:58 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/07 22:54:58 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF 2021/05/07 22:54:59 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:50968->10.242.251.74:8301: i/o timeout 2021/05/07 22:54:59 [INFO] memberlist: Suspect dev-consul-7467bf7b46-pgbp7 has failed, no acks received 2021/05/07 22:55:01 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:51018->10.242.251.74:8301: i/o timeout 2021/05/07 22:55:01 [INFO] memberlist: Suspect dev-consul-7467bf7b46-pgbp7 has failed, no acks received 2021/05/07 22:55:01 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 22:55:01 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/07 22:55:01 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/07 22:55:01 [INFO] memberlist: Marking dev-consul-7467bf7b46-pgbp7 as failed, suspect timeout reached (1 peer confirmations) 2021/05/07 22:55:01 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-pgbp7 10.242.251.74 2021/05/07 22:55:01 [INFO] consul: member 'dev-consul-7467bf7b46-pgbp7' failed, marking health critical 2021/05/07 22:55:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:03 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:44816->10.242.251.82:8301: i/o timeout 2021/05/07 22:55:03 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received 2021/05/07 22:55:03 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (1 peer confirmations) 2021/05/07 22:55:03 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.251.82 2021/05/07 22:55:03 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.251.82:8300) (DC: dc1) 2021/05/07 22:55:03 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical 2021/05/07 22:55:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:05 [ERR] memberlist: Failed fallback ping: read tcp 10.242.134.70:44826->10.242.251.82:8301: i/o timeout 2021/05/07 22:55:05 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received 2021/05/07 22:55:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:09 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:36896->10.242.251.82:8300: i/o timeout 2021/05/07 22:55:09 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:36898->10.242.251.82:8300: i/o timeout 2021/05/07 22:55:10 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.251.82:8302 2021/05/07 22:55:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:14 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:55:15 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:55:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:20 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.251.82:8301 2021/05/07 22:55:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:24 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:37032->10.242.251.82:8300: i/o timeout 2021/05/07 22:55:25 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:37046->10.242.251.82:8300: i/o timeout 2021/05/07 22:55:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:35 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:55:36 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:55:36 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:38 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:40 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:40 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/07 22:55:40 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF 2021/05/07 22:55:43 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 22:55:43 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/07 22:55:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:45 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:37212->10.242.251.82:8300: i/o timeout 2021/05/07 22:55:46 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:37242->10.242.251.82:8300: i/o timeout 2021/05/07 22:55:46 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:48 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:50 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:55 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:55:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:55:57 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:55:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:00 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.251.82:8301 2021/05/07 22:56:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:05 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:37376->10.242.251.82:8300: i/o timeout 2021/05/07 22:56:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:07 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:37402->10.242.251.82:8300: i/o timeout 2021/05/07 22:56:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:15 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:56:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:18 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:56:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:22 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/07 22:56:22 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF 2021/05/07 22:56:25 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:37608->10.242.251.82:8300: i/o timeout 2021/05/07 22:56:25 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 22:56:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:28 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:37634->10.242.251.82:8300: i/o timeout 2021/05/07 22:56:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:35 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:56:36 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:38 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:39 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:56:40 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-pgbp7 10.242.251.74:8301 2021/05/07 22:56:40 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:42 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:45 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:37772->10.242.251.82:8300: i/o timeout 2021/05/07 22:56:46 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:48 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:49 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:37796->10.242.251.82:8300: i/o timeout 2021/05/07 22:56:50 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:56 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:56:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:56:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:00 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:57:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:04 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/07 22:57:04 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF 2021/05/07 22:57:06 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:37912->10.242.251.82:8300: i/o timeout 2021/05/07 22:57:07 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 22:57:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:10 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:37930->10.242.251.82:8300: i/o timeout 2021/05/07 22:57:10 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.251.82:8302 2021/05/07 22:57:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:16 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:57:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:20 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.251.82:8301 2021/05/07 22:57:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:21 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:57:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:26 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:38074->10.242.251.82:8300: i/o timeout 2021/05/07 22:57:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:31 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:38110->10.242.251.82:8300: i/o timeout 2021/05/07 22:57:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:36 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:57:36 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:38 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:40 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:42 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:57:42 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:46 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:38302->10.242.251.82:8300: i/o timeout 2021/05/07 22:57:46 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:46 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/07 22:57:46 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF 2021/05/07 22:57:49 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 22:57:49 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/07 22:57:50 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:52 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:38342->10.242.251.82:8300: i/o timeout 2021/05/07 22:57:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:57:56 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:57:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:00 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.251.82:8301 2021/05/07 22:58:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:03 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:58:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:06 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:38444->10.242.251.82:8300: i/o timeout 2021/05/07 22:58:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:13 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:38468->10.242.251.82:8300: i/o timeout 2021/05/07 22:58:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:17 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:58:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:24 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:58:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:27 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:38582->10.242.251.82:8300: i/o timeout 2021/05/07 22:58:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:28 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/07 22:58:28 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF 2021/05/07 22:58:31 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 22:58:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:34 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:38614->10.242.251.82:8300: i/o timeout 2021/05/07 22:58:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:36 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:37 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:58:38 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:40 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-pgbp7 10.242.251.74:8301 2021/05/07 22:58:40 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:42 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:45 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:58:46 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:47 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:38732->10.242.251.82:8300: i/o timeout 2021/05/07 22:58:48 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:50 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:55 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:38774->10.242.251.82:8300: i/o timeout 2021/05/07 22:58:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:58:57 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-87mjc 10.242.134.93 2021/05/07 22:58:57 [INFO] consul: member 'dev-consul-7467bf7b46-87mjc' joined, marking health alive 2021/05/07 22:58:57 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:58:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:06 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:59:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:07 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:38936->10.242.251.82:8300: i/o timeout 2021/05/07 22:59:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:10 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/07 22:59:10 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF 2021/05/07 22:59:13 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 22:59:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:16 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:39064->10.242.251.82:8300: i/o timeout 2021/05/07 22:59:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:17 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:59:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:27 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:59:27 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:39212->10.242.251.82:8300: i/o timeout 2021/05/07 22:59:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:32 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:34 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:36 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:37 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:39424->10.242.251.82:8300: i/o timeout 2021/05/07 22:59:38 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:59:38 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:40 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:42 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:44 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:46 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:48 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:39580->10.242.251.82:8300: i/o timeout 2021/05/07 22:59:48 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:59:48 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:50 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:52 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:52 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/07 22:59:52 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF 2021/05/07 22:59:55 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 22:59:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 22:59:58 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 22:59:58 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:39698->10.242.251.82:8300: i/o timeout 2021/05/07 22:59:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:00:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:00:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:00:04 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:00:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:00:08 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:39846->10.242.251.82:8300: i/o timeout 2021/05/07 23:00:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:00:09 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 23:00:10 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.251.82:8302 2021/05/07 23:00:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:00:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:00:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:00:16 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:00:18 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 23:00:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:00:19 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: read tcp 10.242.134.70:39986->10.242.251.82:8300: i/o timeout 2021/05/07 23:00:20 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.251.82:8301 2021/05/07 23:00:20 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:00:22 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:00:24 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:00:26 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:00:28 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: read tcp 10.242.134.70:40118->10.242.251.82:8300: i/o timeout 2021/05/07 23:00:28 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:00:30 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 23:00:30 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.251.82 2021/05/07 23:00:30 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan" 2021/05/07 23:00:30 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-pgbp7 10.242.251.74 2021/05/07 23:00:30 [INFO] consul: member 'dev-consul-7467bf7b46-pgbp7' joined, marking health alive 2021/05/07 23:00:30 [DEBUG] raft-net: 10.242.134.70:8300 accepted connection from: 10.242.251.82:54074 2021/05/07 23:00:30 [WARN] raft: Rejecting vote request from 10.242.251.82:8300 since we have a leader: 10.242.134.70:8300 2021/05/07 23:00:30 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:00:30 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.251.82 2021/05/07 23:00:30 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.251.82:8300) (DC: dc1) 2021/05/07 23:00:30 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive 2021/05/07 23:00:31 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-pgbp7 10.242.251.74 2021/05/07 23:00:31 [INFO] consul: member 'dev-consul-7467bf7b46-pgbp7' failed, marking health critical 2021/05/07 23:00:31 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-pgbp7 10.242.251.74 2021/05/07 23:00:31 [INFO] consul: member 'dev-consul-7467bf7b46-pgbp7' joined, marking health alive 2021/05/07 23:00:33 [INFO] serf: EventMemberLeave: dev-consul-7467bf7b46-pgbp7 10.242.251.74 2021/05/07 23:00:33 [INFO] consul: member 'dev-consul-7467bf7b46-pgbp7' left, deregistering 2021/05/07 23:00:34 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received 2021/05/07 23:00:34 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error making call: EOF 2021/05/07 23:00:35 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: EOF 2021/05/07 23:00:35 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 23:00:36 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: dial tcp ->10.242.251.82:8300: getsockopt: connection refused 2021/05/07 23:00:36 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error getting client: failed to get conn: dial tcp ->10.242.251.82:8300: getsockopt: connection refused 2021/05/07 23:00:37 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: dial tcp ->10.242.251.82:8300: getsockopt: connection refused 2021/05/07 23:00:37 [WARN] raft: Failed to contact 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 in 2.500998323s 2021/05/07 23:00:37 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 23:00:38 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: dial tcp ->10.242.251.82:8300: getsockopt: connection refused 2021/05/07 23:00:38 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations) 2021/05/07 23:00:38 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.251.82 2021/05/07 23:00:38 [INFO] consul: Removing LAN server dev-consul-server-1 (Addr: tcp/10.242.251.82:8300) (DC: dc1) 2021/05/07 23:00:38 [INFO] consul: member 'dev-consul-server-1' failed, marking health critical 2021/05/07 23:00:38 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error getting client: failed to get conn: dial tcp ->10.242.251.82:8300: getsockopt: connection refused 2021/05/07 23:00:38 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 23:00:38 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: dial tcp ->10.242.251.82:8300: getsockopt: connection refused 2021/05/07 23:00:39 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 23:00:39 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: dial tcp ->10.242.251.82:8300: getsockopt: connection refused 2021/05/07 23:00:39 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 23:00:39 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/07 23:00:39 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/07 23:00:39 [WARN] raft: Failed to contact 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 in 4.980900113s 2021/05/07 23:00:40 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 23:00:40 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: dial tcp ->10.242.251.82:8300: getsockopt: connection refused 2021/05/07 23:00:40 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error getting client: failed to get conn: dial tcp ->10.242.251.82:8300: getsockopt: connection refused 2021/05/07 23:00:41 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 23:00:41 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: dial tcp ->10.242.251.82:8300: getsockopt: connection refused 2021/05/07 23:00:41 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 23:00:42 [WARN] raft: Failed to contact 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 in 7.428991148s 2021/05/07 23:00:42 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 23:00:42 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: dial tcp ->10.242.251.82:8300: getsockopt: connection refused 2021/05/07 23:00:42 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error getting client: failed to get conn: dial tcp ->10.242.251.82:8300: getsockopt: connection refused 2021/05/07 23:00:43 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 23:00:43 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 23:00:43 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: dial tcp ->10.242.251.82:8300: getsockopt: connection refused 2021/05/07 23:00:44 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error getting client: failed to get conn: dial tcp ->10.242.251.82:8300: getsockopt: connection refused 2021/05/07 23:00:45 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received 2021/05/07 23:00:45 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 23:00:45 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: dial tcp ->10.242.251.82:8300: getsockopt: connection refused 2021/05/07 23:00:45 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 23:00:46 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error getting client: failed to get conn: dial tcp ->10.242.251.82:8300: getsockopt: connection refused 2021/05/07 23:00:47 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 23:00:48 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error getting client: failed to get conn: dial tcp ->10.242.251.82:8300: getsockopt: connection refused 2021/05/07 23:00:49 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 23:00:49 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: dial tcp ->10.242.251.82:8300: getsockopt: connection refused 2021/05/07 23:00:49 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 23:00:49 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: dial tcp ->10.242.251.82:8300: getsockopt: connection refused 2021/05/07 23:00:49 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 23:00:50 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error getting client: failed to get conn: dial tcp ->10.242.251.82:8300: getsockopt: connection refused 2021/05/07 23:00:51 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 23:00:53 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 23:00:53 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/07 23:00:53 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/05/07 23:00:54 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:00:55 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 23:00:56 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:00:58 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:00:59 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 23:01:00 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.251.82:8301 2021/05/07 23:01:00 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:01:02 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:01:02 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error getting client: failed to get conn: dial tcp ->10.242.251.82:8300: i/o timeout 2021/05/07 23:01:05 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: dial tcp ->10.242.251.82:8300: i/o timeout 2021/05/07 23:01:05 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 23:01:06 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:01:08 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:01:09 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: dial tcp ->10.242.251.82:8300: i/o timeout 2021/05/07 23:01:10 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:01:12 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:01:14 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:01:14 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error getting client: failed to get conn: dial tcp ->10.242.251.82:8300: i/o timeout 2021/05/07 23:01:15 [INFO] memberlist: Marking dev-consul-server-1.dc1 as failed, suspect timeout reached (0 peer confirmations) 2021/05/07 23:01:15 [INFO] serf: EventMemberFailed: dev-consul-server-1.dc1 10.242.251.82 2021/05/07 23:01:15 [INFO] consul: Handled member-failed event for server "dev-consul-server-1.dc1" in area "wan" 2021/05/07 23:01:15 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 23:01:17 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/05/07 23:01:17 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/05/07 23:01:18 [WARN] consul: error getting server health from "dev-consul-server-1": last request still outstanding 2021/05/07 23:01:19 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 23:01:20 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.251.121 2021/05/07 23:01:20 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.251.121:8300) (DC: dc1) 2021/05/07 23:01:20 [INFO] raft: Updating configuration with AddNonvoter (e3faf581-01ad-3eca-ee6f-3d9535fd9dfb, 10.242.251.121:8300) to [{Suffrage:Voter ID:a8266095-5003-5418-e43d-1620a1a8ef39 Address:10.242.134.70:8300} {Suffrage:Voter ID:6f0b80b1-5f91-f942-5166-a9e0e02f1b44 Address:10.242.251.82:8300} {Suffrage:Voter ID:4b16da66-7a8a-3eae-065c-181a00688338 Address:10.242.169.136:8300} {Suffrage:Nonvoter ID:e3faf581-01ad-3eca-ee6f-3d9535fd9dfb Address:10.242.251.121:8300}] 2021/05/07 23:01:20 [INFO] raft: Added peer e3faf581-01ad-3eca-ee6f-3d9535fd9dfb, starting replication 2021/05/07 23:01:20 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive 2021/05/07 23:01:20 [ERR] memberlist: Conflicting address for dev-consul-server-1.dc1. Mine: 10.242.251.82:8302 Theirs: 10.242.251.121:8302 2021/05/07 23:01:20 [WARN] serf: Name conflict for 'dev-consul-server-1.dc1' both 10.242.251.82:8302 and 10.242.251.121:8302 are claiming 2021/05/07 23:01:20 [WARN] raft: AppendEntries to {Nonvoter e3faf581-01ad-3eca-ee6f-3d9535fd9dfb 10.242.251.121:8300} rejected, sending older logs (next: 1) 2021/05/07 23:01:20 [INFO] raft: pipelining replication to peer {Nonvoter e3faf581-01ad-3eca-ee6f-3d9535fd9dfb 10.242.251.121:8300} 2021/05/07 23:01:20 [ERR] memberlist: Conflicting address for dev-consul-server-1.dc1. Mine: 10.242.251.82:8302 Theirs: 10.242.251.121:8302 2021/05/07 23:01:20 [WARN] serf: Name conflict for 'dev-consul-server-1.dc1' both 10.242.251.82:8302 and 10.242.251.121:8302 are claiming 2021/05/07 23:01:20 [ERR] memberlist: Conflicting address for dev-consul-server-1.dc1. Mine: 10.242.251.82:8302 Theirs: 10.242.251.121:8302 2021/05/07 23:01:20 [WARN] serf: Name conflict for 'dev-consul-server-1.dc1' both 10.242.251.82:8302 and 10.242.251.121:8302 are claiming 2021/05/07 23:01:21 [ERR] memberlist: Conflicting address for dev-consul-server-1.dc1. Mine: 10.242.251.82:8302 Theirs: 10.242.251.121:8302 2021/05/07 23:01:21 [WARN] serf: Name conflict for 'dev-consul-server-1.dc1' both 10.242.251.82:8302 and 10.242.251.121:8302 are claiming 2021/05/07 23:01:21 [ERR] memberlist: Conflicting address for dev-consul-server-1.dc1. Mine: 10.242.251.82:8302 Theirs: 10.242.251.121:8302 2021/05/07 23:01:21 [WARN] serf: Name conflict for 'dev-consul-server-1.dc1' both 10.242.251.82:8302 and 10.242.251.121:8302 are claiming 2021/05/07 23:01:25 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: dial tcp ->10.242.251.82:8300: i/o timeout 2021/05/07 23:01:26 [WARN] consul: error getting server health from "dev-consul-server-1": rpc error getting client: failed to get conn: dial tcp ->10.242.251.82:8300: i/o timeout 2021/05/07 23:01:29 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: dial tcp ->10.242.251.82:8300: i/o timeout 2021/05/07 23:01:30 [INFO] serf: attempting reconnect to dev-consul-server-1.dc1 10.242.251.82:8302 2021/05/07 23:01:33 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received 2021/05/07 23:01:36 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 23:01:38 [INFO] autopilot: Promoting Server (ID: "e3faf581-01ad-3eca-ee6f-3d9535fd9dfb" Address: "10.242.251.121:8300") to voter 2021/05/07 23:01:38 [INFO] raft: Updating configuration with AddStaging (e3faf581-01ad-3eca-ee6f-3d9535fd9dfb, 10.242.251.121:8300) to [{Suffrage:Voter ID:a8266095-5003-5418-e43d-1620a1a8ef39 Address:10.242.134.70:8300} {Suffrage:Voter ID:6f0b80b1-5f91-f942-5166-a9e0e02f1b44 Address:10.242.251.82:8300} {Suffrage:Voter ID:4b16da66-7a8a-3eae-065c-181a00688338 Address:10.242.169.136:8300} {Suffrage:Voter ID:e3faf581-01ad-3eca-ee6f-3d9535fd9dfb Address:10.242.251.121:8300}] 2021/05/07 23:01:38 [INFO] autopilot: Attempting removal of stale Server (ID: "6f0b80b1-5f91-f942-5166-a9e0e02f1b44" Address: "10.242.251.82:8300") 2021/05/07 23:01:38 [INFO] raft: Updating configuration with RemoveServer (6f0b80b1-5f91-f942-5166-a9e0e02f1b44, ) to [{Suffrage:Voter ID:a8266095-5003-5418-e43d-1620a1a8ef39 Address:10.242.134.70:8300} {Suffrage:Voter ID:4b16da66-7a8a-3eae-065c-181a00688338 Address:10.242.169.136:8300} {Suffrage:Voter ID:e3faf581-01ad-3eca-ee6f-3d9535fd9dfb Address:10.242.251.121:8300}] 2021/05/07 23:01:38 [INFO] raft: Removed peer 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, stopping replication after 423 2021/05/07 23:01:39 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 23:01:46 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: dial tcp ->10.242.251.82:8300: i/o timeout 2021/05/07 23:01:49 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: dial tcp ->10.242.251.82:8300: i/o timeout 2021/05/07 23:01:57 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 23:02:00 [WARN] Unable to get address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44, using fallback address 10.242.251.82:8300: Could not find address for server id 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 2021/05/07 23:02:07 [ERR] raft: Failed to heartbeat to 10.242.251.82:8300: dial tcp ->10.242.251.82:8300: i/o timeout 2021/05/07 23:02:10 [ERR] raft: Failed to AppendEntries to {Voter 6f0b80b1-5f91-f942-5166-a9e0e02f1b44 10.242.251.82:8300}: dial tcp ->10.242.251.82:8300: i/o timeout 2021/05/07 23:02:25 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.251.121 2021/05/07 23:02:25 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"