By type
+ CONSUL_BIND=
+ [ -n ]
+ CONSUL_CLIENT=
+ [ -n ]
+ CONSUL_DATA_DIR=/consul/data
+ CONSUL_CONFIG_DIR=/consul/config
+ [ -n ]
+ [ a = - ]
+ [ agent = agent ]
+ shift
+ set -- consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui
+ [ consul = consul ]
+ stat -c %u /consul/data
+ id -u consul
+ [ 100 != 100 ]
+ stat -c %u /consul/config
+ id -u consul
+ [ 100 != 100 ]
+ [ ! -z ]
+ exec consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui
bootstrap_expect > 0: expecting 3 servers
==> Starting Consul agent...
==> Consul agent running!
Version: 'v1.0.6'
Node ID: '0044e147-4efb-f870-c8eb-6a34a13674cf'
Node name: 'dev-consul-server-2'
Datacenter: 'dc1' (Segment: '')
Server: true (Bootstrap: false)
Client Addr: [0.0.0.0] (HTTP: 8500, HTTPS: -1, DNS: 8600)
Cluster Addr: 10.242.59.64 (LAN: 8301, WAN: 8302)
Encrypt: Gossip: false, TLS-Outgoing: false, TLS-Incoming: false
==> Log data will now stream in as it occurs:
2021/09/27 11:32:46 [INFO] raft: Initial configuration (index=0): []
2021/09/27 11:32:46 [INFO] raft: Node at 10.242.59.64:8300 [Follower] entering Follower state (Leader: "")
2021/09/27 11:32:46 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.59.64
2021/09/27 11:32:46 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.59.64
2021/09/27 11:32:46 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.59.64:8300) (DC: dc1)
2021/09/27 11:32:46 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/09/27 11:32:46 [INFO] agent: Started DNS server 0.0.0.0:8600 (tcp)
2021/09/27 11:32:46 [INFO] agent: Started DNS server 0.0.0.0:8600 (udp)
2021/09/27 11:32:46 [INFO] agent: Started HTTP server on [::]:8500 (tcp)
2021/09/27 11:32:46 [INFO] agent: started state syncer
2021/09/27 11:32:46 [INFO] agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce os scaleway softlayer
2021/09/27 11:32:46 [INFO] agent: Joining LAN cluster...
2021/09/27 11:32:46 [INFO] agent: (LAN) joining: [dev-consul-server-0.consul-server dev-consul-server-1.consul-server dev-consul-server-2.consul-server]
2021/09/27 11:32:46 [WARN] memberlist: Failed to resolve dev-consul-server-0.consul-server: lookup dev-consul-server-0.consul-server on 10.96.0.10:53: no such host
2021/09/27 11:32:46 [WARN] memberlist: Failed to resolve dev-consul-server-1.consul-server: lookup dev-consul-server-1.consul-server on 10.96.0.10:53: no such host
2021/09/27 11:32:46 [WARN] memberlist: Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host
2021/09/27 11:32:46 [INFO] agent: (LAN) joined: 0 Err: 3 error(s) occurred:
* Failed to resolve dev-consul-server-0.consul-server: lookup dev-consul-server-0.consul-server on 10.96.0.10:53: no such host
* Failed to resolve dev-consul-server-1.consul-server: lookup dev-consul-server-1.consul-server on 10.96.0.10:53: no such host
* Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host
2021/09/27 11:32:46 [WARN] agent: Join LAN failed: , retrying in 30s
==> Failed to check for updates: Get https://checkpoint-api.hashicorp.com/v1/check/consul?arch=amd64&os=linux&signature=97ed12c7-a987-f7fd-ccf5-aaee93950b5b&version=1.0.6: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/09/27 11:32:52 [WARN] raft: no known peers, aborting election
2021/09/27 11:32:54 [ERR] agent: failed to sync remote state: No cluster leader
2021/09/27 11:33:03 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.28.11
2021/09/27 11:33:03 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:33:03 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.225.64
2021/09/27 11:33:03 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 11:33:03 [INFO] consul: Existing Raft peers reported by dev-consul-server-1, disabling bootstrap mode
2021/09/27 11:33:03 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.225.64:8300) (DC: dc1)
2021/09/27 11:33:03 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.28.11
2021/09/27 11:33:03 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.225.64
2021/09/27 11:33:03 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/09/27 11:33:03 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/09/27 11:33:03 [DEBUG] raft-net: 10.242.59.64:8300 accepted connection from: 10.242.225.64:40310
2021/09/27 11:33:03 [WARN] raft: Failed to get previous log: 1 log not found (last: 0)
2021/09/27 11:33:04 [INFO] consul: New leader elected: dev-consul-server-1
2021/09/27 11:33:04 [DEBUG] raft-net: 10.242.59.64:8300 accepted connection from: 10.242.225.64:40314
2021/09/27 11:33:06 [INFO] agent: Synced node info
2021/09/27 11:33:16 [INFO] agent: (LAN) joining: [dev-consul-server-0.consul-server dev-consul-server-1.consul-server dev-consul-server-2.consul-server]
2021/09/27 11:33:17 [INFO] agent: (LAN) joined: 3 Err:
2021/09/27 11:33:17 [INFO] agent: Join LAN completed. Synced with 3 initial agents
2021/09/27 11:43:51 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:50996->10.242.28.28:8301: i/o timeout
2021/09/27 11:43:51 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:43:54 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 11:43:54 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:43:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:50998->10.242.28.28:8301: i/o timeout
2021/09/27 11:43:54 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:43:58 [WARN] memberlist: Was able to connect to dev-consul-server-0 but other probes failed, network may be misconfigured
2021/09/27 11:44:02 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:44:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:46136->10.242.28.11:8301: i/o timeout
2021/09/27 11:44:24 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:44:28 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51088->10.242.28.28:8301: i/o timeout
2021/09/27 11:44:28 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:44:32 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51100->10.242.28.28:8301: i/o timeout
2021/09/27 11:44:32 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:44:33 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 11:44:33 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:44:34 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:45:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51224->10.242.28.28:8301: i/o timeout
2021/09/27 11:45:22 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:45:26 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:46304->10.242.28.11:8301: i/o timeout
2021/09/27 11:45:26 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:46:32 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51478->10.242.28.28:8301: i/o timeout
2021/09/27 11:46:32 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:46:35 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51502->10.242.28.28:8301: i/o timeout
2021/09/27 11:46:35 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:46:38 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:46568->10.242.28.11:8301: i/o timeout
2021/09/27 11:46:38 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:46:41 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 11:46:41 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.28.11
2021/09/27 11:46:41 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 11:46:41 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:46576->10.242.28.11:8301: i/o timeout
2021/09/27 11:46:41 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:46:42 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.28.11
2021/09/27 11:46:42 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 11:46:44 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0)
2021/09/27 11:47:52 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51758->10.242.28.28:8301: i/o timeout
2021/09/27 11:47:52 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:47:55 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:46820->10.242.28.11:8301: i/o timeout
2021/09/27 11:47:55 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:47:57 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51772->10.242.28.28:8301: i/o timeout
2021/09/27 11:47:57 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:47:58 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:47:59 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:48:31 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:46930->10.242.28.11:8301: i/o timeout
2021/09/27 11:48:31 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:48:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51876->10.242.28.28:8301: i/o timeout
2021/09/27 11:48:34 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:48:36 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:35502->10.242.28.11:8302: i/o timeout
2021/09/27 11:48:36 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 11:48:37 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 11:48:37 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:48:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51898->10.242.28.28:8301: i/o timeout
2021/09/27 11:48:37 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:48:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:46988->10.242.28.11:8301: i/o timeout
2021/09/27 11:48:45 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:48:46 [INFO] serf: attempting reconnect to dev-consul-68b98449d-z4w69 10.242.28.28:8301
2021/09/27 11:48:52 [ERR] yamux: keepalive failed: i/o deadline reached
2021/09/27 11:48:52 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.28.28:53086
2021/09/27 11:48:54 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:49:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:52040->10.242.28.28:8301: i/o timeout
2021/09/27 11:49:19 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:49:21 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 11:49:21 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:49:22 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:49:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:52080->10.242.28.28:8301: i/o timeout
2021/09/27 11:49:33 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:50:07 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:52186->10.242.28.28:8301: i/o timeout
2021/09/27 11:50:07 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:50:10 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:52200->10.242.28.28:8301: i/o timeout
2021/09/27 11:50:10 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:50:16 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:52216->10.242.28.28:8301: i/o timeout
2021/09/27 11:50:16 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:50:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:52264->10.242.28.28:8301: i/o timeout
2021/09/27 11:50:33 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:50:36 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:47332->10.242.28.11:8301: i/o timeout
2021/09/27 11:50:36 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:50:37 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 11:50:37 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:50:38 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:52286->10.242.28.28:8301: i/o timeout
2021/09/27 11:50:38 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:50:40 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:47352->10.242.28.11:8301: i/o timeout
2021/09/27 11:50:40 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:50:41 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:35908->10.242.28.11:8302: i/o timeout
2021/09/27 11:50:41 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 11:50:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:47356->10.242.28.11:8301: i/o timeout
2021/09/27 11:50:42 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:50:44 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:47362->10.242.28.11:8301: i/o timeout
2021/09/27 11:50:44 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:50:47 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:47378->10.242.28.11:8301: i/o timeout
2021/09/27 11:50:47 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:50:49 [WARN] memberlist: Was able to connect to dev-consul-server-0 but other probes failed, network may be misconfigured
2021/09/27 11:50:53 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:51:15 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:52410->10.242.28.28:8301: i/o timeout
2021/09/27 11:51:15 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:51:29 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:52462->10.242.28.28:8301: i/o timeout
2021/09/27 11:51:29 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:51:32 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:52472->10.242.28.28:8301: i/o timeout
2021/09/27 11:51:32 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:51:33 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 11:51:33 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:51:48 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:52:28 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:52642->10.242.28.28:8301: i/o timeout
2021/09/27 11:52:28 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:53:02 [WARN] memberlist: Refuting a suspect message (from: dev-consul-68b98449d-z4w69)
2021/09/27 11:53:38 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:52860->10.242.28.28:8301: i/o timeout
2021/09/27 11:53:38 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:53:56 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:52936->10.242.28.28:8301: i/o timeout
2021/09/27 11:53:56 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:54:31 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53086->10.242.28.28:8301: i/o timeout
2021/09/27 11:54:31 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:54:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:48150->10.242.28.11:8301: i/o timeout
2021/09/27 11:54:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:48144->10.242.28.11:8301: i/o timeout
2021/09/27 11:54:34 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:54:36 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 11:54:36 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.28.11
2021/09/27 11:54:36 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 11:54:36 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53102->10.242.28.28:8301: i/o timeout
2021/09/27 11:54:36 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:54:38 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53112->10.242.28.28:8301: i/o timeout
2021/09/27 11:54:38 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:54:39 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.28.11
2021/09/27 11:54:39 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 11:54:40 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:48182->10.242.28.11:8301: i/o timeout
2021/09/27 11:54:40 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:54:41 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:36738->10.242.28.11:8302: i/o timeout
2021/09/27 11:54:41 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 11:54:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:48188->10.242.28.11:8301: i/o timeout
2021/09/27 11:54:42 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:54:44 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53136->10.242.28.28:8301: i/o timeout
2021/09/27 11:54:44 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:54:45 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:54:46 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:48208->10.242.28.11:8301: i/o timeout
2021/09/27 11:54:46 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:54:48 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:48220->10.242.28.11:8301: i/o timeout
2021/09/27 11:54:48 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:54:50 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:48230->10.242.28.11:8301: i/o timeout
2021/09/27 11:54:50 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:54:52 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:48236->10.242.28.11:8301: i/o timeout
2021/09/27 11:54:52 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:54:54 [INFO] serf: attempting reconnect to dev-consul-68b98449d-z4w69 10.242.28.28:8301
2021/09/27 11:54:57 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:55:00 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53226->10.242.28.28:8301: i/o timeout
2021/09/27 11:55:00 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:55:03 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53234->10.242.28.28:8301: i/o timeout
2021/09/27 11:55:03 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:55:17 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53294->10.242.28.28:8301: i/o timeout
2021/09/27 11:55:17 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:55:20 [WARN] memberlist: Was able to connect to dev-consul-68b98449d-z4w69 but other probes failed, network may be misconfigured
2021/09/27 11:55:23 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53320->10.242.28.28:8301: i/o timeout
2021/09/27 11:55:23 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:55:38 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53394->10.242.28.28:8301: i/o timeout
2021/09/27 11:56:16 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53624->10.242.28.28:8301: i/o timeout
2021/09/27 11:56:16 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:56:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54184->10.242.28.28:8301: i/o timeout
2021/09/27 11:56:34 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:56:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54192->10.242.28.28:8301: i/o timeout
2021/09/27 11:56:37 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:56:38 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 11:56:38 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:56:40 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:56:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54314->10.242.28.28:8301: i/o timeout
2021/09/27 11:56:42 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:56:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54318->10.242.28.28:8301: i/o timeout
2021/09/27 11:56:46 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54332->10.242.28.28:8301: i/o timeout
2021/09/27 11:56:46 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:56:46 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 11:56:46 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:56:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:49398->10.242.28.11:8301: i/o timeout
2021/09/27 11:56:49 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:56:52 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:49516->10.242.28.11:8301: i/o timeout
2021/09/27 11:56:52 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:56:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:49520->10.242.28.11:8301: i/o timeout
2021/09/27 11:56:54 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:56:56 [INFO] serf: attempting reconnect to dev-consul-68b98449d-z4w69 10.242.28.28:8301
2021/09/27 11:56:56 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:38088->10.242.28.11:8302: i/o timeout
2021/09/27 11:56:56 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 11:56:57 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:56:57 [WARN] memberlist: Refuting a suspect message (from: dev-consul-68b98449d-z4w69)
2021/09/27 11:57:13 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54530->10.242.28.28:8301: i/o timeout
2021/09/27 11:57:13 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:57:16 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54544->10.242.28.28:8301: i/o timeout
2021/09/27 11:57:16 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:57:17 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 11:57:17 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:57:18 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:57:40 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54720->10.242.28.28:8301: i/o timeout
2021/09/27 11:57:40 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:57:51 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54754->10.242.28.28:8301: i/o timeout
2021/09/27 11:57:51 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:57:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54756->10.242.28.28:8301: i/o timeout
2021/09/27 11:57:54 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:57:55 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 11:57:55 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:57:57 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:49826->10.242.28.11:8301: i/o timeout
2021/09/27 11:57:57 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 11:58:00 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:58:12 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54818->10.242.28.28:8301: i/o timeout
2021/09/27 11:58:12 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:58:16 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54834->10.242.28.28:8301: i/o timeout
2021/09/27 11:58:16 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 11:58:17 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 11:58:17 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 11:58:25 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:00:00 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:55254->10.242.28.28:8301: i/o timeout
2021/09/27 12:00:00 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:00:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:55262->10.242.28.28:8301: i/o timeout
2021/09/27 12:00:04 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:00:07 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:55272->10.242.28.28:8301: i/o timeout
2021/09/27 12:00:07 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:00:08 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 12:00:08 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:00:15 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:00:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:55330->10.242.28.28:8301: i/o timeout
2021/09/27 12:00:24 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:00:28 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 12:00:28 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:00:31 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:00:31 [WARN] memberlist: Refuting a suspect message (from: dev-consul-68b98449d-z4w69)
2021/09/27 12:00:46 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:55400->10.242.28.28:8301: i/o timeout
2021/09/27 12:00:46 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:00:48 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 12:00:48 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:00:51 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:50474->10.242.28.11:8301: i/o timeout
2021/09/27 12:00:51 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:00:55 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:50486->10.242.28.11:8301: i/o timeout
2021/09/27 12:00:55 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:00:58 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:50498->10.242.28.11:8301: i/o timeout
2021/09/27 12:00:58 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:01:00 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:50508->10.242.28.11:8301: i/o timeout
2021/09/27 12:01:00 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:01:05 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:01:17 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:55504->10.242.28.28:8301: i/o timeout
2021/09/27 12:01:17 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:01:20 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:55516->10.242.28.28:8301: i/o timeout
2021/09/27 12:01:20 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:01:27 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:50700->10.242.28.11:8301: i/o timeout
2021/09/27 12:01:27 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:01:30 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:50714->10.242.28.11:8301: i/o timeout
2021/09/27 12:01:30 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:01:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:55660->10.242.28.28:8301: i/o timeout
2021/09/27 12:01:33 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:01:36 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:55666->10.242.28.28:8301: i/o timeout
2021/09/27 12:01:36 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:01:38 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:01:39 [WARN] memberlist: Was able to connect to dev-consul-server-0 but other probes failed, network may be misconfigured
2021/09/27 12:01:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:50750->10.242.28.11:8301: i/o timeout
2021/09/27 12:01:42 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:01:50 [WARN] memberlist: Was able to connect to dev-consul-server-0 but other probes failed, network may be misconfigured
2021/09/27 12:01:52 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:50786->10.242.28.11:8301: i/o timeout
2021/09/27 12:01:52 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:01:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:50790->10.242.28.11:8301: i/o timeout
2021/09/27 12:01:55 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:50802->10.242.28.11:8301: i/o timeout
2021/09/27 12:01:55 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:01:56 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:39358->10.242.28.11:8302: i/o timeout
2021/09/27 12:01:57 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:50810->10.242.28.11:8301: i/o timeout
2021/09/27 12:01:57 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:02:00 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:50824->10.242.28.11:8301: i/o timeout
2021/09/27 12:02:00 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:02:02 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:50826->10.242.28.11:8301: i/o timeout
2021/09/27 12:02:02 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:02:04 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (1 peer confirmations)
2021/09/27 12:02:04 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.28.11
2021/09/27 12:02:04 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 12:02:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:50832->10.242.28.11:8301: i/o timeout
2021/09/27 12:02:04 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:02:06 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:39398->10.242.28.11:8302: i/o timeout
2021/09/27 12:02:06 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:02:16 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:39432->10.242.28.11:8302: i/o timeout
2021/09/27 12:02:16 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:02:17 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:02:18 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.28.11
2021/09/27 12:02:18 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 12:02:21 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:50898->10.242.28.11:8301: i/o timeout
2021/09/27 12:02:21 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:02:25 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:50908->10.242.28.11:8301: i/o timeout
2021/09/27 12:02:25 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:03:40 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:56078->10.242.28.28:8301: i/o timeout
2021/09/27 12:03:40 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:03:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:56082->10.242.28.28:8301: i/o timeout
2021/09/27 12:03:42 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:03:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:56096->10.242.28.28:8301: i/o timeout
2021/09/27 12:03:45 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:03:46 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 12:03:46 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:03:52 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0)
2021/09/27 12:04:06 [ERR] memberlist: failed to receive: read tcp 10.242.59.64:8301->10.242.28.28:55978: i/o timeout from=10.242.28.28:55978
2021/09/27 12:04:06 [ERR] memberlist: Failed to send error: write tcp 10.242.59.64:8301->10.242.28.28:55978: i/o timeout from=10.242.28.28:55978
2021/09/27 12:04:11 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51234->10.242.28.11:8301: i/o timeout
2021/09/27 12:04:11 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:04:13 [WARN] memberlist: Was able to connect to dev-consul-server-0 but other probes failed, network may be misconfigured
2021/09/27 12:04:16 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51252->10.242.28.11:8301: i/o timeout
2021/09/27 12:04:16 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:04:21 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:04:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:56214->10.242.28.28:8301: i/o timeout
2021/09/27 12:04:22 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:04:25 [WARN] memberlist: Was able to connect to dev-consul-68b98449d-z4w69 but other probes failed, network may be misconfigured
2021/09/27 12:04:26 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 12:04:26 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:04:28 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:04:52 [WARN] memberlist: Was able to connect to dev-consul-server-0 but other probes failed, network may be misconfigured
2021/09/27 12:04:53 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:56420->10.242.28.28:8301: i/o timeout
2021/09/27 12:04:53 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:04:56 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:56434->10.242.28.28:8301: i/o timeout
2021/09/27 12:04:56 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:04:57 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 12:04:57 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:04:59 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:05:07 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51524->10.242.28.11:8301: i/o timeout
2021/09/27 12:05:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51548->10.242.28.11:8301: i/o timeout
2021/09/27 12:05:14 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:05:16 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:56502->10.242.28.28:8301: i/o timeout
2021/09/27 12:05:16 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:05:18 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:56518->10.242.28.28:8301: i/o timeout
2021/09/27 12:05:18 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:05:30 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51618->10.242.28.11:8301: i/o timeout
2021/09/27 12:05:30 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:05:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:56566->10.242.28.28:8301: i/o timeout
2021/09/27 12:05:33 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:05:36 [WARN] memberlist: Was able to connect to dev-consul-68b98449d-z4w69 but other probes failed, network may be misconfigured
2021/09/27 12:05:38 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 12:05:38 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:05:38 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:56592->10.242.28.28:8301: i/o timeout
2021/09/27 12:05:38 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:05:41 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51656->10.242.28.11:8301: i/o timeout
2021/09/27 12:05:41 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:05:42 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0)
2021/09/27 12:05:42 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:05:46 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:56618->10.242.28.28:8301: i/o timeout
2021/09/27 12:05:46 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:05:49 [WARN] memberlist: Was able to connect to dev-consul-server-0 but other probes failed, network may be misconfigured
2021/09/27 12:05:51 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:56638->10.242.28.28:8301: i/o timeout
2021/09/27 12:05:51 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:05:53 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51696->10.242.28.11:8301: i/o timeout
2021/09/27 12:05:53 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:05:55 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:56654->10.242.28.28:8301: i/o timeout
2021/09/27 12:05:55 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:05:56 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:05:57 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0.dc1)
2021/09/27 12:06:01 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51740->10.242.28.11:8301: i/o timeout
2021/09/27 12:06:01 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:06:07 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51758->10.242.28.11:8301: i/o timeout
2021/09/27 12:06:07 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:06:11 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51772->10.242.28.11:8301: i/o timeout
2021/09/27 12:06:11 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:06:13 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51776->10.242.28.11:8301: i/o timeout
2021/09/27 12:06:13 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:06:15 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51794->10.242.28.11:8301: i/o timeout
2021/09/27 12:06:15 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:06:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51808->10.242.28.11:8301: i/o timeout
2021/09/27 12:06:19 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:06:25 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51832->10.242.28.11:8301: i/o timeout
2021/09/27 12:06:25 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:06:27 [INFO] serf: attempting reconnect to dev-consul-68b98449d-z4w69 10.242.28.28:8301
2021/09/27 12:06:34 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:06:34 [WARN] memberlist: Refuting a suspect message (from: dev-consul-68b98449d-z4w69)
2021/09/27 12:06:36 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51866->10.242.28.11:8301: i/o timeout
2021/09/27 12:06:36 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:06:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:56822->10.242.28.28:8301: i/o timeout
2021/09/27 12:06:39 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:06:40 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 12:06:40 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:06:42 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:06:55 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:56872->10.242.28.28:8301: i/o timeout
2021/09/27 12:06:55 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:07:07 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:51968->10.242.28.11:8301: i/o timeout
2021/09/27 12:07:07 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:07:11 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:56926->10.242.28.28:8301: i/o timeout
2021/09/27 12:07:11 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:07:16 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:56946->10.242.28.28:8301: i/o timeout
2021/09/27 12:07:16 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:07:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:56952->10.242.28.28:8301: i/o timeout
2021/09/27 12:07:19 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:07:20 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 12:07:20 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:07:29 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:52148->10.242.28.11:8301: i/o timeout
2021/09/27 12:07:29 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:07:32 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:07:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:52184->10.242.28.11:8301: i/o timeout
2021/09/27 12:07:42 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:07:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:57132->10.242.28.28:8301: i/o timeout
2021/09/27 12:07:45 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:07:48 [WARN] raft: Rejecting vote request from 10.242.28.11:8300 since we have a leader: 10.242.225.64:8300
2021/09/27 12:07:48 [DEBUG] raft-net: 10.242.59.64:8300 accepted connection from: 10.242.28.11:36818
2021/09/27 12:07:48 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:57148->10.242.28.28:8301: i/o timeout
2021/09/27 12:07:48 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:07:49 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 12:07:49 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:07:53 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:07:56 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:52232->10.242.28.11:8301: i/o timeout
2021/09/27 12:07:56 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:07:56 [INFO] consul: New leader elected: dev-consul-server-1
2021/09/27 12:07:57 [DEBUG] raft-net: 10.242.59.64:8300 accepted connection from: 10.242.225.64:44780
2021/09/27 12:08:00 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:52252->10.242.28.11:8301: i/o timeout
2021/09/27 12:08:00 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:08:03 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:52258->10.242.28.11:8301: i/o timeout
2021/09/27 12:08:03 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:08:06 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:40828->10.242.28.11:8302: i/o timeout
2021/09/27 12:08:06 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:08:06 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:52272->10.242.28.11:8301: i/o timeout
2021/09/27 12:08:06 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:08:08 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:57228->10.242.28.28:8301: i/o timeout
2021/09/27 12:08:08 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:08:10 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:57238->10.242.28.28:8301: i/o timeout
2021/09/27 12:08:10 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:08:12 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:52296->10.242.28.11:8301: i/o timeout
2021/09/27 12:08:12 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:08:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:52300->10.242.28.11:8301: i/o timeout
2021/09/27 12:08:14 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:08:15 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (1 peer confirmations)
2021/09/27 12:08:15 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.28.11
2021/09/27 12:08:15 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 12:08:16 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (1 peer confirmations)
2021/09/27 12:08:16 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:08:16 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:40872->10.242.28.11:8302: i/o timeout
2021/09/27 12:08:16 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:08:16 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:57260->10.242.28.28:8301: i/o timeout
2021/09/27 12:08:16 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:08:26 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:40906->10.242.28.11:8302: i/o timeout
2021/09/27 12:08:26 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:08:34 [INFO] serf: attempting reconnect to dev-consul-68b98449d-z4w69 10.242.28.28:8301
2021/09/27 12:08:36 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/09/27 12:08:36 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.28.11
2021/09/27 12:08:36 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan"
2021/09/27 12:08:36 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:40924->10.242.28.11:8302: i/o timeout
2021/09/27 12:08:36 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:08:46 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.28.11:8302
2021/09/27 12:09:14 [INFO] serf: attempting reconnect to dev-consul-68b98449d-z4w69 10.242.28.28:8301
2021/09/27 12:09:46 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.28.11:8302
2021/09/27 12:09:54 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.28.11:8301
2021/09/27 12:10:34 [INFO] serf: attempting reconnect to dev-consul-68b98449d-z4w69 10.242.28.28:8301
2021/09/27 12:11:14 [INFO] serf: attempting reconnect to dev-consul-68b98449d-z4w69 10.242.28.28:8301
2021/09/27 12:11:16 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.28.11:8302
2021/09/27 12:11:41 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:11:41 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.28.11
2021/09/27 12:11:41 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 12:11:42 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.28.11
2021/09/27 12:11:42 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/09/27 12:11:42 [WARN] raft: Rejecting vote request from 10.242.28.11:8300 since we have a leader: 10.242.225.64:8300
2021/09/27 12:11:42 [WARN] memberlist: Was able to connect to dev-consul-server-0 but other probes failed, network may be misconfigured
2021/09/27 12:11:43 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:58000->10.242.28.28:8301: i/o timeout
2021/09/27 12:11:43 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:11:44 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:11:44 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:12:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:58096->10.242.28.28:8301: i/o timeout
2021/09/27 12:12:14 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:12:17 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:58110->10.242.28.28:8301: i/o timeout
2021/09/27 12:12:17 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:12:18 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 12:12:18 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:12:21 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53180->10.242.28.11:8301: i/o timeout
2021/09/27 12:12:21 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:12:24 [INFO] serf: attempting reconnect to dev-consul-68b98449d-z4w69 10.242.28.28:8301
2021/09/27 12:12:29 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:12:30 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:58156->10.242.28.28:8301: i/o timeout
2021/09/27 12:12:30 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:12:35 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53220->10.242.28.11:8301: i/o timeout
2021/09/27 12:12:35 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:12:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53234->10.242.28.11:8301: i/o timeout
2021/09/27 12:12:37 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:12:39 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 12:12:39 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.28.11
2021/09/27 12:12:39 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 12:12:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:58198->10.242.28.28:8301: i/o timeout
2021/09/27 12:12:42 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:12:44 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:58204->10.242.28.28:8301: i/o timeout
2021/09/27 12:12:44 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:12:46 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.28.11
2021/09/27 12:12:46 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 12:12:46 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 12:12:46 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:12:46 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:58212->10.242.28.28:8301: i/o timeout
2021/09/27 12:12:46 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:12:50 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:12:51 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:58232->10.242.28.28:8301: i/o timeout
2021/09/27 12:12:51 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:12:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:58234->10.242.28.28:8301: i/o timeout
2021/09/27 12:12:54 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:12:55 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 12:12:55 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:12:58 [WARN] memberlist: Was able to connect to dev-consul-server-0 but other probes failed, network may be misconfigured
2021/09/27 12:13:01 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:41882->10.242.28.11:8302: i/o timeout
2021/09/27 12:13:01 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:13:02 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53328->10.242.28.11:8301: i/o timeout
2021/09/27 12:13:02 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:13:05 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53340->10.242.28.11:8301: i/o timeout
2021/09/27 12:13:05 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:13:06 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (1 peer confirmations)
2021/09/27 12:13:06 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.28.11
2021/09/27 12:13:06 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 12:13:11 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.28.11
2021/09/27 12:13:11 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 12:13:11 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0)
2021/09/27 12:13:13 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53364->10.242.28.11:8301: i/o timeout
2021/09/27 12:13:13 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:13:15 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53378->10.242.28.11:8301: i/o timeout
2021/09/27 12:13:15 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:13:18 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53386->10.242.28.11:8301: i/o timeout
2021/09/27 12:13:18 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:13:20 [ERR] yamux: keepalive failed: i/o deadline reached
2021/09/27 12:13:20 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.28.28:45280
2021/09/27 12:13:20 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53398->10.242.28.11:8301: i/o timeout
2021/09/27 12:13:20 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:13:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53402->10.242.28.11:8301: i/o timeout
2021/09/27 12:13:22 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:13:25 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53416->10.242.28.11:8301: i/o timeout
2021/09/27 12:13:25 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:13:26 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:41972->10.242.28.11:8302: i/o timeout
2021/09/27 12:13:26 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:13:27 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53522->10.242.28.11:8301: i/o timeout
2021/09/27 12:13:27 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:13:30 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53542->10.242.28.11:8301: i/o timeout
2021/09/27 12:13:30 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:13:31 [ERR] memberlist: failed to receive: read tcp 10.242.59.64:8301->10.242.28.11:49914: i/o timeout from=10.242.28.11:49914
2021/09/27 12:13:31 [ERR] memberlist: Failed to send error: write tcp 10.242.59.64:8301->10.242.28.11:49914: i/o timeout from=10.242.28.11:49914
2021/09/27 12:13:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:53546->10.242.28.11:8301: i/o timeout
2021/09/27 12:13:33 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:13:34 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (1 peer confirmations)
2021/09/27 12:13:34 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.28.11
2021/09/27 12:13:34 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 12:13:36 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:42096->10.242.28.11:8302: i/o timeout
2021/09/27 12:13:36 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:13:51 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:42158->10.242.28.11:8302: i/o timeout
2021/09/27 12:13:51 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:13:56 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/09/27 12:13:56 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.28.11
2021/09/27 12:13:56 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan"
2021/09/27 12:14:01 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:42172->10.242.28.11:8302: i/o timeout
2021/09/27 12:14:01 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:14:03 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.28.11:8301
2021/09/27 12:14:43 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.28.11:8302
2021/09/27 12:14:43 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.28.11:8301
2021/09/27 12:14:59 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:15:02 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:58766->10.242.28.28:8301: i/o timeout
2021/09/27 12:15:02 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:15:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:58772->10.242.28.28:8301: i/o timeout
2021/09/27 12:15:04 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:15:05 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (0 peer confirmations)
2021/09/27 12:15:05 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:15:23 [INFO] serf: attempting reconnect to dev-consul-68b98449d-z4w69 10.242.28.28:8301
2021/09/27 12:15:39 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:15:40 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:58898->10.242.28.28:8301: i/o timeout
2021/09/27 12:15:40 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:15:43 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.28.11:8302
2021/09/27 12:15:43 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:58906->10.242.28.28:8301: i/o timeout
2021/09/27 12:15:43 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:15:44 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (0 peer confirmations)
2021/09/27 12:15:44 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:15:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:58910->10.242.28.28:8301: i/o timeout
2021/09/27 12:15:45 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:15:51 [ERR] yamux: keepalive failed: i/o deadline reached
2021/09/27 12:16:03 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.28.11:8301
2021/09/27 12:16:23 [ERR] yamux: keepalive failed: i/o deadline reached
2021/09/27 12:16:23 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.28.28:46720
2021/09/27 12:16:43 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.28.11:8301
2021/09/27 12:16:47 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.28.11
2021/09/27 12:16:47 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 12:16:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54270->10.242.28.11:8301: i/o timeout
2021/09/27 12:16:49 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:16:52 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54290->10.242.28.11:8301: i/o timeout
2021/09/27 12:16:52 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:16:53 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (0 peer confirmations)
2021/09/27 12:16:53 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.28.11
2021/09/27 12:16:53 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 12:16:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54296->10.242.28.11:8301: i/o timeout
2021/09/27 12:16:54 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:16:55 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.28.11
2021/09/27 12:16:55 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/09/27 12:17:05 [ERR] memberlist: failed to receive: read tcp 10.242.59.64:8301->10.242.28.11:51556: i/o timeout from=10.242.28.11:51556
2021/09/27 12:17:05 [ERR] memberlist: Failed to send error: write tcp 10.242.59.64:8301->10.242.28.11:51556: i/o timeout from=10.242.28.11:51556
2021/09/27 12:17:06 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:42896->10.242.28.11:8302: i/o timeout
2021/09/27 12:17:06 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:17:16 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:42930->10.242.28.11:8302: i/o timeout
2021/09/27 12:17:16 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:17:17 [INFO] serf: attempting reconnect to dev-consul-68b98449d-z4w69 10.242.28.28:8301
2021/09/27 12:17:19 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.28.11
2021/09/27 12:17:19 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0)
2021/09/27 12:17:19 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 12:17:19 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0.dc1)
2021/09/27 12:17:21 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54394->10.242.28.11:8301: i/o timeout
2021/09/27 12:17:21 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:17:23 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54396->10.242.28.11:8301: i/o timeout
2021/09/27 12:17:23 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:17:25 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (0 peer confirmations)
2021/09/27 12:17:25 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.28.11
2021/09/27 12:17:25 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 12:17:26 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54412->10.242.28.11:8301: i/o timeout
2021/09/27 12:17:26 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:17:31 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:42986->10.242.28.11:8302: i/o timeout
2021/09/27 12:17:31 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:17:32 [ERR] memberlist: failed to receive: read tcp 10.242.59.64:8301->10.242.28.28:41992: i/o timeout from=10.242.28.28:41992
2021/09/27 12:17:32 [ERR] memberlist: Failed to send error: write tcp 10.242.59.64:8301->10.242.28.28:41992: i/o timeout from=10.242.28.28:41992
2021/09/27 12:17:41 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:43000->10.242.28.11:8302: i/o timeout
2021/09/27 12:17:41 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:17:55 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.28.11
2021/09/27 12:17:55 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 12:17:56 [WARN] memberlist: Was able to connect to dev-consul-server-0.dc1 but other probes failed, network may be misconfigured
2021/09/27 12:17:58 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54516->10.242.28.11:8301: i/o timeout
2021/09/27 12:17:58 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:18:00 [WARN] memberlist: Was able to connect to dev-consul-server-0 but other probes failed, network may be misconfigured
2021/09/27 12:18:01 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (0 peer confirmations)
2021/09/27 12:18:01 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.28.11
2021/09/27 12:18:01 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 12:18:09 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.28.11
2021/09/27 12:18:09 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 12:18:23 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54598->10.242.28.11:8301: i/o timeout
2021/09/27 12:18:23 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:18:27 [INFO] serf: attempting reconnect to dev-consul-68b98449d-z4w69 10.242.28.28:8301
2021/09/27 12:18:37 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:18:40 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54656->10.242.28.11:8301: i/o timeout
2021/09/27 12:18:40 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:18:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:59604->10.242.28.28:8301: i/o timeout
2021/09/27 12:18:42 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:18:44 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54668->10.242.28.11:8301: i/o timeout
2021/09/27 12:18:44 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:18:46 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:59622->10.242.28.28:8301: i/o timeout
2021/09/27 12:18:46 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:18:48 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:59636->10.242.28.28:8301: i/o timeout
2021/09/27 12:18:48 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:18:50 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54744->10.242.28.11:8301: i/o timeout
2021/09/27 12:18:50 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:18:51 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:18:52 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (1 peer confirmations)
2021/09/27 12:18:52 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.28.11
2021/09/27 12:18:52 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 12:18:52 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:54760->10.242.28.11:8301: i/o timeout
2021/09/27 12:18:52 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:19:01 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:43396->10.242.28.11:8302: i/o timeout
2021/09/27 12:19:01 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:19:07 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.28.11:8301
2021/09/27 12:19:11 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:43430->10.242.28.11:8302: i/o timeout
2021/09/27 12:19:11 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:19:21 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:43484->10.242.28.11:8302: i/o timeout
2021/09/27 12:19:21 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:19:23 [ERR] yamux: keepalive failed: i/o deadline reached
2021/09/27 12:19:23 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.28.11
2021/09/27 12:19:23 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan"
2021/09/27 12:19:43 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.28.11:8302
2021/09/27 12:19:47 [INFO] serf: attempting reconnect to dev-consul-68b98449d-z4w69 10.242.28.28:8301
2021/09/27 12:20:10 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.28.11
2021/09/27 12:20:10 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 12:20:10 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0.dc1)
2021/09/27 12:20:10 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.28.11
2021/09/27 12:20:10 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/09/27 12:20:23 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:20:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:60444->10.242.28.28:8301: i/o timeout
2021/09/27 12:20:24 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:20:27 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:60458->10.242.28.28:8301: i/o timeout
2021/09/27 12:20:27 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:20:30 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:60504->10.242.28.28:8301: i/o timeout
2021/09/27 12:20:30 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:20:33 [INFO] memberlist: Marking dev-consul-68b98449d-z4w69 as failed, suspect timeout reached (2 peer confirmations)
2021/09/27 12:20:33 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:20:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:55604->10.242.28.11:8301: i/o timeout
2021/09/27 12:20:33 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:20:36 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:55626->10.242.28.11:8301: i/o timeout
2021/09/27 12:20:36 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:20:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:55642->10.242.28.11:8301: i/o timeout
2021/09/27 12:20:39 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:20:41 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:55656->10.242.28.11:8301: i/o timeout
2021/09/27 12:20:41 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:20:43 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:55664->10.242.28.11:8301: i/o timeout
2021/09/27 12:20:43 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:20:45 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (1 peer confirmations)
2021/09/27 12:20:45 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.28.11
2021/09/27 12:20:45 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 12:20:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:55680->10.242.28.11:8301: i/o timeout
2021/09/27 12:20:45 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:20:46 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:44234->10.242.28.11:8302: i/o timeout
2021/09/27 12:20:46 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:20:50 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.28.11
2021/09/27 12:20:50 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 12:20:51 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:21:00 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:55764->10.242.28.11:8301: i/o timeout
2021/09/27 12:21:00 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:21:01 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:44318->10.242.28.11:8302: i/o timeout
2021/09/27 12:21:01 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:21:03 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:55770->10.242.28.11:8301: i/o timeout
2021/09/27 12:21:03 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:21:06 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:60724->10.242.28.28:8301: i/o timeout
2021/09/27 12:21:06 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:21:09 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:60744->10.242.28.28:8301: i/o timeout
2021/09/27 12:21:09 [INFO] memberlist: Suspect dev-consul-68b98449d-z4w69 has failed, no acks received
2021/09/27 12:21:11 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:44372->10.242.28.11:8302: i/o timeout
2021/09/27 12:21:11 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:21:13 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:55818->10.242.28.11:8301: i/o timeout
2021/09/27 12:21:13 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:21:17 [WARN] memberlist: Was able to connect to dev-consul-68b98449d-z4w69 but other probes failed, network may be misconfigured
2021/09/27 12:21:18 [INFO] serf: EventMemberFailed: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:21:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.59.64:55864->10.242.28.11:8301: i/o timeout
2021/09/27 12:21:19 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:21:20 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:21:50 [INFO] serf: EventMemberLeave: dev-consul-68b98449d-z4w69 10.242.28.28
2021/09/27 12:21:53 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:21:56 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:21:59 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:22:01 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:22:02 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:22:05 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (1 peer confirmations)
2021/09/27 12:22:05 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.28.11
2021/09/27 12:22:05 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.28.11:8300) (DC: dc1)
2021/09/27 12:22:13 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received
2021/09/27 12:22:16 [INFO] serf: EventMemberJoin: dev-consul-68b98449d-9l6r2 10.242.90.211
2021/09/27 12:22:27 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.28.11:8301
2021/09/27 12:22:28 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/09/27 12:22:28 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.28.11
2021/09/27 12:22:28 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan"
2021/09/27 12:22:44 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received
2021/09/27 12:23:04 [ERR] memberlist: Conflicting address for dev-consul-server-0.dc1. Mine: 10.242.28.11:8302 Theirs: 10.242.225.79:8302
2021/09/27 12:23:04 [WARN] serf: Name conflict for 'dev-consul-server-0.dc1' both 10.242.28.11:8302 and 10.242.225.79:8302 are claiming
2021/09/27 12:23:04 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.225.79
2021/09/27 12:23:04 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.225.79:8300) (DC: dc1)
2021/09/27 12:23:04 [ERR] memberlist: Conflicting address for dev-consul-server-0.dc1. Mine: 10.242.28.11:8302 Theirs: 10.242.225.79:8302
2021/09/27 12:23:04 [WARN] serf: Name conflict for 'dev-consul-server-0.dc1' both 10.242.28.11:8302 and 10.242.225.79:8302 are claiming
2021/09/27 12:23:04 [ERR] memberlist: Conflicting address for dev-consul-server-0.dc1. Mine: 10.242.28.11:8302 Theirs: 10.242.225.79:8302
2021/09/27 12:23:04 [WARN] serf: Name conflict for 'dev-consul-server-0.dc1' both 10.242.28.11:8302 and 10.242.225.79:8302 are claiming
2021/09/27 12:23:05 [ERR] memberlist: Conflicting address for dev-consul-server-0.dc1. Mine: 10.242.28.11:8302 Theirs: 10.242.225.79:8302
2021/09/27 12:23:05 [WARN] serf: Name conflict for 'dev-consul-server-0.dc1' both 10.242.28.11:8302 and 10.242.225.79:8302 are claiming
2021/09/27 12:23:05 [ERR] memberlist: Conflicting address for dev-consul-server-0.dc1. Mine: 10.242.28.11:8302 Theirs: 10.242.225.79:8302
2021/09/27 12:23:05 [WARN] serf: Name conflict for 'dev-consul-server-0.dc1' both 10.242.28.11:8302 and 10.242.225.79:8302 are claiming
2021/09/27 12:23:10 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.28.11:8302
2021/09/27 12:24:10 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.28.11:8302
2021/09/27 12:24:32 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.225.79
2021/09/27 12:24:32 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"