By type
+ CONSUL_BIND=
+ [ -n ]
+ CONSUL_CLIENT=
+ [ -n ]
+ CONSUL_DATA_DIR=/consul/data
+ CONSUL_CONFIG_DIR=/consul/config
+ [ -n ]
+ [ a = - ]
+ [ agent = agent ]
+ shift
+ set -- consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui
+ [ consul = consul ]
+ stat -c %u /consul/data
+ id -u consul
+ [ 100 != 100 ]
+ stat -c %u /consul/config
+ id -u consul
+ [ 100 != 100 ]
+ [ ! -z ]
+ exec consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui
bootstrap_expect > 0: expecting 3 servers
==> Starting Consul agent...
==> Consul agent running!
Version: 'v1.0.6'
Node ID: '23f78c2d-6e31-8c07-eefe-c4fff84e6288'
Node name: 'dev-consul-server-1'
Datacenter: 'dc1' (Segment: '')
Server: true (Bootstrap: false)
Client Addr: [0.0.0.0] (HTTP: 8500, HTTPS: -1, DNS: 8600)
Cluster Addr: 10.242.28.14 (LAN: 8301, WAN: 8302)
Encrypt: Gossip: false, TLS-Outgoing: false, TLS-Incoming: false
==> Log data will now stream in as it occurs:
2021/06/13 22:40:19 [INFO] raft: Initial configuration (index=0): []
2021/06/13 22:40:19 [INFO] raft: Node at 10.242.28.14:8300 [Follower] entering Follower state (Leader: "")
2021/06/13 22:40:19 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.28.14
2021/06/13 22:40:19 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.28.14
2021/06/13 22:40:19 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.28.14:8300) (DC: dc1)
2021/06/13 22:40:19 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/06/13 22:40:19 [INFO] agent: Started DNS server 0.0.0.0:8600 (udp)
2021/06/13 22:40:19 [INFO] agent: Started DNS server 0.0.0.0:8600 (tcp)
2021/06/13 22:40:19 [INFO] agent: Started HTTP server on [::]:8500 (tcp)
2021/06/13 22:40:19 [INFO] agent: started state syncer
2021/06/13 22:40:19 [INFO] agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce os scaleway softlayer
2021/06/13 22:40:19 [INFO] agent: Joining LAN cluster...
2021/06/13 22:40:19 [INFO] agent: (LAN) joining: [dev-consul-server-0.consul-server dev-consul-server-1.consul-server dev-consul-server-2.consul-server]
2021/06/13 22:40:19 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.249.70
2021/06/13 22:40:19 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.249.70:8300) (DC: dc1)
2021/06/13 22:40:19 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.249.70
2021/06/13 22:40:19 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/06/13 22:40:19 [WARN] memberlist: Failed to resolve dev-consul-server-1.consul-server: lookup dev-consul-server-1.consul-server on 10.96.0.10:53: no such host
2021/06/13 22:40:19 [WARN] memberlist: Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host
2021/06/13 22:40:19 [INFO] agent: (LAN) joined: 1 Err:
2021/06/13 22:40:19 [INFO] agent: Join LAN completed. Synced with 1 initial agents
2021/06/13 22:40:25 [WARN] raft: no known peers, aborting election
2021/06/13 22:40:27 [ERR] agent: failed to sync remote state: No cluster leader
2021/06/13 22:40:35 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-kqtxq 10.242.28.8
==> Failed to check for updates: Get https://checkpoint-api.hashicorp.com/v1/check/consul?arch=amd64&os=linux&signature=6e9b054f-cecd-c6e2-1f8d-bb77fce808a6&version=1.0.6: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/06/13 22:40:45 [ERR] agent: Coordinate update error: No cluster leader
2021/06/13 22:41:01 [ERR] agent: failed to sync remote state: No cluster leader
2021/06/13 22:41:13 [ERR] agent: Coordinate update error: No cluster leader
2021/06/13 22:41:29 [ERR] agent: failed to sync remote state: No cluster leader
2021/06/13 22:41:40 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.136.142
2021/06/13 22:41:40 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/13 22:41:40 [INFO] consul: Existing Raft peers reported by dev-consul-server-0, disabling bootstrap mode
2021/06/13 22:41:40 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.136.142
2021/06/13 22:41:40 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/06/13 22:41:42 [DEBUG] raft-net: 10.242.28.14:8300 accepted connection from: 10.242.249.70:41258
2021/06/13 22:41:42 [DEBUG] raft-net: 10.242.28.14:8300 accepted connection from: 10.242.249.70:41260
2021/06/13 22:41:42 [WARN] raft: Failed to get previous log: 1 log not found (last: 0)
2021/06/13 22:41:42 [INFO] consul: New leader elected: dev-consul-server-0
2021/06/13 22:41:43 [INFO] agent: Synced node info
2021/06/14 00:00:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:42230->10.242.136.142:8301: i/o timeout
2021/06/14 00:00:04 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:00:07 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/06/14 00:00:08 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/06/14 00:00:08 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.136.142
2021/06/14 00:00:08 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:00:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:51040->10.242.136.142:8302: i/o timeout
2021/06/14 00:00:14 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:00:19 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.136.142:8301
2021/06/14 00:00:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:51142->10.242.136.142:8302: i/o timeout
2021/06/14 00:00:24 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:00:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:51520->10.242.136.142:8302: i/o timeout
2021/06/14 00:00:39 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:00:40 [ERR] memberlist: Push/Pull with dev-consul-server-2.dc1 failed: read tcp 10.242.28.14:50996->10.242.136.142:8302: i/o timeout
2021/06/14 00:00:44 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/14 00:00:44 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.136.142
2021/06/14 00:00:44 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/06/14 00:00:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:51582->10.242.136.142:8302: i/o timeout
2021/06/14 00:00:49 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:00:59 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.136.142:8301
2021/06/14 00:01:19 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.136.142:8302
2021/06/14 00:01:21 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.136.142
2021/06/14 00:01:21 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/06/14 00:01:29 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:52368->10.242.136.142:8302: i/o timeout
2021/06/14 00:01:29 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:01:35 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.136.142
2021/06/14 00:01:35 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:01:38 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:43910->10.242.136.142:8301: i/o timeout
2021/06/14 00:01:38 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:01:41 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.136.142
2021/06/14 00:01:41 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:01:44 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:52644->10.242.136.142:8302: i/o timeout
2021/06/14 00:01:44 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:01:46 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.136.142
2021/06/14 00:01:46 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:01:49 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2)
2021/06/14 00:01:51 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/06/14 00:01:52 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/06/14 00:02:31 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:44810->10.242.136.142:8301: i/o timeout
2021/06/14 00:02:31 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:02:35 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/06/14 00:02:35 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/06/14 00:02:35 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.136.142
2021/06/14 00:02:35 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:02:42 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.136.142
2021/06/14 00:02:42 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:02:56 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:45220->10.242.136.142:8301: i/o timeout
2021/06/14 00:02:56 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:02:59 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.136.142
2021/06/14 00:02:59 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:02:59 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/06/14 00:03:05 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.136.142
2021/06/14 00:03:05 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:03:06 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/06/14 00:03:13 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:45508->10.242.136.142:8301: i/o timeout
2021/06/14 00:03:13 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:03:16 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:45530->10.242.136.142:8301: i/o timeout
2021/06/14 00:03:16 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:03:17 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/06/14 00:03:17 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.136.142
2021/06/14 00:03:17 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:03:18 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:45592->10.242.136.142:8301: i/o timeout
2021/06/14 00:03:18 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:03:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:54320->10.242.136.142:8302: i/o timeout
2021/06/14 00:03:24 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:03:34 [WARN] memberlist: Was able to connect to dev-consul-server-2.dc1 but other probes failed, network may be misconfigured
2021/06/14 00:03:39 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.136.142:8301
2021/06/14 00:03:43 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.136.142
2021/06/14 00:03:43 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:03:44 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/06/14 00:03:46 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:46062->10.242.136.142:8301: i/o timeout
2021/06/14 00:03:46 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:03:49 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/06/14 00:03:49 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.136.142
2021/06/14 00:03:49 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:03:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:54752->10.242.136.142:8302: i/o timeout
2021/06/14 00:03:49 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:03:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:46108->10.242.136.142:8301: i/o timeout
2021/06/14 00:03:49 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:03:52 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2)
2021/06/14 00:03:55 [DEBUG] raft-net: 10.242.28.14:8300 accepted connection from: 10.242.136.142:56490
2021/06/14 00:03:55 [WARN] raft: Rejecting vote request from 10.242.136.142:8300 since we have a leader: 10.242.249.70:8300
2021/06/14 00:03:55 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2.dc1)
2021/06/14 00:03:55 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.136.142
2021/06/14 00:03:55 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:04:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:46368->10.242.136.142:8301: i/o timeout
2021/06/14 00:04:04 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:08:29 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:50694->10.242.136.142:8301: i/o timeout
2021/06/14 00:08:29 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:08:33 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/06/14 00:08:33 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.136.142
2021/06/14 00:08:33 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:08:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:59394->10.242.136.142:8302: i/o timeout
2021/06/14 00:08:34 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:08:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:50772->10.242.136.142:8301: i/o timeout
2021/06/14 00:08:34 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:08:39 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.136.142
2021/06/14 00:08:39 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:08:43 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:50920->10.242.136.142:8301: i/o timeout
2021/06/14 00:08:43 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:08:44 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:59560->10.242.136.142:8302: i/o timeout
2021/06/14 00:08:44 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:08:45 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.136.142
2021/06/14 00:08:45 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:08:48 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2)
2021/06/14 00:08:48 [WARN] raft: Rejecting vote request from 10.242.136.142:8300 since we have a leader: 10.242.249.70:8300
2021/06/14 00:08:49 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.136.142
2021/06/14 00:08:49 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:08:49 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2.dc1)
2021/06/14 00:08:51 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:51054->10.242.136.142:8301: i/o timeout
2021/06/14 00:08:51 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:08:56 [INFO] consul: New leader elected: dev-consul-server-0
2021/06/14 00:08:56 [DEBUG] raft-net: 10.242.28.14:8300 accepted connection from: 10.242.249.70:60574
2021/06/14 00:09:09 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:51374->10.242.136.142:8301: i/o timeout
2021/06/14 00:09:09 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:09:10 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/06/14 00:09:10 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.136.142
2021/06/14 00:09:10 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:09:12 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:51380->10.242.136.142:8301: i/o timeout
2021/06/14 00:09:12 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:09:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:60066->10.242.136.142:8302: i/o timeout
2021/06/14 00:09:14 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:09:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:60162->10.242.136.142:8302: i/o timeout
2021/06/14 00:09:24 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:09:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:60400->10.242.136.142:8302: i/o timeout
2021/06/14 00:09:34 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:09:44 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/14 00:09:44 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.136.142
2021/06/14 00:09:44 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/06/14 00:09:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:60656->10.242.136.142:8302: i/o timeout
2021/06/14 00:09:49 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:09:49 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.136.142:8301
2021/06/14 00:09:51 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.136.142:8302
2021/06/14 00:10:06 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/14 00:10:40 [WARN] raft: Rejecting vote request from 10.242.136.142:8300 since we have a leader: 10.242.249.70:8300
2021/06/14 00:10:51 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.136.142
2021/06/14 00:10:51 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/06/14 00:10:51 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.136.142
2021/06/14 00:10:51 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:10:51 [WARN] raft: Rejecting vote request from 10.242.136.142:8300 since we have a leader: 10.242.249.70:8300
2021/06/14 00:10:51 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2.dc1)
2021/06/14 00:10:53 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:53112->10.242.136.142:8301: i/o timeout
2021/06/14 00:10:53 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:10:57 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.136.142
2021/06/14 00:10:57 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:10:57 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2)
2021/06/14 00:10:57 [INFO] consul: New leader elected: dev-consul-server-0
2021/06/14 00:10:57 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:53188->10.242.136.142:8301: i/o timeout
2021/06/14 00:10:57 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:10:58 [DEBUG] raft-net: 10.242.28.14:8300 accepted connection from: 10.242.249.70:34256
2021/06/14 00:10:58 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.136.142
2021/06/14 00:10:58 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:11:01 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:53240->10.242.136.142:8301: i/o timeout
2021/06/14 00:11:01 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:11:04 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.136.142
2021/06/14 00:11:04 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:11:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:33690->10.242.136.142:8302: i/o timeout
2021/06/14 00:11:04 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:11:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:53304->10.242.136.142:8301: i/o timeout
2021/06/14 00:11:04 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:11:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:34036->10.242.136.142:8302: i/o timeout
2021/06/14 00:11:24 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:11:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:34198->10.242.136.142:8302: i/o timeout
2021/06/14 00:11:34 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:11:44 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:34362->10.242.136.142:8302: i/o timeout
2021/06/14 00:11:44 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:11:54 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/14 00:11:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:34448->10.242.136.142:8302: i/o timeout
2021/06/14 00:11:54 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.136.142
2021/06/14 00:11:54 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:11:54 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/06/14 00:12:25 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.136.142
2021/06/14 00:12:25 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:12:26 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/06/14 00:12:28 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:54698->10.242.136.142:8301: i/o timeout
2021/06/14 00:12:28 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:12:31 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:54718->10.242.136.142:8301: i/o timeout
2021/06/14 00:12:31 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:12:32 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.136.142
2021/06/14 00:12:32 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:12:51 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.136.142:8302
2021/06/14 00:12:53 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2.dc1)
2021/06/14 00:12:53 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.136.142
2021/06/14 00:12:53 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/06/14 00:12:59 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.136.142:8301
2021/06/14 00:13:02 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.136.142
2021/06/14 00:13:02 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:14:53 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:57078->10.242.136.142:8301: i/o timeout
2021/06/14 00:15:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:57942->10.242.136.142:8301: i/o timeout
2021/06/14 00:15:45 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:16:18 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/06/14 00:16:21 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2)
2021/06/14 00:16:30 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:58758->10.242.136.142:8301: i/o timeout
2021/06/14 00:16:30 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:16:48 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:59076->10.242.136.142:8301: i/o timeout
2021/06/14 00:16:48 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:16:51 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:59094->10.242.136.142:8301: i/o timeout
2021/06/14 00:16:51 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:16:52 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/06/14 00:16:52 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.136.142
2021/06/14 00:16:52 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:16:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:39568->10.242.136.142:8302: i/o timeout
2021/06/14 00:16:54 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:17:02 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.136.142
2021/06/14 00:17:02 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:17:43 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/06/14 00:19:28 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:33644->10.242.136.142:8301: i/o timeout
2021/06/14 00:19:28 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:19:51 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:34030->10.242.136.142:8301: i/o timeout
2021/06/14 00:19:51 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:19:58 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:34180->10.242.136.142:8301: i/o timeout
2021/06/14 00:19:58 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:20:01 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:34214->10.242.136.142:8301: i/o timeout
2021/06/14 00:20:01 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:20:02 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.136.142
2021/06/14 00:20:02 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:20:03 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/06/14 00:20:04 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2)
2021/06/14 00:20:04 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.136.142
2021/06/14 00:20:04 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:20:04 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2.dc1)
2021/06/14 00:20:51 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:35082->10.242.136.142:8301: i/o timeout
2021/06/14 00:20:51 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:21:02 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2)
2021/06/14 00:21:07 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:35376->10.242.136.142:8301: i/o timeout
2021/06/14 00:21:07 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:21:11 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/06/14 00:21:11 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.136.142
2021/06/14 00:21:11 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:21:11 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:35440->10.242.136.142:8301: i/o timeout
2021/06/14 00:21:11 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:21:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:44296->10.242.136.142:8302: i/o timeout
2021/06/14 00:21:24 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:21:28 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.136.142
2021/06/14 00:21:28 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:21:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:35852->10.242.136.142:8301: i/o timeout
2021/06/14 00:21:34 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:21:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:35890->10.242.136.142:8301: i/o timeout
2021/06/14 00:21:37 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:21:38 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/06/14 00:21:38 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.136.142
2021/06/14 00:21:38 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:21:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:44584->10.242.136.142:8302: i/o timeout
2021/06/14 00:21:39 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:21:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:44820->10.242.136.142:8302: i/o timeout
2021/06/14 00:21:54 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:22:02 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.136.142:8301
2021/06/14 00:22:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:44998->10.242.136.142:8302: i/o timeout
2021/06/14 00:22:04 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:22:09 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/14 00:22:09 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.136.142
2021/06/14 00:22:09 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/06/14 00:22:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:45106->10.242.136.142:8302: i/o timeout
2021/06/14 00:22:14 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:22:41 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.136.142
2021/06/14 00:22:41 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.136.142
2021/06/14 00:22:41 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/06/14 00:22:41 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:22:41 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2.dc1)
2021/06/14 00:24:55 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:39322->10.242.136.142:8301: i/o timeout
2021/06/14 00:24:55 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:26:26 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:40884->10.242.136.142:8301: i/o timeout
2021/06/14 00:26:29 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:49566->10.242.136.142:8302: i/o timeout
2021/06/14 00:26:29 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:26:30 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:40970->10.242.136.142:8301: i/o timeout
2021/06/14 00:26:30 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:26:31 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/06/14 00:26:31 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.136.142
2021/06/14 00:26:31 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:26:38 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.136.142
2021/06/14 00:26:38 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:26:39 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2)
2021/06/14 00:26:43 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:41186->10.242.136.142:8301: i/o timeout
2021/06/14 00:26:43 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:26:44 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.136.142
2021/06/14 00:26:44 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:26:44 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:49830->10.242.136.142:8302: i/o timeout
2021/06/14 00:26:44 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:26:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:50012->10.242.136.142:8302: i/o timeout
2021/06/14 00:26:54 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:27:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:50192->10.242.136.142:8302: i/o timeout
2021/06/14 00:27:04 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:27:06 [ERR] yamux: keepalive failed: i/o deadline reached
2021/06/14 00:27:06 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.136.142:48798
2021/06/14 00:27:12 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.136.142:8301
2021/06/14 00:27:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:50352->10.242.136.142:8302: i/o timeout
2021/06/14 00:27:14 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:27:14 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/06/14 00:27:14 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.136.142
2021/06/14 00:27:14 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/06/14 00:27:28 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.136.142
2021/06/14 00:27:28 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:27:28 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.136.142
2021/06/14 00:27:28 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/06/14 00:33:46 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:48458->10.242.136.142:8301: i/o timeout
2021/06/14 00:33:46 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:33:50 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:48536->10.242.136.142:8301: i/o timeout
2021/06/14 00:33:50 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:33:59 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:48692->10.242.136.142:8301: i/o timeout
2021/06/14 00:33:59 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:34:02 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:48716->10.242.136.142:8301: i/o timeout
2021/06/14 00:34:03 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:48768->10.242.136.142:8301: i/o timeout
2021/06/14 00:34:03 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:34:07 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:48840->10.242.136.142:8301: i/o timeout
2021/06/14 00:34:07 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:34:08 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.136.142
2021/06/14 00:34:08 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:34:08 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2)
2021/06/14 00:34:10 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.136.142
2021/06/14 00:34:10 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:34:11 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:48902->10.242.136.142:8301: i/o timeout
2021/06/14 00:34:11 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:34:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:48924->10.242.136.142:8301: i/o timeout
2021/06/14 00:34:14 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:34:15 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/06/14 00:34:15 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.136.142
2021/06/14 00:34:15 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:34:19 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.136.142
2021/06/14 00:34:19 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:34:21 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:49086->10.242.136.142:8301: i/o timeout
2021/06/14 00:34:21 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:34:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:49132->10.242.136.142:8301: i/o timeout
2021/06/14 00:34:24 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:34:27 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:49198->10.242.136.142:8301: i/o timeout
2021/06/14 00:34:27 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:34:30 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:49232->10.242.136.142:8301: i/o timeout
2021/06/14 00:34:30 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/06/14 00:34:31 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/06/14 00:34:31 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.136.142
2021/06/14 00:34:31 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)
2021/06/14 00:34:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.28.14:57950->10.242.136.142:8302: i/o timeout
2021/06/14 00:34:34 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/06/14 00:34:37 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2)
2021/06/14 00:34:37 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.136.142
2021/06/14 00:34:37 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.136.142:8300) (DC: dc1)