By type
+ CONSUL_BIND=
+ [ -n ]
+ CONSUL_CLIENT=
+ [ -n ]
+ CONSUL_DATA_DIR=/consul/data
+ CONSUL_CONFIG_DIR=/consul/config
+ [ -n ]
+ [ a = - ]
+ [ agent = agent ]
+ shift
+ set -- consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui
+ [ consul = consul ]
+ stat -c %u /consul/data
+ id -u consul
+ [ 100 != 100 ]
+ stat -c %u /consul/config
+ id -u consul
+ [ 100 != 100 ]
+ [ ! -z ]
+ exec consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui
bootstrap_expect > 0: expecting 3 servers
==> Starting Consul agent...
==> Consul agent running!
Version: 'v1.0.6'
Node ID: '9fcb14a9-100e-2d75-3e7a-6fe772ff1f8f'
Node name: 'dev-consul-server-1'
Datacenter: 'dc1' (Segment: '')
Server: true (Bootstrap: false)
Client Addr: [0.0.0.0] (HTTP: 8500, HTTPS: -1, DNS: 8600)
Cluster Addr: 10.242.32.71 (LAN: 8301, WAN: 8302)
Encrypt: Gossip: false, TLS-Outgoing: false, TLS-Incoming: false
==> Log data will now stream in as it occurs:
2021/04/25 22:39:54 [INFO] raft: Initial configuration (index=0): []
2021/04/25 22:39:54 [INFO] raft: Node at 10.242.32.71:8300 [Follower] entering Follower state (Leader: "")
2021/04/25 22:39:54 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.32.71
2021/04/25 22:39:54 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.32.71
2021/04/25 22:39:54 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan"
2021/04/25 22:39:54 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.32.71:8300) (DC: dc1)
2021/04/25 22:39:54 [INFO] agent: Started DNS server 0.0.0.0:8600 (udp)
2021/04/25 22:39:54 [INFO] agent: Started DNS server 0.0.0.0:8600 (tcp)
2021/04/25 22:39:54 [INFO] agent: Started HTTP server on [::]:8500 (tcp)
2021/04/25 22:39:54 [INFO] agent: started state syncer
2021/04/25 22:39:54 [INFO] agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce os scaleway softlayer
2021/04/25 22:39:54 [INFO] agent: Joining LAN cluster...
2021/04/25 22:39:54 [INFO] agent: (LAN) joining: [dev-consul-server-0.consul-server dev-consul-server-1.consul-server dev-consul-server-2.consul-server]
2021/04/25 22:39:54 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.187.2
2021/04/25 22:39:54 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.187.2:8300) (DC: dc1)
2021/04/25 22:39:54 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.187.2
2021/04/25 22:39:54 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"
2021/04/25 22:39:54 [WARN] memberlist: Failed to resolve dev-consul-server-1.consul-server: lookup dev-consul-server-1.consul-server on 10.96.0.10:53: no such host
2021/04/25 22:39:54 [WARN] memberlist: Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host
2021/04/25 22:39:54 [INFO] agent: (LAN) joined: 1 Err:
2021/04/25 22:39:54 [INFO] agent: Join LAN completed. Synced with 1 initial agents
2021/04/25 22:39:56 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 22:40:01 [ERR] agent: failed to sync remote state: No cluster leader
2021/04/25 22:40:03 [WARN] raft: no known peers, aborting election
==> Failed to check for updates: Get https://checkpoint-api.hashicorp.com/v1/check/consul?arch=amd64&os=linux&signature=8cf9da2c-5615-327b-635c-3594cecf6c33&version=1.0.6: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/25 22:40:13 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 22:40:13 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 22:40:13 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 22:40:13 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 22:40:14 [INFO] consul: Existing Raft peers reported by dev-consul-server-0, disabling bootstrap mode
2021/04/25 22:40:17 [DEBUG] raft-net: 10.242.32.71:8300 accepted connection from: 10.242.187.2:59282
2021/04/25 22:40:17 [DEBUG] raft-net: 10.242.32.71:8300 accepted connection from: 10.242.187.2:59284
2021/04/25 22:40:17 [WARN] raft: Failed to get previous log: 1 log not found (last: 0)
2021/04/25 22:40:17 [INFO] consul: New leader elected: dev-consul-server-0
2021/04/25 22:40:19 [INFO] agent: Synced node info
2021/04/25 22:59:21 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:58848->10.242.93.140:8301: i/o timeout
2021/04/25 22:59:21 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 22:59:22 [WARN] memberlist: Refuting a suspect message (from: dev-consul-7467bf7b46-ww995)
2021/04/25 23:01:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:32886->10.242.93.140:8301: i/o timeout
2021/04/25 23:01:37 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:01:52 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:33086->10.242.93.140:8301: i/o timeout
2021/04/25 23:01:52 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:01:59 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:33174->10.242.93.140:8301: i/o timeout
2021/04/25 23:01:59 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:02:01 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:02:02 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/04/25 23:02:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:58350->10.242.93.149:8301: i/o timeout
2021/04/25 23:02:04 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:02:06 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:58358->10.242.93.149:8301: i/o timeout
2021/04/25 23:02:06 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:02:08 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:58400->10.242.93.149:8301: i/o timeout
2021/04/25 23:02:08 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:02:11 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:58452->10.242.93.149:8301: i/o timeout
2021/04/25 23:02:11 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:02:13 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:58476->10.242.93.149:8301: i/o timeout
2021/04/25 23:02:13 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:02:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:43786->10.242.93.149:8302: i/o timeout
2021/04/25 23:02:14 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:02:15 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (1 peer confirmations)
2021/04/25 23:02:15 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:02:15 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:02:16 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:58512->10.242.93.149:8301: i/o timeout
2021/04/25 23:02:16 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:02:23 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:02:23 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.93.140:33396
2021/04/25 23:02:24 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:02:29 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:43918->10.242.93.149:8302: i/o timeout
2021/04/25 23:02:29 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:02:35 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:02:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:33662->10.242.93.140:8301: i/o timeout
2021/04/25 23:02:37 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:02:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:44108->10.242.93.149:8302: i/o timeout
2021/04/25 23:02:39 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:02:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:33690->10.242.93.140:8301: i/o timeout
2021/04/25 23:02:39 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:02:41 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:33732->10.242.93.140:8301: i/o timeout
2021/04/25 23:02:41 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:02:43 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:33740->10.242.93.140:8301: i/o timeout
2021/04/25 23:02:43 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:02:44 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/25 23:02:44 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:02:44 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:02:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:33770->10.242.93.140:8301: i/o timeout
2021/04/25 23:02:45 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:02:45 [ERR] memberlist: failed to receive: read tcp 10.242.32.71:8301->10.242.93.149:54440: i/o timeout from=10.242.93.149:54440
2021/04/25 23:02:45 [ERR] memberlist: Failed to send error: write tcp 10.242.32.71:8301->10.242.93.149:54440: i/o timeout from=10.242.93.149:54440
2021/04/25 23:02:48 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:33812->10.242.93.140:8301: i/o timeout
2021/04/25 23:02:48 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:02:48 [INFO] memberlist: Marking dev-consul-7467bf7b46-ww995 as failed, suspect timeout reached (1 peer confirmations)
2021/04/25 23:02:48 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:02:48 [ERR] memberlist: failed to receive: read tcp 10.242.32.71:8301->10.242.93.140:52062: i/o timeout from=10.242.93.140:52062
2021/04/25 23:02:48 [ERR] memberlist: Failed to send error: write tcp 10.242.32.71:8301->10.242.93.140:52062: i/o timeout from=10.242.93.140:52062
2021/04/25 23:02:57 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:03:04 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:03:09 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:03:09 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:03:09 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:03:09 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:03:12 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:59230->10.242.93.149:8301: i/o timeout
2021/04/25 23:03:12 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:03:15 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:59262->10.242.93.149:8301: i/o timeout
2021/04/25 23:03:15 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:03:17 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:59290->10.242.93.149:8301: i/o timeout
2021/04/25 23:03:17 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:03:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:44624->10.242.93.149:8302: i/o timeout
2021/04/25 23:03:19 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:03:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:59306->10.242.93.149:8301: i/o timeout
2021/04/25 23:03:19 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:03:21 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:59358->10.242.93.149:8301: i/o timeout
2021/04/25 23:03:21 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:03:22 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (1 peer confirmations)
2021/04/25 23:03:22 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:03:22 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:03:29 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:44780->10.242.93.149:8302: i/o timeout
2021/04/25 23:03:29 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:03:31 [ERR] memberlist: failed to receive: read tcp 10.242.32.71:8301->10.242.93.149:54784: i/o timeout from=10.242.93.149:54784
2021/04/25 23:03:31 [ERR] memberlist: Failed to send error: write tcp 10.242.32.71:8301->10.242.93.149:54784: i/o timeout from=10.242.93.149:54784
2021/04/25 23:03:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:44906->10.242.93.149:8302: i/o timeout
2021/04/25 23:03:39 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:03:39 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:03:49 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/25 23:03:49 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:03:49 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:03:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:45114->10.242.93.149:8302: i/o timeout
2021/04/25 23:03:54 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:04:19 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:04:59 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:05:39 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:05:54 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:06:19 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:06:54 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:06:59 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:07:39 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:07:54 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:08:19 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:08:24 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-fdl7b 10.242.32.109
2021/04/25 23:08:47 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:08:54 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:08:59 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:09:39 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:09:54 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:10:10 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:10:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:40462->10.242.93.140:8301: i/o timeout
2021/04/25 23:10:14 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:10:18 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:40528->10.242.93.140:8301: i/o timeout
2021/04/25 23:10:18 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:10:18 [INFO] memberlist: Marking dev-consul-7467bf7b46-ww995 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:10:18 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:10:19 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:10:25 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2)
2021/04/25 23:10:25 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:10:25 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:10:27 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:10:27 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:10:27 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:10:29 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:37606->10.242.93.149:8301: i/o timeout
2021/04/25 23:10:29 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:10:33 [WARN] memberlist: Was able to connect to dev-consul-7467bf7b46-ww995 but other probes failed, network may be misconfigured
2021/04/25 23:10:34 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:10:34 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:10:34 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:10:35 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/04/25 23:10:37 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:10:37 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:10:38 [WARN] memberlist: Was able to connect to dev-consul-7467bf7b46-ww995 but other probes failed, network may be misconfigured
2021/04/25 23:10:40 [WARN] memberlist: Was able to connect to dev-consul-7467bf7b46-ww995 but other probes failed, network may be misconfigured
2021/04/25 23:10:41 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:37886->10.242.93.149:8301: i/o timeout
2021/04/25 23:10:41 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:10:43 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:10:43 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:10:43 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:10:43 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:10:46 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:37956->10.242.93.149:8301: i/o timeout
2021/04/25 23:10:46 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:10:50 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:38002->10.242.93.149:8301: i/o timeout
2021/04/25 23:10:50 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:10:50 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:10:50 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:10:50 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:10:53 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:10:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:51632->10.242.93.149:8302: i/o timeout
2021/04/25 23:10:54 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:10:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:41192->10.242.93.140:8301: i/o timeout
2021/04/25 23:10:54 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:10:54 [INFO] memberlist: Marking dev-consul-7467bf7b46-ww995 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:10:54 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:11:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:51838->10.242.93.149:8302: i/o timeout
2021/04/25 23:11:04 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:11:14 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:11:14 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:11:15 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:11:17 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:38610->10.242.93.149:8301: i/o timeout
2021/04/25 23:11:17 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:11:21 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:41754->10.242.93.140:8301: i/o timeout
2021/04/25 23:11:21 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:11:21 [INFO] memberlist: Marking dev-consul-7467bf7b46-ww995 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:11:21 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:11:21 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:11:21 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:11:22 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:11:22 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:11:29 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:12:42 [WARN] memberlist: Refuting a suspect message (from: dev-consul-7467bf7b46-ww995)
2021/04/25 23:12:46 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:40556->10.242.93.149:8301: i/o timeout
2021/04/25 23:12:46 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:12:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:40602->10.242.93.149:8301: i/o timeout
2021/04/25 23:12:49 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:12:51 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:43768->10.242.93.140:8301: i/o timeout
2021/04/25 23:12:51 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:12:51 [INFO] memberlist: Marking dev-consul-7467bf7b46-ww995 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:12:51 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:12:53 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:12:53 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:12:53 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:12:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:40660->10.242.93.149:8301: i/o timeout
2021/04/25 23:12:54 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:13:03 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:13:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:54534->10.242.93.149:8302: i/o timeout
2021/04/25 23:13:04 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:13:04 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:13:06 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:44188->10.242.93.140:8301: i/o timeout
2021/04/25 23:13:06 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:13:09 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:44248->10.242.93.140:8301: i/o timeout
2021/04/25 23:13:09 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:13:10 [INFO] memberlist: Marking dev-consul-7467bf7b46-ww995 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:13:10 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:13:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:54678->10.242.93.149:8302: i/o timeout
2021/04/25 23:13:14 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:13:16 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:13:16 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:13:17 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:41326->10.242.93.149:8301: i/o timeout
2021/04/25 23:13:17 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:13:20 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:41374->10.242.93.149:8301: i/o timeout
2021/04/25 23:13:20 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:13:21 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:13:21 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:13:23 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:13:23 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.93.140:37282
2021/04/25 23:13:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:54988->10.242.93.149:8302: i/o timeout
2021/04/25 23:13:24 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:13:30 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:13:30 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:13:35 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:14:15 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:14:38 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:14:38 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:14:40 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:42968->10.242.93.149:8301: i/o timeout
2021/04/25 23:14:40 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:14:43 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:14:43 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:14:44 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:43088->10.242.93.149:8301: i/o timeout
2021/04/25 23:14:44 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:14:54 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:14:55 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:15:04 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:15:04 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:15:10 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:15:10 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:15:11 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/04/25 23:15:13 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:15:16 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:46844->10.242.93.140:8301: i/o timeout
2021/04/25 23:15:16 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:15:25 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:47010->10.242.93.140:8301: i/o timeout
2021/04/25 23:15:25 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:15:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:47288->10.242.93.140:8301: i/o timeout
2021/04/25 23:15:39 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:16:07 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:44738->10.242.93.149:8301: i/o timeout
2021/04/25 23:16:07 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:16:07 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:16:13 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:44872->10.242.93.149:8301: i/o timeout
2021/04/25 23:16:13 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:16:15 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:16:15 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:16:15 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:16:16 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:44942->10.242.93.149:8301: i/o timeout
2021/04/25 23:16:16 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:16:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:58620->10.242.93.149:8302: i/o timeout
2021/04/25 23:16:24 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:16:28 [ERR] memberlist: failed to receive: read tcp 10.242.32.71:8301->10.242.93.140:60306: i/o timeout from=10.242.93.140:60306
2021/04/25 23:16:28 [ERR] memberlist: Failed to send error: write tcp 10.242.32.71:8301->10.242.93.140:60306: i/o timeout from=10.242.93.140:60306
2021/04/25 23:16:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:58720->10.242.93.149:8302: i/o timeout
2021/04/25 23:16:34 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:16:35 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:16:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:59132->10.242.93.149:8302: i/o timeout
2021/04/25 23:16:49 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:16:49 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/25 23:16:49 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:16:49 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:17:09 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:17:15 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:17:32 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:17:32 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:17:32 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:17:32 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:17:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:46556->10.242.93.149:8301: i/o timeout
2021/04/25 23:17:37 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:17:37 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:17:37 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:17:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:60124->10.242.93.149:8302: i/o timeout
2021/04/25 23:17:39 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:17:40 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:46574->10.242.93.149:8301: i/o timeout
2021/04/25 23:17:40 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:17:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:60352->10.242.93.149:8302: i/o timeout
2021/04/25 23:17:49 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:17:55 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:18:02 [ERR] memberlist: failed to receive: read tcp 10.242.32.71:8302->10.242.93.149:50556: i/o timeout from=10.242.93.149:50556
2021/04/25 23:18:02 [ERR] memberlist: Failed to send error: write tcp 10.242.32.71:8302->10.242.93.149:50556: i/o timeout from=10.242.93.149:50556
2021/04/25 23:18:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:60656->10.242.93.149:8302: i/o timeout
2021/04/25 23:18:04 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:18:09 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/25 23:18:09 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:18:09 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:18:09 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:18:12 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:18:12 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:18:12 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.93.149:49720
2021/04/25 23:18:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:60750->10.242.93.149:8302: i/o timeout
2021/04/25 23:18:14 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:18:35 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:19:15 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:19:45 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:19:45 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:19:49 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2.dc1)
2021/04/25 23:19:55 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:20:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:34712->10.242.93.149:8302: i/o timeout
2021/04/25 23:20:04 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:20:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:35006->10.242.93.149:8302: i/o timeout
2021/04/25 23:20:14 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:20:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:35218->10.242.93.149:8302: i/o timeout
2021/04/25 23:20:24 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:20:24 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/25 23:20:24 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:20:24 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:20:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:35336->10.242.93.149:8302: i/o timeout
2021/04/25 23:20:34 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:20:35 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:20:39 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:21:15 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:21:25 [ERR] memberlist: failed to receive: read tcp 10.242.32.71:8301->10.242.93.149:36190: i/o timeout from=10.242.93.149:36190
2021/04/25 23:21:25 [ERR] memberlist: Failed to send error: write tcp 10.242.32.71:8301->10.242.93.149:36190: i/o timeout from=10.242.93.149:36190
2021/04/25 23:21:39 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:22:25 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:22:51 [DEBUG] raft-net: 10.242.32.71:8300 accepted connection from: 10.242.93.149:51040
2021/04/25 23:22:51 [WARN] raft: Rejecting vote request from 10.242.93.149:8300 since we have a leader: 10.242.187.2:8300
2021/04/25 23:22:51 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:22:51 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:22:51 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:22:51 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:22:51 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:22:53 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:56080->10.242.93.140:8301: i/o timeout
2021/04/25 23:22:53 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:22:57 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:53026->10.242.93.149:8301: i/o timeout
2021/04/25 23:22:57 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:22:57 [WARN] raft: Heartbeat timeout from "10.242.187.2:8300" reached, starting election
2021/04/25 23:22:57 [INFO] raft: Node at 10.242.32.71:8300 [Candidate] entering Candidate state in term 3
2021/04/25 23:22:57 [INFO] raft: Election won. Tally: 2
2021/04/25 23:22:57 [INFO] raft: Node at 10.242.32.71:8300 [Leader] entering Leader state
2021/04/25 23:22:57 [INFO] raft: Added peer f66dacd5-df84-469e-7a9b-4103153d1fdc, starting replication
2021/04/25 23:22:57 [INFO] raft: Added peer e524e1aa-4527-3cd0-d6fe-8da75eba4af0, starting replication
2021/04/25 23:22:57 [INFO] consul: cluster leadership acquired
2021/04/25 23:22:57 [INFO] consul: New leader elected: dev-consul-server-1
2021/04/25 23:22:57 [INFO] raft: pipelining replication to peer {Voter e524e1aa-4527-3cd0-d6fe-8da75eba4af0 10.242.187.2:8300}
2021/04/25 23:22:57 [INFO] consul: member 'dev-consul-7467bf7b46-ww995' joined, marking health alive
2021/04/25 23:22:57 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive
2021/04/25 23:22:58 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:22:58 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:22:58 [INFO] consul: member 'dev-consul-server-2' failed, marking health critical
2021/04/25 23:22:59 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:23:00 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:56172->10.242.93.140:8301: i/o timeout
2021/04/25 23:23:00 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:23:00 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/25 23:23:00 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:23:00 [INFO] consul: member 'dev-consul-7467bf7b46-ww995' failed, marking health critical
2021/04/25 23:23:01 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 2.501289336s
2021/04/25 23:23:01 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:03 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:03 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 4.950957431s
2021/04/25 23:23:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:38494->10.242.93.149:8302: i/o timeout
2021/04/25 23:23:04 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:23:05 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:23:05 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:05 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 7.386266823s
2021/04/25 23:23:07 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:47012->10.242.93.149:8300: i/o timeout
2021/04/25 23:23:07 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:07 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:23:09 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:09 [ERR] raft: Failed to heartbeat to 10.242.93.149:8300: read tcp 10.242.32.71:47008->10.242.93.149:8300: i/o timeout
2021/04/25 23:23:10 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:23:11 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:12 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:23:13 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:13 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 2.50018086s
2021/04/25 23:23:15 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:16 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 4.940611442s
2021/04/25 23:23:17 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:17 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:47240->10.242.93.149:8300: i/o timeout
2021/04/25 23:23:17 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:23:18 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 7.373010621s
2021/04/25 23:23:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:38800->10.242.93.149:8302: i/o timeout
2021/04/25 23:23:19 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:23:19 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:21 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:22 [ERR] raft: Failed to heartbeat to 10.242.93.149:8300: read tcp 10.242.32.71:47308->10.242.93.149:8300: i/o timeout
2021/04/25 23:23:22 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:23:23 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:25 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:27 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:27 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:47444->10.242.93.149:8300: i/o timeout
2021/04/25 23:23:27 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:23:29 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:39016->10.242.93.149:8302: i/o timeout
2021/04/25 23:23:29 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:23:29 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:31 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:32 [ERR] raft: Failed to heartbeat to 10.242.93.149:8300: read tcp 10.242.32.71:47552->10.242.93.149:8300: i/o timeout
2021/04/25 23:23:33 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:23:33 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:35 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:37 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:37 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:47662->10.242.93.149:8300: i/o timeout
2021/04/25 23:23:37 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:23:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:39212->10.242.93.149:8302: i/o timeout
2021/04/25 23:23:39 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:23:39 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:39 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:23:39 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/25 23:23:42 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/25 23:23:43 [ERR] raft: Failed to heartbeat to 10.242.93.149:8300: read tcp 10.242.32.71:47790->10.242.93.149:8300: i/o timeout
2021/04/25 23:23:43 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:44 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:23:45 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:23:45 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:46 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:23:47 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:47 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:47860->10.242.93.149:8300: i/o timeout
2021/04/25 23:23:47 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:23:47 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 2.500161905s
2021/04/25 23:23:49 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:50 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 4.996740969s
2021/04/25 23:23:51 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:23:51 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:23:51 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive
2021/04/25 23:23:51 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:53 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:39512->10.242.93.149:8302: i/o timeout
2021/04/25 23:23:54 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:23:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:54224->10.242.93.149:8301: i/o timeout
2021/04/25 23:23:54 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:23:55 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:57 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:57 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:48088->10.242.93.149:8300: i/o timeout
2021/04/25 23:23:58 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:23:58 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:23:58 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:23:58 [INFO] consul: member 'dev-consul-server-2' failed, marking health critical
2021/04/25 23:23:58 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:23:59 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/25 23:23:59 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:23:59 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:54352->10.242.93.149:8301: i/o timeout
2021/04/25 23:23:59 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:23:59 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:23:59 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:23:59 [INFO] consul: member 'dev-consul-7467bf7b46-ww995' joined, marking health alive
2021/04/25 23:23:59 [ERR] memberlist: failed to receive: read tcp 10.242.32.71:8301->10.242.93.149:36978: i/o timeout from=10.242.93.149:36978
2021/04/25 23:23:59 [ERR] memberlist: Failed to send error: write tcp 10.242.32.71:8301->10.242.93.149:36978: i/o timeout from=10.242.93.149:36978
2021/04/25 23:23:59 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:23:59 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:24:00 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:24:01 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:24:01 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:02 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:24:02 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:57518->10.242.93.140:8301: i/o timeout
2021/04/25 23:24:02 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:24:02 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:24:03 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:24:03 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:39634->10.242.93.149:8302: i/o timeout
2021/04/25 23:24:04 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:24:04 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:24:04 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:24:04 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:24:04 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive
2021/04/25 23:24:05 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:06 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/04/25 23:24:06 [INFO] memberlist: Marking dev-consul-7467bf7b46-ww995 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:24:06 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:24:06 [INFO] consul: member 'dev-consul-7467bf7b46-ww995' failed, marking health critical
2021/04/25 23:24:07 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:57632->10.242.93.140:8301: i/o timeout
2021/04/25 23:24:07 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:24:07 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:07 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:48294->10.242.93.149:8300: i/o timeout
2021/04/25 23:24:09 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:09 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 2.500290529s
2021/04/25 23:24:10 [ERR] memberlist: failed to receive: read tcp 10.242.32.71:8301->10.242.93.140:34680: i/o timeout from=10.242.93.140:34680
2021/04/25 23:24:10 [ERR] memberlist: Failed to send error: write tcp 10.242.32.71:8301->10.242.93.140:34680: i/o timeout from=10.242.93.140:34680
2021/04/25 23:24:11 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:54542->10.242.93.149:8301: i/o timeout
2021/04/25 23:24:11 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:24:11 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:12 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 4.957659458s
2021/04/25 23:24:13 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:13 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:24:13 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:24:13 [INFO] consul: member 'dev-consul-server-2' failed, marking health critical
2021/04/25 23:24:14 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 7.402752525s
2021/04/25 23:24:15 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:17 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:18 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:48026->10.242.93.149:8300: i/o timeout
2021/04/25 23:24:18 [ERR] raft: Failed to heartbeat to 10.242.93.149:8300: read tcp 10.242.32.71:48500->10.242.93.149:8300: i/o timeout
2021/04/25 23:24:18 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:24:19 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:24:19 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:21 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:24:21 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:23 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:25 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:27 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:28 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:48736->10.242.93.149:8300: i/o timeout
2021/04/25 23:24:29 [ERR] raft: Failed to heartbeat to 10.242.93.149:8300: read tcp 10.242.32.71:48740->10.242.93.149:8300: i/o timeout
2021/04/25 23:24:29 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:29 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:24:30 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:24:31 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:33 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:35 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:37 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:39 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:39 [ERR] raft: Failed to heartbeat to 10.242.93.149:8300: read tcp 10.242.32.71:48968->10.242.93.149:8300: i/o timeout
2021/04/25 23:24:40 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:48974->10.242.93.149:8300: i/o timeout
2021/04/25 23:24:40 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:24:41 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:42 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:24:43 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:45 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:47 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:49 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:50 [ERR] raft: Failed to heartbeat to 10.242.93.149:8300: read tcp 10.242.32.71:49158->10.242.93.149:8300: i/o timeout
2021/04/25 23:24:51 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:51 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:24:52 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:24:52 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/25 23:24:52 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:49222->10.242.93.149:8300: i/o timeout
2021/04/25 23:24:54 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/25 23:24:55 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:57 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:24:57 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:24:59 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:01 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:01 [ERR] raft: Failed to heartbeat to 10.242.93.149:8300: read tcp 10.242.32.71:49390->10.242.93.149:8300: i/o timeout
2021/04/25 23:25:02 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:25:03 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:05 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:07 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:07 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:49512->10.242.93.149:8300: i/o timeout
2021/04/25 23:25:09 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:09 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:25:11 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:12 [ERR] raft: Failed to heartbeat to 10.242.93.149:8300: read tcp 10.242.32.71:49640->10.242.93.149:8300: i/o timeout
2021/04/25 23:25:13 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:25:13 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:15 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:17 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:18 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:25:19 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:21 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:23 [ERR] raft: Failed to heartbeat to 10.242.93.149:8300: read tcp 10.242.32.71:49846->10.242.93.149:8300: i/o timeout
2021/04/25 23:25:23 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:24 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:25:25 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:27 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:28 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:49946->10.242.93.149:8300: i/o timeout
2021/04/25 23:25:29 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:31 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:25:31 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:33 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:33 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:25:33 [WARN] consul: error getting server health from "dev-consul-server-2": rpc error making call: EOF
2021/04/25 23:25:34 [ERR] raft: Failed to heartbeat to 10.242.93.149:8300: read tcp 10.242.32.71:50068->10.242.93.149:8300: i/o timeout
2021/04/25 23:25:35 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:25:36 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/25 23:25:37 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:38 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:25:39 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:41 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:43 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:45 [ERR] raft: Failed to heartbeat to 10.242.93.149:8300: read tcp 10.242.32.71:50294->10.242.93.149:8300: i/o timeout
2021/04/25 23:25:45 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:47 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:25:47 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:48 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:50342->10.242.93.149:8300: i/o timeout
2021/04/25 23:25:49 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:51 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:53 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:55 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:57 [ERR] raft: Failed to heartbeat to 10.242.93.149:8300: read tcp 10.242.32.71:50568->10.242.93.149:8300: i/o timeout
2021/04/25 23:25:57 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:25:58 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:25:59 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:00 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:26:01 [WARN] raft: AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300} rejected, sending older logs (next: 793)
2021/04/25 23:26:01 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:26:01 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:26:02 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/25 23:26:03 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:26:03 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:26:03 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:03 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 2.500172731s
2021/04/25 23:26:05 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:06 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 4.994505673s
2021/04/25 23:26:07 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:08 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 7.474698352s
2021/04/25 23:26:09 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:42316->10.242.93.149:8302: i/o timeout
2021/04/25 23:26:09 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:26:09 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:10 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2)
2021/04/25 23:26:10 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:26:10 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:26:10 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive
2021/04/25 23:26:11 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:26:11 [INFO] consul: member 'dev-consul-7467bf7b46-ww995' joined, marking health alive
2021/04/25 23:26:12 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:60182->10.242.93.140:8301: i/o timeout
2021/04/25 23:26:12 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:26:12 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/25 23:26:13 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:13 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 2.500233167s
2021/04/25 23:26:15 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:60204->10.242.93.140:8301: i/o timeout
2021/04/25 23:26:15 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:26:15 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:16 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 4.982724664s
2021/04/25 23:26:17 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:18 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:57184->10.242.93.149:8301: i/o timeout
2021/04/25 23:26:18 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:26:18 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:26:18 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:26:18 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:26:18 [INFO] consul: member 'dev-consul-server-2' failed, marking health critical
2021/04/25 23:26:18 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 7.426248181s
2021/04/25 23:26:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:42524->10.242.93.149:8302: i/o timeout
2021/04/25 23:26:19 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:26:19 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:20 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:26:20 [INFO] consul: member 'dev-consul-7467bf7b46-ww995' failed, marking health critical
2021/04/25 23:26:21 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:50784->10.242.93.149:8300: i/o timeout
2021/04/25 23:26:21 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:26:21 [INFO] raft: pipelining replication to peer {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}
2021/04/25 23:26:21 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:60398->10.242.93.140:8301: i/o timeout
2021/04/25 23:26:21 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:26:21 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:21 [ERR] raft: Failed to heartbeat to 10.242.93.149:8300: read tcp 10.242.32.71:50832->10.242.93.149:8300: i/o timeout
2021/04/25 23:26:22 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:26:23 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:25 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:26 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:26:27 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:28 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:26:29 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:26:29 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:30 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:26:31 [INFO] raft: aborting pipeline replication to peer {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}
2021/04/25 23:26:31 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:26:31 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:33 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:33 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 2.500224242s
2021/04/25 23:26:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:42824->10.242.93.149:8302: i/o timeout
2021/04/25 23:26:34 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:26:35 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:35 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 4.955996369s
2021/04/25 23:26:37 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:37 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:26:39 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 2.50020407s
2021/04/25 23:26:39 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:41 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:51454->10.242.93.149:8300: i/o timeout
2021/04/25 23:26:41 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:26:41 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:41 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 4.97246316s
2021/04/25 23:26:43 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:44 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 7.430097809s
2021/04/25 23:26:45 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:46 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:26:46 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:26:46 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive
2021/04/25 23:26:47 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:48 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 2.500192441s
2021/04/25 23:26:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:43140->10.242.93.149:8302: i/o timeout
2021/04/25 23:26:49 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:26:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:57836->10.242.93.149:8301: i/o timeout
2021/04/25 23:26:49 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:26:49 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:51 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:51642->10.242.93.149:8300: i/o timeout
2021/04/25 23:26:51 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 4.99492878s
2021/04/25 23:26:51 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:52 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:26:52 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:26:52 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:26:52 [INFO] consul: member 'dev-consul-server-2' failed, marking health critical
2021/04/25 23:26:53 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:57924->10.242.93.149:8301: i/o timeout
2021/04/25 23:26:53 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:26:53 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:53 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 7.460248792s
2021/04/25 23:26:55 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:56 [ERR] raft: Failed to heartbeat to 10.242.93.149:8300: read tcp 10.242.32.71:51266->10.242.93.149:8300: i/o timeout
2021/04/25 23:26:57 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:26:57 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:26:59 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:43340->10.242.93.149:8302: i/o timeout
2021/04/25 23:26:59 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:26:59 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:01 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:51870->10.242.93.149:8300: i/o timeout
2021/04/25 23:27:01 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:27:01 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:03 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:04 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/25 23:27:04 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:27:04 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:27:04 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:27:04 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:27:05 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:07 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:07 [ERR] raft: Failed to heartbeat to 10.242.93.149:8300: read tcp 10.242.32.71:51996->10.242.93.149:8300: i/o timeout
2021/04/25 23:27:08 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:27:08 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:27:08 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.93.149:52508
2021/04/25 23:27:09 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:43464->10.242.93.149:8302: i/o timeout
2021/04/25 23:27:09 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:27:09 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:11 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:52090->10.242.93.149:8300: i/o timeout
2021/04/25 23:27:11 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:27:11 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:27:11 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:13 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:15 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:17 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:18 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:27:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:43800->10.242.93.149:8302: i/o timeout
2021/04/25 23:27:19 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:27:20 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/25 23:27:20 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded
2021/04/25 23:27:20 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded
2021/04/25 23:27:20 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 2.500216579s
2021/04/25 23:27:21 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:52316->10.242.93.149:8300: i/o timeout
2021/04/25 23:27:21 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:27:21 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:23 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 4.922707985s
2021/04/25 23:27:23 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:25 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:25 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 7.389856732s
2021/04/25 23:27:27 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:28 [ERR] raft: Failed to heartbeat to 10.242.93.149:8300: read tcp 10.242.32.71:52258->10.242.93.149:8300: i/o timeout
2021/04/25 23:27:29 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:29 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:27:30 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:27:30 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:27:30 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive
2021/04/25 23:27:31 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:52524->10.242.93.149:8300: i/o timeout
2021/04/25 23:27:31 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:32 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 2.50022684s
2021/04/25 23:27:33 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:44116->10.242.93.149:8302: i/o timeout
2021/04/25 23:27:34 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:27:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:58826->10.242.93.149:8301: i/o timeout
2021/04/25 23:27:34 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:27:35 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 4.952491256s
2021/04/25 23:27:35 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:35 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:27:35 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:27:35 [INFO] consul: member 'dev-consul-server-2' failed, marking health critical
2021/04/25 23:27:37 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:37 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 7.403812335s
2021/04/25 23:27:38 [WARN] memberlist: Refuting a dead message (from: dev-consul-7467bf7b46-ww995)
2021/04/25 23:27:39 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:39 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:27:41 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 2.500208544s
2021/04/25 23:27:41 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:41 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:52754->10.242.93.149:8300: i/o timeout
2021/04/25 23:27:42 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:27:43 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:43 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 4.997270067s
2021/04/25 23:27:44 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:44208->10.242.93.149:8302: i/o timeout
2021/04/25 23:27:44 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:27:44 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/25 23:27:44 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:27:44 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:27:45 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:46 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 7.431229961s
2021/04/25 23:27:47 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:49 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:27:49 [INFO] consul: member 'dev-consul-7467bf7b46-ww995' joined, marking health alive
2021/04/25 23:27:49 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:49 [ERR] raft: Failed to heartbeat to 10.242.93.149:8300: read tcp 10.242.32.71:52714->10.242.93.149:8300: i/o timeout
2021/04/25 23:27:50 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:27:50 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:27:50 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:27:51 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:52 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:52966->10.242.93.149:8300: i/o timeout
2021/04/25 23:27:53 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:53 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:27:54 [WARN] memberlist: Was able to connect to dev-consul-7467bf7b46-ww995 but other probes failed, network may be misconfigured
2021/04/25 23:27:55 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:56 [WARN] memberlist: Was able to connect to dev-consul-7467bf7b46-ww995 but other probes failed, network may be misconfigured
2021/04/25 23:27:57 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:27:57 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:27:58 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:34222->10.242.93.140:8301: i/o timeout
2021/04/25 23:27:58 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:27:58 [INFO] memberlist: Marking dev-consul-7467bf7b46-ww995 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:27:58 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:27:58 [INFO] consul: member 'dev-consul-7467bf7b46-ww995' failed, marking health critical
2021/04/25 23:27:58 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/25 23:27:58 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:27:59 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:27:59 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:27:59 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:27:59 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive
2021/04/25 23:28:00 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2.dc1)
2021/04/25 23:28:00 [INFO] raft: pipelining replication to peer {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}
2021/04/25 23:28:00 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:28:00 [INFO] consul: member 'dev-consul-7467bf7b46-ww995' joined, marking health alive
2021/04/25 23:29:00 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:60630->10.242.93.149:8301: i/o timeout
2021/04/25 23:29:00 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:29:00 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/25 23:29:01 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 2.500181881s
2021/04/25 23:29:01 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:29:06 [WARN] memberlist: Was able to connect to dev-consul-7467bf7b46-ww995 but other probes failed, network may be misconfigured
2021/04/25 23:29:06 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/25 23:29:07 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:60774->10.242.93.149:8301: i/o timeout
2021/04/25 23:29:07 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:29:07 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:29:07 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 2.500170971s
2021/04/25 23:29:09 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:29:09 [WARN] memberlist: Refuting a suspect message (from: dev-consul-7467bf7b46-fdl7b)
2021/04/25 23:29:10 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:35720->10.242.93.140:8301: i/o timeout
2021/04/25 23:29:10 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:29:10 [INFO] memberlist: Marking dev-consul-7467bf7b46-ww995 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:29:10 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:29:10 [INFO] consul: member 'dev-consul-7467bf7b46-ww995' failed, marking health critical
2021/04/25 23:29:11 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:29:11 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:29:11 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:29:11 [INFO] consul: member 'dev-consul-server-2' failed, marking health critical
2021/04/25 23:29:11 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 2.500208378s
2021/04/25 23:29:11 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:29:13 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:29:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:60858->10.242.93.149:8301: i/o timeout
2021/04/25 23:29:14 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:29:14 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded
2021/04/25 23:29:15 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:29:15 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 2.500180866s
2021/04/25 23:29:17 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:29:18 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 4.987855894s
2021/04/25 23:29:19 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:29:19 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:29:19 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.93.149:53794
2021/04/25 23:29:20 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 7.467527052s
2021/04/25 23:29:21 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:29:21 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:29:22 [INFO] raft: aborting pipeline replication to peer {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}
2021/04/25 23:29:22 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:29:23 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:29:23 [ERR] raft: Failed to heartbeat to 10.242.93.149:8300: read tcp 10.242.32.71:53154->10.242.93.149:8300: i/o timeout
2021/04/25 23:29:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:46424->10.242.93.149:8302: i/o timeout
2021/04/25 23:29:24 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:29:24 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:29:25 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 2.500197469s
2021/04/25 23:29:25 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:29:27 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:29:27 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 4.947915391s
2021/04/25 23:29:29 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:29:30 [WARN] raft: Failed to contact f66dacd5-df84-469e-7a9b-4103153d1fdc in 7.35910003s
2021/04/25 23:29:31 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:29:32 [ERR] raft: Failed to AppendEntries to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: read tcp 10.242.32.71:55078->10.242.93.149:8300: i/o timeout
2021/04/25 23:29:32 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:29:33 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:29:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:46658->10.242.93.149:8302: i/o timeout
2021/04/25 23:29:34 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:29:34 [ERR] raft: Failed to heartbeat to 10.242.93.149:8300: read tcp 10.242.32.71:55126->10.242.93.149:8300: i/o timeout
2021/04/25 23:29:35 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:29:35 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding
2021/04/25 23:29:36 [WARN] Unable to get address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc, using fallback address 10.242.93.149:8300: Could not find address for server id f66dacd5-df84-469e-7a9b-4103153d1fdc
2021/04/25 23:29:36 [ERR] raft: peer {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300} has newer term, stopping replication
2021/04/25 23:29:36 [INFO] raft: aborting pipeline replication to peer {Voter e524e1aa-4527-3cd0-d6fe-8da75eba4af0 10.242.187.2:8300}
2021/04/25 23:29:36 [INFO] raft: Node at 10.242.32.71:8300 [Follower] entering Follower state (Leader: "")
2021/04/25 23:29:36 [INFO] consul: cluster leadership lost
2021/04/25 23:29:37 [WARN] raft: Rejecting vote request from 10.242.93.149:8300 since our last index is greater (1053, 1046)
2021/04/25 23:29:37 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:29:37 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:29:40 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:29:42 [INFO] consul: New leader elected: dev-consul-server-0
2021/04/25 23:29:43 [DEBUG] raft-net: 10.242.32.71:8300 accepted connection from: 10.242.187.2:38698
2021/04/25 23:29:53 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:33542->10.242.93.149:8301: i/o timeout
2021/04/25 23:29:53 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:29:55 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:29:55 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:29:55 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:29:55 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:29:55 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:29:57 [WARN] memberlist: Was able to connect to dev-consul-7467bf7b46-ww995 but other probes failed, network may be misconfigured
2021/04/25 23:30:01 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:33740->10.242.93.149:8301: i/o timeout
2021/04/25 23:30:01 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:30:01 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:30:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:47320->10.242.93.149:8302: i/o timeout
2021/04/25 23:30:04 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:30:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:33796->10.242.93.149:8301: i/o timeout
2021/04/25 23:30:04 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:30:07 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:30:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:34122->10.242.93.149:8301: i/o timeout
2021/04/25 23:30:19 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:30:21 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:37266->10.242.93.140:8301: i/o timeout
2021/04/25 23:30:21 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:30:22 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:30:23 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:37306->10.242.93.140:8301: i/o timeout
2021/04/25 23:30:23 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:30:23 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:30:23 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:30:25 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:34212->10.242.93.149:8301: i/o timeout
2021/04/25 23:30:25 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:30:29 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:47852->10.242.93.149:8302: i/o timeout
2021/04/25 23:30:29 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:30:33 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:30:33 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.93.140:46410
2021/04/25 23:30:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:48278->10.242.93.149:8302: i/o timeout
2021/04/25 23:30:49 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:30:55 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2.dc1)
2021/04/25 23:30:58 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:30:58 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:31:01 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:35014->10.242.93.149:8301: i/o timeout
2021/04/25 23:31:01 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:31:01 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:31:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:48600->10.242.93.149:8302: i/o timeout
2021/04/25 23:31:04 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:31:04 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:31:04 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:31:04 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:31:05 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:35084->10.242.93.149:8301: i/o timeout
2021/04/25 23:31:05 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:31:07 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:31:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:48994->10.242.93.149:8302: i/o timeout
2021/04/25 23:31:24 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:31:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:49212->10.242.93.149:8302: i/o timeout
2021/04/25 23:31:34 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:31:34 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/25 23:31:34 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:31:34 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:32:04 [ERR] memberlist: failed to receive: read tcp 10.242.32.71:8301->10.242.93.140:39564: i/o timeout from=10.242.93.140:39564
2021/04/25 23:32:04 [ERR] memberlist: Failed to send error: write tcp 10.242.32.71:8301->10.242.93.140:39564: i/o timeout from=10.242.93.140:39564
2021/04/25 23:32:17 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:32:17 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:32:17 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:32:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:39730->10.242.93.140:8301: i/o timeout
2021/04/25 23:32:19 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:32:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:39762->10.242.93.140:8301: i/o timeout
2021/04/25 23:32:22 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:32:23 [INFO] memberlist: Marking dev-consul-7467bf7b46-ww995 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:32:23 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:32:29 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:50350->10.242.93.149:8302: i/o timeout
2021/04/25 23:32:29 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:32:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:50542->10.242.93.149:8302: i/o timeout
2021/04/25 23:32:39 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:32:39 [ERR] memberlist: failed to receive: read tcp 10.242.32.71:8301->10.242.93.140:39756: i/o timeout from=10.242.93.140:39756
2021/04/25 23:32:39 [ERR] memberlist: Failed to send error: write tcp 10.242.32.71:8301->10.242.93.140:39756: i/o timeout from=10.242.93.140:39756
2021/04/25 23:32:41 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:32:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:50770->10.242.93.149:8302: i/o timeout
2021/04/25 23:32:49 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:32:59 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:50958->10.242.93.149:8302: i/o timeout
2021/04/25 23:32:59 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:32:59 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/25 23:32:59 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:32:59 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:32:59 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:33:02 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:40638->10.242.93.140:8301: i/o timeout
2021/04/25 23:33:02 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:33:03 [WARN] memberlist: Refuting a suspect message (from: dev-consul-7467bf7b46-ww995)
2021/04/25 23:33:04 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:33:04 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:33:05 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:33:06 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:40686->10.242.93.140:8301: i/o timeout
2021/04/25 23:33:06 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:33:11 [ERR] memberlist: Push/Pull with dev-consul-7467bf7b46-ww995 failed: read tcp 10.242.32.71:40628->10.242.93.140:8301: i/o timeout
2021/04/25 23:33:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:51270->10.242.93.149:8302: i/o timeout
2021/04/25 23:33:14 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:33:21 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:33:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:51394->10.242.93.149:8302: i/o timeout
2021/04/25 23:33:24 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:33:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:51792->10.242.93.149:8302: i/o timeout
2021/04/25 23:33:39 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:33:39 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:33:39 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.93.140:49848
2021/04/25 23:33:44 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/25 23:33:44 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:33:44 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:33:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:52028->10.242.93.149:8302: i/o timeout
2021/04/25 23:33:49 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:34:39 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:35:01 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:35:02 [ERR] memberlist: failed to receive: read tcp 10.242.32.71:8302->10.242.93.149:58008: i/o timeout from=10.242.93.149:58008
2021/04/25 23:35:02 [ERR] memberlist: Failed to send error: write tcp 10.242.32.71:8302->10.242.93.149:58008: i/o timeout from=10.242.93.149:58008
2021/04/25 23:35:41 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:36:21 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:36:39 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:37:01 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:37:27 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:37:27 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.93.149:57198
2021/04/25 23:37:39 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:37:41 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:37:44 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:37:44 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:37:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:57072->10.242.93.149:8302: i/o timeout
2021/04/25 23:37:54 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:38:09 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:57386->10.242.93.149:8302: i/o timeout
2021/04/25 23:38:09 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:38:21 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:38:24 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/25 23:38:24 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:38:24 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:38:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:57702->10.242.93.149:8302: i/o timeout
2021/04/25 23:38:24 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:38:36 [ERR] memberlist: failed to receive: read tcp 10.242.32.71:8301->10.242.93.140:40304: i/o timeout from=10.242.93.140:40304
2021/04/25 23:38:36 [ERR] memberlist: Failed to send error: write tcp 10.242.32.71:8301->10.242.93.140:40304: i/o timeout from=10.242.93.140:40304
2021/04/25 23:38:39 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:38:50 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:38:50 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:38:50 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.93.140:50256
2021/04/25 23:38:52 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:38:52 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:38:52 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-fdl7b 10.242.32.109
2021/04/25 23:38:52 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:38:52 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:38:52 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-fdl7b 10.242.32.109
2021/04/25 23:38:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:47908->10.242.93.140:8301: i/o timeout
2021/04/25 23:38:54 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:38:58 [WARN] memberlist: Was able to connect to dev-consul-7467bf7b46-ww995 but other probes failed, network may be misconfigured
2021/04/25 23:38:59 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:48042->10.242.93.140:8301: i/o timeout
2021/04/25 23:38:59 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:39:17 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:48418->10.242.93.140:8301: i/o timeout
2021/04/25 23:39:17 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:39:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:48524->10.242.93.140:8301: i/o timeout
2021/04/25 23:39:22 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:39:26 [WARN] memberlist: Was able to connect to dev-consul-7467bf7b46-ww995 but other probes failed, network may be misconfigured
2021/04/25 23:39:26 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:39:27 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/04/25 23:39:29 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/04/25 23:39:29 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:39:31 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:48756->10.242.93.140:8301: i/o timeout
2021/04/25 23:39:31 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:39:35 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:45650->10.242.93.149:8301: i/o timeout
2021/04/25 23:39:35 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:39:35 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:39:35 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:39:35 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:39:37 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:39:39 [WARN] memberlist: Was able to connect to dev-consul-server-2.dc1 but other probes failed, network may be misconfigured
2021/04/25 23:39:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:48838->10.242.93.140:8301: i/o timeout
2021/04/25 23:39:39 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:39:44 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:59420->10.242.93.149:8302: i/o timeout
2021/04/25 23:39:44 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:39:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:59620->10.242.93.149:8302: i/o timeout
2021/04/25 23:39:54 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:39:55 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:40:01 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:40:09 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:59928->10.242.93.149:8302: i/o timeout
2021/04/25 23:40:09 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:40:11 [ERR] memberlist: Push/Pull with dev-consul-server-2.dc1 failed: read tcp 10.242.32.71:59404->10.242.93.149:8302: i/o timeout
2021/04/25 23:40:11 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:40:11 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:40:11 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1)
2021/04/25 23:40:11 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:40:12 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2.dc1)
2021/04/25 23:40:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:49608->10.242.93.140:8301: i/o timeout
2021/04/25 23:40:14 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:40:14 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/25 23:40:14 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:40:14 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:40:17 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:46582->10.242.93.149:8301: i/o timeout
2021/04/25 23:40:17 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:40:17 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:40:17 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:40:17 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:40:17 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:40:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:60036->10.242.93.149:8302: i/o timeout
2021/04/25 23:40:19 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:40:20 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:49720->10.242.93.140:8301: i/o timeout
2021/04/25 23:40:20 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:40:20 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:40:24 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:40:24 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.93.140:51070
2021/04/25 23:40:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:60456->10.242.93.149:8302: i/o timeout
2021/04/25 23:40:39 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:40:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:60854->10.242.93.149:8302: i/o timeout
2021/04/25 23:40:54 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:40:54 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/25 23:40:54 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:40:54 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:40:57 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:40:57 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.93.149:58574
2021/04/25 23:41:11 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:41:16 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:41:18 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:50948->10.242.93.140:8301: i/o timeout
2021/04/25 23:41:18 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:41:21 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:41:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:51038->10.242.93.140:8301: i/o timeout
2021/04/25 23:41:22 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:41:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:42:09 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:42:21 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:43:01 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:43:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:43:40 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:43:40 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:43:41 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:43:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:50862->10.242.93.149:8301: i/o timeout
2021/04/25 23:43:45 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:43:45 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:43:45 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:43:45 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:44:01 [ERR] memberlist: failed to receive: read tcp 10.242.32.71:8302->10.242.93.149:60534: i/o timeout from=10.242.93.149:60534
2021/04/25 23:44:01 [ERR] memberlist: Failed to send error: write tcp 10.242.32.71:8302->10.242.93.149:60534: i/o timeout from=10.242.93.149:60534
2021/04/25 23:44:10 [ERR] memberlist: failed to receive: read tcp 10.242.32.71:8302->10.242.93.149:60560: i/o timeout from=10.242.93.149:60560
2021/04/25 23:44:10 [ERR] memberlist: Failed to send error: write tcp 10.242.32.71:8302->10.242.93.149:60560: i/o timeout from=10.242.93.149:60560
2021/04/25 23:44:21 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:44:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:45:00 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:45:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:46:31 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:46:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:47:11 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:47:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:48:21 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:48:33 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:48:39 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:48:39 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:48:39 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:48:41 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:57064->10.242.93.149:8301: i/o timeout
2021/04/25 23:48:41 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:48:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:60200->10.242.93.140:8301: i/o timeout
2021/04/25 23:48:45 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:48:45 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:48:45 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:48:45 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:48:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:49:01 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:49:20 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:49:20 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.93.140:53928
2021/04/25 23:49:26 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:49:30 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:32986->10.242.93.140:8301: i/o timeout
2021/04/25 23:49:30 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:49:32 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/25 23:49:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:33058->10.242.93.140:8301: i/o timeout
2021/04/25 23:49:33 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/25 23:49:33 [WARN] memberlist: Refuting a dead message (from: dev-consul-server-2)
2021/04/25 23:49:37 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:49:37 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:49:41 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:49:44 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:43692->10.242.93.149:8302: i/o timeout
2021/04/25 23:49:44 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:49:44 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:49:44 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:49:46 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:58456->10.242.93.149:8301: i/o timeout
2021/04/25 23:49:46 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:49:49 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:49:49 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:49:49 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:49:50 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:58550->10.242.93.149:8301: i/o timeout
2021/04/25 23:49:50 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:49:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:43912->10.242.93.149:8302: i/o timeout
2021/04/25 23:49:54 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:50:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:44118->10.242.93.149:8302: i/o timeout
2021/04/25 23:50:04 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:50:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:44320->10.242.93.149:8302: i/o timeout
2021/04/25 23:50:14 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:50:14 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/25 23:50:14 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:50:14 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:50:14 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:50:21 [ERR] memberlist: failed to receive: read tcp 10.242.32.71:8302->10.242.93.149:33768: i/o timeout from=10.242.93.149:33768
2021/04/25 23:50:21 [ERR] memberlist: Failed to send error: write tcp 10.242.32.71:8302->10.242.93.149:33768: i/o timeout from=10.242.93.149:33768
2021/04/25 23:50:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:50:54 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:51:06 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2.dc1)
2021/04/25 23:51:34 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:51:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:51:55 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:52:14 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:52:29 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:52:29 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.93.140:54520
2021/04/25 23:52:54 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:53:07 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:53:07 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:53:11 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:34510->10.242.93.149:8301: i/o timeout
2021/04/25 23:53:11 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:53:12 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:53:12 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:53:12 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:53:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:54:04 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:54:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:55:14 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:55:54 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:56:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/25 23:56:34 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:56:39 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:56:39 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:56:40 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:56:40 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:56:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:38858->10.242.93.149:8301: i/o timeout
2021/04/25 23:56:42 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:56:46 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:56:46 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:56:46 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:56:47 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:38996->10.242.93.149:8301: i/o timeout
2021/04/25 23:56:47 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:56:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:52564->10.242.93.149:8302: i/o timeout
2021/04/25 23:56:49 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:57:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:52872->10.242.93.149:8302: i/o timeout
2021/04/25 23:57:04 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:57:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:52966->10.242.93.149:8302: i/o timeout
2021/04/25 23:57:14 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/25 23:57:19 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/25 23:57:19 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/25 23:57:19 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/25 23:57:21 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/25 23:57:44 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/25 23:57:52 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/25 23:57:52 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:57:55 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:40388->10.242.93.149:8301: i/o timeout
2021/04/25 23:57:55 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:57:57 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/25 23:57:57 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/25 23:57:57 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/25 23:57:58 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:40452->10.242.93.149:8301: i/o timeout
2021/04/25 23:57:58 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/25 23:58:24 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/25 23:58:29 [ERR] memberlist: failed to receive: read tcp 10.242.32.71:8301->10.242.93.149:48774: i/o timeout from=10.242.93.149:48774
2021/04/25 23:58:29 [ERR] memberlist: Failed to send error: write tcp 10.242.32.71:8301->10.242.93.149:48774: i/o timeout from=10.242.93.149:48774
2021/04/25 23:59:34 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:00:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:01:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:01:44 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:02:05 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/26 00:02:05 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/26 00:02:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:59302->10.242.93.149:8302: i/o timeout
2021/04/26 00:02:14 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 00:02:26 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/26 00:02:26 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2)
2021/04/26 00:02:26 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-fdl7b 10.242.32.109
2021/04/26 00:02:26 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 00:02:26 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-fdl7b 10.242.32.109
2021/04/26 00:02:29 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:59636->10.242.93.149:8302: i/o timeout
2021/04/26 00:02:29 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 00:02:30 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:46136->10.242.93.149:8301: i/o timeout
2021/04/26 00:02:30 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/26 00:02:32 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/26 00:02:32 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 00:02:34 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 00:02:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:49418->10.242.93.140:8301: i/o timeout
2021/04/26 00:02:37 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 00:02:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:59864->10.242.93.149:8302: i/o timeout
2021/04/26 00:02:39 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 00:02:40 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 00:02:41 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:49498->10.242.93.140:8301: i/o timeout
2021/04/26 00:02:41 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 00:02:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:60074->10.242.93.149:8302: i/o timeout
2021/04/26 00:02:49 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 00:02:54 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:02:59 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:60182->10.242.93.149:8302: i/o timeout
2021/04/26 00:02:59 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 00:03:09 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:60492->10.242.93.149:8302: i/o timeout
2021/04/26 00:03:09 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 00:03:09 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/26 00:03:09 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/26 00:03:09 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/26 00:03:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:03:32 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/26 00:03:34 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:04:14 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:04:25 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 00:04:30 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:51760->10.242.93.140:8301: i/o timeout
2021/04/26 00:04:30 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 00:04:31 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 00:04:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:51806->10.242.93.140:8301: i/o timeout
2021/04/26 00:04:33 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 00:04:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:04:54 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:05:04 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 00:05:06 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:52494->10.242.93.140:8301: i/o timeout
2021/04/26 00:05:06 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 00:05:09 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:52544->10.242.93.140:8301: i/o timeout
2021/04/26 00:05:09 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 00:05:12 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:52574->10.242.93.140:8301: i/o timeout
2021/04/26 00:05:12 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 00:05:17 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:52766->10.242.93.140:8301: i/o timeout
2021/04/26 00:05:17 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 00:05:17 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 00:05:24 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/26 00:05:24 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/26 00:05:34 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:05:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:35386->10.242.93.149:8302: i/o timeout
2021/04/26 00:05:39 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 00:05:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:35600->10.242.93.149:8302: i/o timeout
2021/04/26 00:05:54 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 00:05:59 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/26 00:05:59 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.93.140:58152
2021/04/26 00:06:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:35890->10.242.93.149:8302: i/o timeout
2021/04/26 00:06:04 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 00:06:04 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/26 00:06:04 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/26 00:06:04 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/26 00:06:44 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:06:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:07:24 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:07:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:08:16 [ERR] memberlist: failed to receive: read tcp 10.242.32.71:8302->10.242.93.149:38252: i/o timeout from=10.242.93.149:38252
2021/04/26 00:08:16 [ERR] memberlist: Failed to send error: write tcp 10.242.32.71:8302->10.242.93.149:38252: i/o timeout from=10.242.93.149:38252
2021/04/26 00:08:34 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:09:14 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:09:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:10:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:10:50 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/26 00:10:50 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.93.140:58772
2021/04/26 00:10:54 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/26 00:11:24 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:11:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:12:04 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:12:44 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:12:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:13:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:13:54 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:14:34 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:15:14 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:15:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:15:54 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:16:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:16:34 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:17:14 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:17:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:17:54 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:18:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:19:04 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:19:31 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/26 00:19:31 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 00:19:31 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 00:19:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:39008->10.242.93.149:8301: i/o timeout
2021/04/26 00:19:33 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/26 00:19:36 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/26 00:19:36 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/26 00:19:36 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 00:19:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:42174->10.242.93.140:8301: i/o timeout
2021/04/26 00:19:37 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 00:19:39 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 00:19:40 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:42296->10.242.93.140:8301: i/o timeout
2021/04/26 00:19:40 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 00:19:44 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:20:51 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/26 00:20:54 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:21:34 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:21:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:22:14 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:22:54 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:23:34 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:24:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:25:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:26:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:26:44 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:27:24 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:28:04 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:28:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:28:33 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 00:28:36 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:53340->10.242.93.140:8301: i/o timeout
2021/04/26 00:28:36 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 00:28:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:53402->10.242.93.140:8301: i/o timeout
2021/04/26 00:28:39 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 00:28:40 [INFO] memberlist: Marking dev-consul-7467bf7b46-ww995 as failed, suspect timeout reached (2 peer confirmations)
2021/04/26 00:28:40 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 00:28:44 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:29:24 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:30:04 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:31:14 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:31:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:31:54 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:32:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:33:04 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:33:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:33:44 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:34:24 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:35:34 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:35:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:36:14 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:37:24 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:37:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:38:04 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:39:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:40:14 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:40:32 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 00:40:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:39902->10.242.93.140:8301: i/o timeout
2021/04/26 00:40:34 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 00:40:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:39974->10.242.93.140:8301: i/o timeout
2021/04/26 00:40:37 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 00:40:38 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 00:40:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:40:54 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:42:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:42:34 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:43:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:44:14 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:44:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:45:24 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:46:04 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:46:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:47:44 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:48:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:49:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:49:24 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:50:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:50:34 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:51:14 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:51:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:51:54 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:52:34 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:52:56 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/26 00:52:56 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/26 00:53:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:37642->10.242.93.149:8302: i/o timeout
2021/04/26 00:53:14 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 00:53:14 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:53:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:37764->10.242.93.149:8302: i/o timeout
2021/04/26 00:53:24 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 00:53:34 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/26 00:53:34 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/26 00:53:34 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/26 00:53:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:38168->10.242.93.149:8302: i/o timeout
2021/04/26 00:53:39 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 00:53:54 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:54:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:55:34 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:56:14 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:56:54 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 00:57:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:58:04 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:58:44 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 00:58:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 00:59:24 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:00:04 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:00:44 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:00:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:01:52 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:01:54 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:02:34 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:03:14 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:03:54 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:04:22 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:04:31 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/26 01:04:31 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/26 01:04:31 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 01:04:31 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/26 01:04:31 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 01:04:32 [WARN] raft: Rejecting vote request from 10.242.93.149:8300 since we have a leader: 10.242.187.2:8300
2021/04/26 01:04:32 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2.dc1)
2021/04/26 01:04:40 [WARN] raft: Rejecting vote request from 10.242.93.149:8300 since we have a leader: 10.242.187.2:8300
2021/04/26 01:04:43 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/26 01:04:45 [INFO] serf: EventMemberUpdate: dev-consul-server-2
2021/04/26 01:04:45 [INFO] serf: EventMemberUpdate: dev-consul-server-2.dc1
2021/04/26 01:04:47 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/26 01:04:48 [WARN] raft: Heartbeat timeout from "10.242.187.2:8300" reached, starting election
2021/04/26 01:04:48 [INFO] raft: Node at 10.242.32.71:8300 [Candidate] entering Candidate state in term 5
2021/04/26 01:04:48 [ERR] raft: Failed to make RequestVote RPC to {Voter f66dacd5-df84-469e-7a9b-4103153d1fdc 10.242.93.149:8300}: EOF
2021/04/26 01:04:48 [INFO] raft: Node at 10.242.32.71:8300 [Follower] entering Follower state (Leader: "")
2021/04/26 01:04:49 [INFO] consul: New leader elected: dev-consul-server-0
2021/04/26 01:04:50 [DEBUG] raft-net: 10.242.32.71:8300 accepted connection from: 10.242.187.2:37224
2021/04/26 01:06:11 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:43250->10.242.93.140:8301: i/o timeout
2021/04/26 01:06:11 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 01:06:13 [WARN] memberlist: Refuting a suspect message (from: dev-consul-7467bf7b46-ww995)
2021/04/26 01:06:15 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/04/26 01:06:15 [INFO] memberlist: Marking dev-consul-7467bf7b46-ww995 as failed, suspect timeout reached (2 peer confirmations)
2021/04/26 01:06:15 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 01:06:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:53826->10.242.93.149:8302: i/o timeout
2021/04/26 01:06:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:40260->10.242.93.149:8301: i/o timeout
2021/04/26 01:06:19 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/26 01:06:19 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/26 01:06:19 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 01:06:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:53942->10.242.93.149:8302: i/o timeout
2021/04/26 01:06:24 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:06:27 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 01:06:28 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/26 01:06:28 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 01:06:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:43704->10.242.93.140:8301: i/o timeout
2021/04/26 01:06:35 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:40614->10.242.93.149:8301: i/o timeout
2021/04/26 01:06:35 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/26 01:06:36 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/26 01:06:36 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 01:06:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:54248->10.242.93.149:8302: i/o timeout
2021/04/26 01:06:39 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:06:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:40662->10.242.93.149:8301: i/o timeout
2021/04/26 01:06:39 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/26 01:06:44 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:43866->10.242.93.140:8301: i/o timeout
2021/04/26 01:06:44 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 01:06:44 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 01:06:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:54464->10.242.93.149:8302: i/o timeout
2021/04/26 01:06:49 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:06:58 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/26 01:06:58 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.93.149:41540
2021/04/26 01:07:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:54666->10.242.93.149:8302: i/o timeout
2021/04/26 01:07:04 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:07:04 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:07:06 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/26 01:07:06 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.93.140:34712
2021/04/26 01:07:09 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/26 01:07:09 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/26 01:07:09 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/26 01:07:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:54970->10.242.93.149:8302: i/o timeout
2021/04/26 01:07:14 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:07:44 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:07:53 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/26 01:07:53 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 01:07:56 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:42312->10.242.93.149:8301: i/o timeout
2021/04/26 01:07:56 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/26 01:07:58 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/26 01:07:58 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/26 01:07:58 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 01:07:59 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:42374->10.242.93.149:8301: i/o timeout
2021/04/26 01:07:59 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/26 01:08:00 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/26 01:08:00 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/26 01:08:00 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 01:08:01 [DEBUG] raft-net: 10.242.32.71:8300 accepted connection from: 10.242.93.149:44458
2021/04/26 01:08:01 [WARN] raft: Rejecting vote request from 10.242.93.149:8300 since we have a leader: 10.242.187.2:8300
2021/04/26 01:08:03 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:45580->10.242.93.140:8301: i/o timeout
2021/04/26 01:08:03 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 01:08:06 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:45646->10.242.93.140:8301: i/o timeout
2021/04/26 01:08:06 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 01:08:09 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:56110->10.242.93.149:8302: i/o timeout
2021/04/26 01:08:09 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:08:09 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:45702->10.242.93.140:8301: i/o timeout
2021/04/26 01:08:09 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 01:08:10 [INFO] memberlist: Marking dev-consul-7467bf7b46-ww995 as failed, suspect timeout reached (2 peer confirmations)
2021/04/26 01:08:10 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 01:08:10 [INFO] consul: New leader elected: dev-consul-server-0
2021/04/26 01:08:11 [DEBUG] raft-net: 10.242.32.71:8300 accepted connection from: 10.242.187.2:40154
2021/04/26 01:08:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:56434->10.242.93.149:8302: i/o timeout
2021/04/26 01:08:24 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:08:24 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:08:25 [ERR] memberlist: failed to receive: read tcp 10.242.32.71:8301->10.242.93.140:55688: i/o timeout from=10.242.93.140:55688
2021/04/26 01:08:25 [ERR] memberlist: Failed to send error: write tcp 10.242.32.71:8301->10.242.93.140:55688: i/o timeout from=10.242.93.140:55688
2021/04/26 01:08:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:56544->10.242.93.149:8302: i/o timeout
2021/04/26 01:08:34 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:08:39 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/26 01:08:39 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/26 01:08:39 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/26 01:09:04 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:09:31 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:10:14 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:10:54 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:11:01 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:11:27 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/26 01:11:27 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/26 01:11:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:60356->10.242.93.149:8302: i/o timeout
2021/04/26 01:11:34 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:11:44 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:60566->10.242.93.149:8302: i/o timeout
2021/04/26 01:11:44 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:11:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:60760->10.242.93.149:8302: i/o timeout
2021/04/26 01:11:54 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:12:00 [ERR] memberlist: failed to receive: read tcp 10.242.32.71:8302->10.242.93.149:45926: i/o timeout from=10.242.93.149:45926
2021/04/26 01:12:00 [ERR] memberlist: Failed to send error: write tcp 10.242.32.71:8302->10.242.93.149:45926: i/o timeout from=10.242.93.149:45926
2021/04/26 01:12:04 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/26 01:12:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:60878->10.242.93.149:8302: i/o timeout
2021/04/26 01:12:04 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/26 01:12:04 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:12:04 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/26 01:12:04 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:12:44 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:12:57 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:13:41 [ERR] memberlist: failed to receive: read tcp 10.242.32.71:8302->10.242.93.149:46342: i/o timeout from=10.242.93.149:46342
2021/04/26 01:13:41 [ERR] memberlist: Failed to send error: write tcp 10.242.32.71:8302->10.242.93.149:46342: i/o timeout from=10.242.93.149:46342
2021/04/26 01:13:54 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:13:57 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:14:22 [ERR] memberlist: failed to receive: read tcp 10.242.32.71:8301->10.242.93.149:59186: i/o timeout from=10.242.93.149:59186
2021/04/26 01:14:22 [ERR] memberlist: Failed to send error: write tcp 10.242.32.71:8301->10.242.93.149:59186: i/o timeout from=10.242.93.149:59186
2021/04/26 01:14:41 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/26 01:14:41 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/26 01:14:41 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.93.149:45652
2021/04/26 01:15:04 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:15:44 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:16:24 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:16:57 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:17:57 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:18:04 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:18:44 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:18:57 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:19:24 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:19:57 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:20:04 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:20:07 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/26 01:20:44 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:21:24 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:22:04 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:22:27 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:23:14 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:23:27 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:23:43 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/26 01:23:54 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:24:27 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:24:34 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:25:44 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:26:54 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:26:57 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:28:31 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/26 01:28:31 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/26 01:28:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:53210->10.242.93.149:8302: i/o timeout
2021/04/26 01:28:39 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:28:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:53520->10.242.93.149:8302: i/o timeout
2021/04/26 01:28:54 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:29:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:53618->10.242.93.149:8302: i/o timeout
2021/04/26 01:29:04 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:29:04 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:29:09 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/26 01:29:09 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/26 01:29:09 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/26 01:29:27 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:29:44 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:30:24 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:30:27 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:31:04 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:31:44 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:31:57 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:32:54 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:33:27 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:33:34 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:34:14 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:34:38 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 01:34:38 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/26 01:34:38 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2.dc1)
2021/04/26 01:34:38 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/26 01:34:38 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/26 01:34:38 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 01:34:44 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/26 01:34:45 [INFO] serf: EventMemberUpdate: dev-consul-server-2
2021/04/26 01:34:45 [INFO] serf: EventMemberUpdate: dev-consul-server-2.dc1
2021/04/26 01:36:03 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:51958->10.242.93.140:8301: i/o timeout
2021/04/26 01:36:03 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 01:36:18 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:52284->10.242.93.140:8301: i/o timeout
2021/04/26 01:36:18 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 01:36:21 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:49178->10.242.93.149:8301: i/o timeout
2021/04/26 01:36:21 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/26 01:36:21 [INFO] memberlist: Marking dev-consul-7467bf7b46-ww995 as failed, suspect timeout reached (2 peer confirmations)
2021/04/26 01:36:21 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 01:36:21 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/26 01:36:21 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 01:36:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:34566->10.242.93.149:8302: i/o timeout
2021/04/26 01:36:24 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:36:24 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:36:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:34678->10.242.93.149:8302: i/o timeout
2021/04/26 01:36:34 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:36:44 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:34984->10.242.93.149:8302: i/o timeout
2021/04/26 01:36:44 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:36:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:35188->10.242.93.149:8302: i/o timeout
2021/04/26 01:36:54 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:36:54 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/26 01:36:54 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/26 01:36:54 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/26 01:37:04 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:37:27 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:38:27 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:38:44 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:39:09 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/26 01:39:09 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/26 01:39:09 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/26 01:39:09 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 01:39:09 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2.dc1)
2021/04/26 01:39:11 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:52718->10.242.93.149:8301: i/o timeout
2021/04/26 01:39:11 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/26 01:39:15 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:52806->10.242.93.149:8301: i/o timeout
2021/04/26 01:39:15 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/26 01:39:15 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/26 01:39:15 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/26 01:39:15 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 01:39:19 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/26 01:39:19 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 01:39:19 [ERR] memberlist: failed to receive: read tcp 10.242.32.71:8301->10.242.93.140:33920: i/o timeout from=10.242.93.140:33920
2021/04/26 01:39:19 [ERR] memberlist: Failed to send error: write tcp 10.242.32.71:8301->10.242.93.140:33920: i/o timeout from=10.242.93.140:33920
2021/04/26 01:39:20 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 01:39:27 [WARN] memberlist: Was able to connect to dev-consul-7467bf7b46-ww995 but other probes failed, network may be misconfigured
2021/04/26 01:39:28 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:56206->10.242.93.140:8301: i/o timeout
2021/04/26 01:39:28 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 01:39:28 [INFO] memberlist: Marking dev-consul-7467bf7b46-ww995 as failed, suspect timeout reached (2 peer confirmations)
2021/04/26 01:39:28 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 01:39:28 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 01:39:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:53310->10.242.93.149:8301: i/o timeout
2021/04/26 01:39:39 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/26 01:39:42 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/26 01:39:42 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/26 01:39:42 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 01:39:43 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:53384->10.242.93.149:8301: i/o timeout
2021/04/26 01:39:43 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/26 01:39:44 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 01:39:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:56540->10.242.93.140:8301: i/o timeout
2021/04/26 01:39:45 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 01:39:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:38840->10.242.93.149:8302: i/o timeout
2021/04/26 01:39:49 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:39:49 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/26 01:39:49 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.93.140:44016
2021/04/26 01:39:54 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:39:59 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:39032->10.242.93.149:8302: i/o timeout
2021/04/26 01:39:59 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:40:01 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/26 01:40:01 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 01:40:03 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 01:40:06 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:57004->10.242.93.140:8301: i/o timeout
2021/04/26 01:40:06 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 01:40:09 [INFO] memberlist: Marking dev-consul-7467bf7b46-ww995 as failed, suspect timeout reached (2 peer confirmations)
2021/04/26 01:40:09 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 01:40:12 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 01:40:15 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:57202->10.242.93.140:8301: i/o timeout
2021/04/26 01:40:15 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 01:40:18 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:54142->10.242.93.149:8301: i/o timeout
2021/04/26 01:40:18 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/26 01:40:18 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/26 01:40:18 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 01:40:18 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 01:40:21 [WARN] memberlist: Was able to connect to dev-consul-7467bf7b46-ww995 but other probes failed, network may be misconfigured
2021/04/26 01:40:21 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2)
2021/04/26 01:40:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:39554->10.242.93.149:8302: i/o timeout
2021/04/26 01:40:24 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:40:31 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:40:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:39776->10.242.93.149:8302: i/o timeout
2021/04/26 01:40:34 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:40:35 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/26 01:40:41 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/26 01:40:41 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 01:40:41 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2.dc1)
2021/04/26 01:40:42 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 01:40:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:57832->10.242.93.140:8301: i/o timeout
2021/04/26 01:40:45 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 01:40:47 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-ww995 10.242.93.140
2021/04/26 01:40:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:57862->10.242.93.140:8301: i/o timeout
2021/04/26 01:40:49 [INFO] memberlist: Suspect dev-consul-7467bf7b46-ww995 has failed, no acks received
2021/04/26 01:40:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:40100->10.242.93.149:8302: i/o timeout
2021/04/26 01:40:54 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:40:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:54816->10.242.93.149:8301: i/o timeout
2021/04/26 01:40:54 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/26 01:40:54 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/26 01:40:54 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/26 01:40:54 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 01:41:04 [WARN] memberlist: Was able to connect to dev-consul-server-2.dc1 but other probes failed, network may be misconfigured
2021/04/26 01:41:09 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:40506->10.242.93.149:8302: i/o timeout
2021/04/26 01:41:09 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:41:11 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:41:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:40726->10.242.93.149:8302: i/o timeout
2021/04/26 01:41:19 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:41:24 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/26 01:41:24 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/26 01:41:24 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/26 01:41:27 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:41:29 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:40922->10.242.93.149:8302: i/o timeout
2021/04/26 01:41:29 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:42:07 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.93.149
2021/04/26 01:42:07 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/26 01:42:08 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/26 01:42:08 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 01:42:11 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:56500->10.242.93.149:8301: i/o timeout
2021/04/26 01:42:11 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/26 01:42:13 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:56534->10.242.93.149:8301: i/o timeout
2021/04/26 01:42:13 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/26 01:42:13 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/26 01:42:13 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 01:42:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:41840->10.242.93.149:8302: i/o timeout
2021/04/26 01:42:14 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:42:21 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:42:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:42052->10.242.93.149:8302: i/o timeout
2021/04/26 01:42:24 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:42:27 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/26 01:42:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:42362->10.242.93.149:8302: i/o timeout
2021/04/26 01:42:39 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:42:44 [INFO] memberlist: Marking dev-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/04/26 01:42:44 [INFO] serf: EventMemberFailed: dev-consul-server-2.dc1 10.242.93.149
2021/04/26 01:42:44 [INFO] consul: Handled member-failed event for server "dev-consul-server-2.dc1" in area "wan"
2021/04/26 01:42:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:42578->10.242.93.149:8302: i/o timeout
2021/04/26 01:42:49 [INFO] memberlist: Suspect dev-consul-server-2.dc1 has failed, no acks received
2021/04/26 01:42:49 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.93.149
2021/04/26 01:42:49 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 01:42:51 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:57318->10.242.93.149:8301: i/o timeout
2021/04/26 01:42:51 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/26 01:42:51 [DEBUG] raft-net: 10.242.32.71:8300 accepted connection from: 10.242.93.149:53068
2021/04/26 01:42:55 [ERR] memberlist: Failed fallback ping: read tcp 10.242.32.71:57406->10.242.93.149:8301: i/o timeout
2021/04/26 01:42:55 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/26 01:42:55 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/26 01:42:55 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.93.149
2021/04/26 01:42:55 [INFO] consul: Removing LAN server dev-consul-server-2 (Addr: tcp/10.242.93.149:8300) (DC: dc1)
2021/04/26 01:42:56 [ERR] yamux: keepalive failed: i/o deadline reached
2021/04/26 01:42:56 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.93.140:45770
2021/04/26 01:42:57 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:43:31 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:43:57 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:44:41 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:45:57 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:46:21 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-ww995 10.242.93.140:8301
2021/04/26 01:46:57 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:47:31 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:48:11 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301
2021/04/26 01:48:27 [INFO] serf: attempting reconnect to dev-consul-server-2.dc1 10.242.93.149:8302
2021/04/26 01:48:51 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.93.149:8301