By type
+ CONSUL_BIND= + [ -n ] + CONSUL_CLIENT= + [ -n ] + CONSUL_DATA_DIR=/consul/data + CONSUL_CONFIG_DIR=/consul/config + [ -n ] + [ a = - ] + [ agent = agent ] + shift + set -- consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui + [ consul = consul ] + stat -c %u /consul/data + id -u consul + [ 100 != 100 ] + stat -c %u /consul/config + id -u consul + [ 100 != 100 ] + [ ! -z ] + exec consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui bootstrap_expect > 0: expecting 3 servers ==> Starting Consul agent... ==> Consul agent running! Version: 'v1.0.6' Node ID: 'e0f6e875-c5f9-02ca-bce6-61a8fa3d2e53' Node name: 'dev-consul-server-2' Datacenter: 'dc1' (Segment: '
') Server: true (Bootstrap: false) Client Addr: [0.0.0.0] (HTTP: 8500, HTTPS: -1, DNS: 8600) Cluster Addr: 10.242.26.4 (LAN: 8301, WAN: 8302) Encrypt: Gossip: false, TLS-Outgoing: false, TLS-Incoming: false ==> Log data will now stream in as it occurs: 2021/05/24 10:42:42 [INFO] raft: Initial configuration (index=0): [] 2021/05/24 10:42:42 [INFO] raft: Node at 10.242.26.4:8300 [Follower] entering Follower state (Leader: "") 2021/05/24 10:42:42 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.26.4 2021/05/24 10:42:42 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.26.4 2021/05/24 10:42:42 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan" 2021/05/24 10:42:42 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.26.4:8300) (DC: dc1) 2021/05/24 10:42:42 [INFO] agent: Started DNS server 0.0.0.0:8600 (tcp) 2021/05/24 10:42:42 [INFO] agent: Started DNS server 0.0.0.0:8600 (udp) 2021/05/24 10:42:42 [INFO] agent: Started HTTP server on [::]:8500 (tcp) 2021/05/24 10:42:42 [INFO] agent: started state syncer 2021/05/24 10:42:42 [INFO] agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce os scaleway softlayer 2021/05/24 10:42:42 [INFO] agent: Joining LAN cluster... 2021/05/24 10:42:42 [INFO] agent: (LAN) joining: [dev-consul-server-0.consul-server dev-consul-server-1.consul-server dev-consul-server-2.consul-server] 2021/05/24 10:42:42 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-zwnvv 10.242.167.200 2021/05/24 10:42:42 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.24.139 2021/05/24 10:42:42 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.167.206 2021/05/24 10:42:42 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 10:42:42 [INFO] consul: Found expected number of peers, attempting bootstrap: 10.242.24.139:8300,10.242.167.206:8300,10.242.26.4:8300 2021/05/24 10:42:42 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.167.206 2021/05/24 10:42:42 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.24.139 2021/05/24 10:42:42 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan" 2021/05/24 10:42:42 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan" 2021/05/24 10:42:42 [WARN] memberlist: Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host 2021/05/24 10:42:42 [INFO] agent: (LAN) joined: 2 Err: 2021/05/24 10:42:42 [INFO] agent: Join LAN completed. Synced with 2 initial agents 2021/05/24 10:42:42 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.167.206:8300) (DC: dc1) 2021/05/24 10:42:44 [DEBUG] raft-net: 10.242.26.4:8300 accepted connection from: 10.242.24.139:38858 2021/05/24 10:42:44 [DEBUG] raft-net: 10.242.26.4:8300 accepted connection from: 10.242.24.139:38860 2021/05/24 10:42:44 [INFO] agent: Synced node info 2021/05/24 10:42:44 [INFO] consul: New leader elected: dev-consul-server-0 ==> Failed to check for updates: Get https://checkpoint-api.hashicorp.com/v1/check/consul?arch=amd64&os=linux&signature=23156d43-b3c8-9524-1668-fbad0697b185&version=1.0.6: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/05/24 11:09:48 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:47514->10.242.24.139:8301: i/o timeout 2021/05/24 11:09:48 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:09:50 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations) 2021/05/24 11:09:50 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.24.139 2021/05/24 11:09:50 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:09:51 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:47550->10.242.24.139:8301: i/o timeout 2021/05/24 11:09:51 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:09:52 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:33220->10.242.24.139:8302: i/o timeout 2021/05/24 11:09:52 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:09:58 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.24.139 2021/05/24 11:09:58 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:10:00 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:47672->10.242.24.139:8301: i/o timeout 2021/05/24 11:10:00 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:10:11 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:47812->10.242.24.139:8301: i/o timeout 2021/05/24 11:10:11 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:10:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:47866->10.242.24.139:8301: i/o timeout 2021/05/24 11:10:14 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:10:14 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations) 2021/05/24 11:10:14 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.24.139 2021/05/24 11:10:14 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:10:15 [WARN] raft: Rejecting vote request from 10.242.167.206:8300 since we have a leader: 10.242.24.139:8300 2021/05/24 11:10:15 [DEBUG] raft-net: 10.242.26.4:8300 accepted connection from: 10.242.167.206:36830 2021/05/24 11:10:16 [WARN] raft: Heartbeat timeout from "10.242.24.139:8300" reached, starting election 2021/05/24 11:10:16 [INFO] raft: Node at 10.242.26.4:8300 [Candidate] entering Candidate state in term 3 2021/05/24 11:10:16 [WARN] Unable to get address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93, using fallback address 10.242.24.139:8300: Could not find address for server id 2064e5b4-3552-66e0-b810-8b53b6a67b93 2021/05/24 11:10:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:33620->10.242.24.139:8302: i/o timeout 2021/05/24 11:10:22 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:10:23 [INFO] raft: Node at 10.242.26.4:8300 [Follower] entering Follower state (Leader: "") 2021/05/24 11:10:23 [INFO] consul: New leader elected: dev-consul-server-1 2021/05/24 11:10:23 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:10:23 [ERR] agent: Coordinate update error: rpc error making call: EOF 2021/05/24 11:10:23 [DEBUG] raft-net: 10.242.26.4:8300 accepted connection from: 10.242.167.206:36992 2021/05/24 11:10:24 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:10:24 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.24.139:38840 2021/05/24 11:10:26 [ERR] raft: Failed to make RequestVote RPC to {Voter 2064e5b4-3552-66e0-b810-8b53b6a67b93 10.242.24.139:8300}: read tcp 10.242.26.4:50282->10.242.24.139:8300: i/o timeout 2021/05/24 11:10:31 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0.dc1) 2021/05/24 11:10:31 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.24.139 2021/05/24 11:10:31 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:10:32 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:33748->10.242.24.139:8302: i/o timeout 2021/05/24 11:10:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:48128->10.242.24.139:8301: i/o timeout 2021/05/24 11:10:34 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:10:36 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations) 2021/05/24 11:10:36 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.24.139 2021/05/24 11:10:36 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:10:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:33814->10.242.24.139:8302: i/o timeout 2021/05/24 11:10:37 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:10:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:48152->10.242.24.139:8301: i/o timeout 2021/05/24 11:10:37 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:10:42 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:10:52 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:33994->10.242.24.139:8302: i/o timeout 2021/05/24 11:10:52 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:11:02 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:34068->10.242.24.139:8302: i/o timeout 2021/05/24 11:11:02 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:11:07 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations) 2021/05/24 11:11:07 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.24.139 2021/05/24 11:11:07 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan" 2021/05/24 11:11:12 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:34250->10.242.24.139:8302: i/o timeout 2021/05/24 11:11:12 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:11:42 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:11:45 [ERR] memberlist: failed to receive: read tcp 10.242.26.4:8302->10.242.24.139:46686: i/o timeout from=10.242.24.139:46686 2021/05/24 11:11:45 [ERR] memberlist: Failed to send error: write tcp 10.242.26.4:8302->10.242.24.139:46686: i/o timeout from=10.242.24.139:46686 2021/05/24 11:11:52 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:12:35 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.24.139 2021/05/24 11:12:35 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:12:36 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:49628->10.242.24.139:8301: i/o timeout 2021/05/24 11:12:36 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:12:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:49650->10.242.24.139:8301: i/o timeout 2021/05/24 11:12:39 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:12:40 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations) 2021/05/24 11:12:40 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.24.139 2021/05/24 11:12:40 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:12:42 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:13:03 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.24.139 2021/05/24 11:13:03 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan" 2021/05/24 11:13:03 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-zwnvv 10.242.167.200 2021/05/24 11:13:03 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.24.139 2021/05/24 11:13:03 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:13:03 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-zwnvv 10.242.167.200 2021/05/24 11:13:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:50498->10.242.24.139:8301: i/o timeout 2021/05/24 11:13:42 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:13:54 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:50650->10.242.24.139:8301: i/o timeout 2021/05/24 11:13:54 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:13:54 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations) 2021/05/24 11:13:54 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.24.139 2021/05/24 11:13:54 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:13:57 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:36338->10.242.24.139:8302: i/o timeout 2021/05/24 11:13:57 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:14:12 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:36520->10.242.24.139:8302: i/o timeout 2021/05/24 11:14:12 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:14:13 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:14:13 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.242.24.139:43176 2021/05/24 11:14:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:36590->10.242.24.139:8302: i/o timeout 2021/05/24 11:14:22 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:14:23 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations) 2021/05/24 11:14:23 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.24.139 2021/05/24 11:14:23 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan" 2021/05/24 11:14:32 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:14:43 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.24.139 2021/05/24 11:14:43 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:14:43 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.24.139 2021/05/24 11:14:43 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan" 2021/05/24 11:14:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:51280->10.242.24.139:8301: i/o timeout 2021/05/24 11:14:45 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:14:48 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:51306->10.242.24.139:8301: i/o timeout 2021/05/24 11:14:48 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:14:49 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.24.139 2021/05/24 11:14:49 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:14:49 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0.dc1) 2021/05/24 11:14:50 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.24.139 2021/05/24 11:14:50 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:14:52 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:51382->10.242.24.139:8301: i/o timeout 2021/05/24 11:14:52 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:14:56 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.24.139 2021/05/24 11:14:56 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:14:56 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:51424->10.242.24.139:8301: i/o timeout 2021/05/24 11:14:56 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:14:58 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.24.139 2021/05/24 11:14:58 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:15:04 [WARN] memberlist: Was able to connect to dev-consul-server-0 but other probes failed, network may be misconfigured 2021/05/24 11:15:12 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:51642->10.242.24.139:8301: i/o timeout 2021/05/24 11:15:12 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:15:13 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations) 2021/05/24 11:15:13 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.24.139 2021/05/24 11:15:13 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:15:15 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.24.139 2021/05/24 11:15:15 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:15:16 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:51684->10.242.24.139:8301: i/o timeout 2021/05/24 11:15:16 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:15:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:51704->10.242.24.139:8301: i/o timeout 2021/05/24 11:15:19 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:15:20 [INFO] memberlist: Marking dev-consul-server-0 as failed, suspect timeout reached (2 peer confirmations) 2021/05/24 11:15:20 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.24.139 2021/05/24 11:15:20 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:15:22 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:37410->10.242.24.139:8302: i/o timeout 2021/05/24 11:15:22 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:15:32 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:37542->10.242.24.139:8302: i/o timeout 2021/05/24 11:15:32 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:15:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:37610->10.242.24.139:8302: i/o timeout 2021/05/24 11:15:42 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:15:42 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:15:43 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.24.139 2021/05/24 11:15:43 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan" 2021/05/24 11:16:03 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:16:22 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:17:32 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:18:03 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:18:12 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:19:03 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:19:52 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:20:33 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:21:33 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:23:03 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:24:27 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:25:33 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:26:32 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:27:03 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:28:03 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:28:42 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:29:03 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:30:20 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.24.139 2021/05/24 11:30:20 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan" 2021/05/24 11:30:32 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:50224->10.242.24.139:8302: i/o timeout 2021/05/24 11:30:32 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:30:47 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:50386->10.242.24.139:8302: i/o timeout 2021/05/24 11:30:47 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:30:57 [ERR] memberlist: Failed fallback ping: read tcp 10.242.26.4:50624->10.242.24.139:8302: i/o timeout 2021/05/24 11:30:57 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:31:02 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations) 2021/05/24 11:31:02 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.24.139 2021/05/24 11:31:02 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan" 2021/05/24 11:31:03 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:32:33 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:32:52 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:33:19 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:33:32 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:34:03 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:34:42 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:36:03 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:36:16 [ERR] yamux: keepalive failed: i/o deadline reached 2021/05/24 11:36:52 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:37:32 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:37:33 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:38:24 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.24.139 2021/05/24 11:38:24 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan" 2021/05/24 11:38:24 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.24.139 2021/05/24 11:38:24 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:38:27 [WARN] raft: Rejecting vote request from 10.242.24.139:8300 since we have a leader: 10.242.167.206:8300 2021/05/24 11:38:33 [WARN] raft: Rejecting vote request from 10.242.24.139:8300 since we have a leader: 10.242.167.206:8300 2021/05/24 11:38:35 [INFO] consul: New leader elected: dev-consul-server-1 2021/05/24 11:38:36 [DEBUG] raft-net: 10.242.26.4:8300 accepted connection from: 10.242.167.206:39510 2021/05/24 11:38:43 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:38:54 [INFO] serf: EventMemberFailed: dev-consul-server-0 10.242.24.139 2021/05/24 11:38:54 [INFO] consul: Removing LAN server dev-consul-server-0 (Addr: tcp/10.242.24.139:8300) (DC: dc1) 2021/05/24 11:38:56 [INFO] memberlist: Suspect dev-consul-server-0 has failed, no acks received 2021/05/24 11:39:15 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:39:24 [ERR] memberlist: Conflicting address for dev-consul-server-0.dc1. Mine: 10.242.24.139:8302 Theirs: 10.242.24.185:8302 2021/05/24 11:39:24 [WARN] serf: Name conflict for 'dev-consul-server-0.dc1' both 10.242.24.139:8302 and 10.242.24.185:8302 are claiming 2021/05/24 11:39:24 [ERR] memberlist: Conflicting address for dev-consul-server-0. Mine: 10.242.24.139:8301 Theirs: 10.242.24.185:8301 2021/05/24 11:39:24 [WARN] serf: Name conflict for 'dev-consul-server-0' both 10.242.24.139:8301 and 10.242.24.185:8301 are claiming 2021/05/24 11:39:24 [ERR] memberlist: Conflicting address for dev-consul-server-0. Mine: 10.242.24.139:8301 Theirs: 10.242.24.185:8301 2021/05/24 11:39:24 [WARN] serf: Name conflict for 'dev-consul-server-0' both 10.242.24.139:8301 and 10.242.24.185:8301 are claiming 2021/05/24 11:39:24 [ERR] memberlist: Conflicting address for dev-consul-server-0. Mine: 10.242.24.139:8301 Theirs: 10.242.24.185:8301 2021/05/24 11:39:24 [WARN] serf: Name conflict for 'dev-consul-server-0' both 10.242.24.139:8301 and 10.242.24.185:8301 are claiming 2021/05/24 11:39:24 [ERR] memberlist: Conflicting address for dev-consul-server-0. Mine: 10.242.24.139:8301 Theirs: 10.242.24.185:8301 2021/05/24 11:39:24 [WARN] serf: Name conflict for 'dev-consul-server-0' both 10.242.24.139:8301 and 10.242.24.185:8301 are claiming 2021/05/24 11:39:24 [ERR] memberlist: Conflicting address for dev-consul-server-0. Mine: 10.242.24.139:8301 Theirs: 10.242.24.185:8301 2021/05/24 11:39:24 [WARN] serf: Name conflict for 'dev-consul-server-0' both 10.242.24.139:8301 and 10.242.24.185:8301 are claiming 2021/05/24 11:39:25 [ERR] memberlist: Conflicting address for dev-consul-server-0.dc1. Mine: 10.242.24.139:8302 Theirs: 10.242.24.185:8302 2021/05/24 11:39:25 [WARN] serf: Name conflict for 'dev-consul-server-0.dc1' both 10.242.24.139:8302 and 10.242.24.185:8302 are claiming 2021/05/24 11:39:25 [ERR] memberlist: Conflicting address for dev-consul-server-0.dc1. Mine: 10.242.24.139:8302 Theirs: 10.242.24.185:8302 2021/05/24 11:39:25 [WARN] serf: Name conflict for 'dev-consul-server-0.dc1' both 10.242.24.139:8302 and 10.242.24.185:8302 are claiming 2021/05/24 11:39:31 [ERR] memberlist: Push/Pull with dev-consul-server-0.dc1 failed: dial tcp 10.242.24.139:8302: i/o timeout 2021/05/24 11:39:45 [INFO] memberlist: Marking dev-consul-server-0.dc1 as failed, suspect timeout reached (0 peer confirmations) 2021/05/24 11:39:45 [INFO] serf: EventMemberFailed: dev-consul-server-0.dc1 10.242.24.139 2021/05/24 11:39:45 [INFO] consul: Handled member-failed event for server "dev-consul-server-0.dc1" in area "wan" 2021/05/24 11:39:50 [INFO] memberlist: Suspect dev-consul-server-0.dc1 has failed, no acks received 2021/05/24 11:40:03 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:40:12 [INFO] serf: attempting reconnect to dev-consul-server-0 10.242.24.139:8301 2021/05/24 11:40:16 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.24.185 2021/05/24 11:40:16 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.24.185:8300) (DC: dc1) 2021/05/24 11:40:34 [ERR] memberlist: Conflicting address for dev-consul-server-0.dc1. Mine: 10.242.24.139:8302 Theirs: 10.242.24.185:8302 2021/05/24 11:40:34 [WARN] serf: Name conflict for 'dev-consul-server-0.dc1' both 10.242.24.139:8302 and 10.242.24.185:8302 are claiming 2021/05/24 11:41:03 [INFO] serf: attempting reconnect to dev-consul-server-0.dc1 10.242.24.139:8302 2021/05/24 11:41:34 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.24.185 2021/05/24 11:41:34 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan"