By type
+ CONSUL_BIND= + [ -n ] + CONSUL_CLIENT= + [ -n ] + CONSUL_DATA_DIR=/consul/data + CONSUL_CONFIG_DIR=/consul/config + [ -n ] + [ a = - ] + [ agent = agent ] + shift + set -- consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui + [ consul = consul ] + stat -c %u /consul/data + id -u consul + [ 100 != 100 ] + stat -c %u /consul/config + id -u consul + [ 100 != 100 ] + [ ! -z ] + exec consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui bootstrap_expect > 0: expecting 3 servers ==> Starting Consul agent... ==> Consul agent running! Version: 'v1.0.6' Node ID: '72cb5236-0268-cda0-f11c-930283a62f22' Node name: 'dev-consul-server-0' Datacenter: 'dc1' (Segment: '
') Server: true (Bootstrap: false) Client Addr: [0.0.0.0] (HTTP: 8500, HTTPS: -1, DNS: 8600) Cluster Addr: 10.242.96.138 (LAN: 8301, WAN: 8302) Encrypt: Gossip: false, TLS-Outgoing: false, TLS-Incoming: false ==> Log data will now stream in as it occurs: 2021/06/11 22:39:37 [INFO] raft: Initial configuration (index=0): [] 2021/06/11 22:39:37 [INFO] raft: Node at 10.242.96.138:8300 [Follower] entering Follower state (Leader: "") 2021/06/11 22:39:37 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.96.138 2021/06/11 22:39:37 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.96.138 2021/06/11 22:39:37 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.96.138:8300) (DC: dc1) 2021/06/11 22:39:37 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan" 2021/06/11 22:39:37 [INFO] agent: Started DNS server 0.0.0.0:8600 (udp) 2021/06/11 22:39:37 [INFO] agent: Started DNS server 0.0.0.0:8600 (tcp) 2021/06/11 22:39:37 [INFO] agent: Started HTTP server on [::]:8500 (tcp) 2021/06/11 22:39:37 [INFO] agent: started state syncer 2021/06/11 22:39:37 [INFO] agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce os scaleway softlayer 2021/06/11 22:39:37 [INFO] agent: Joining LAN cluster... 2021/06/11 22:39:37 [INFO] agent: (LAN) joining: [dev-consul-server-0.consul-server dev-consul-server-1.consul-server dev-consul-server-2.consul-server] 2021/06/11 22:39:40 [WARN] memberlist: Failed to resolve dev-consul-server-0.consul-server: lookup dev-consul-server-0.consul-server on 10.96.0.10:53: no such host 2021/06/11 22:39:40 [WARN] memberlist: Failed to resolve dev-consul-server-1.consul-server: lookup dev-consul-server-1.consul-server on 10.96.0.10:53: no such host 2021/06/11 22:39:41 [WARN] memberlist: Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host 2021/06/11 22:39:41 [INFO] agent: (LAN) joined: 0 Err: 3 error(s) occurred: * Failed to resolve dev-consul-server-0.consul-server: lookup dev-consul-server-0.consul-server on 10.96.0.10:53: no such host * Failed to resolve dev-consul-server-1.consul-server: lookup dev-consul-server-1.consul-server on 10.96.0.10:53: no such host * Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host 2021/06/11 22:39:41 [WARN] agent: Join LAN failed: , retrying in 30s 2021/06/11 22:39:43 [WARN] raft: no known peers, aborting election 2021/06/11 22:39:44 [ERR] agent: failed to sync remote state: No cluster leader ==> Failed to check for updates: Get https://checkpoint-api.hashicorp.com/v1/check/consul?arch=amd64&os=linux&signature=2ab2c12c-37d1-f6a2-2658-c98cc2dfdea0&version=1.0.6: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/11 22:39:58 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-db87f 10.242.133.198 2021/06/11 22:40:04 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.66.8 2021/06/11 22:40:04 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.66.8:8300) (DC: dc1) 2021/06/11 22:40:04 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.66.8 2021/06/11 22:40:04 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan" 2021/06/11 22:40:11 [INFO] agent: (LAN) joining: [dev-consul-server-0.consul-server dev-consul-server-1.consul-server dev-consul-server-2.consul-server] 2021/06/11 22:40:11 [WARN] memberlist: Failed to resolve dev-consul-server-1.consul-server: lookup dev-consul-server-1.consul-server on 10.96.0.10:53: no such host 2021/06/11 22:40:11 [WARN] memberlist: Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host 2021/06/11 22:40:11 [INFO] agent: (LAN) joined: 1 Err: 2021/06/11 22:40:11 [INFO] agent: Join LAN completed. Synced with 1 initial agents 2021/06/11 22:40:11 [ERR] agent: failed to sync remote state: No cluster leader 2021/06/11 22:40:12 [ERR] agent: Coordinate update error: No cluster leader 2021/06/11 22:40:20 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.133.204 2021/06/11 22:40:20 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.133.204:8300) (DC: dc1) 2021/06/11 22:40:20 [INFO] consul: Existing Raft peers reported by dev-consul-server-2, disabling bootstrap mode 2021/06/11 22:40:20 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.133.204 2021/06/11 22:40:20 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan" 2021/06/11 22:40:28 [DEBUG] raft-net: 10.242.96.138:8300 accepted connection from: 10.242.133.204:59286 2021/06/11 22:40:28 [WARN] raft: Failed to get previous log: 1 log not found (last: 0) 2021/06/11 22:40:29 [INFO] consul: New leader elected: dev-consul-server-2 2021/06/11 22:40:29 [DEBUG] raft-net: 10.242.96.138:8300 accepted connection from: 10.242.133.204:59302 2021/06/11 22:40:29 [INFO] agent: Synced node info 2021/06/12 00:00:13 [DEBUG] raft-net: 10.242.96.138:8300 accepted connection from: 10.242.133.204:49334 2021/06/12 00:00:14 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2) 2021/06/12 00:00:16 [ERR] memberlist: Failed fallback ping: write tcp 10.242.96.138:52678->10.242.133.204:8301: i/o timeout 2021/06/12 00:00:16 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received 2021/06/12 00:00:22 [DEBUG] raft-net: 10.242.96.138:8300 accepted connection from: 10.242.133.204:49500 2021/06/12 00:00:32 [DEBUG] raft-net: 10.242.96.138:8300 accepted connection from: 10.242.133.204:49668 2021/06/12 00:00:42 [DEBUG] raft-net: 10.242.96.138:8300 accepted connection from: 10.242.133.204:49822 2021/06/12 00:00:42 [ERR] memberlist: Failed fallback ping: write tcp 10.242.96.138:57384->10.242.133.198:8301: i/o timeout 2021/06/12 00:00:43 [INFO] memberlist: Suspect dev-consul-7467bf7b46-db87f has failed, no acks received 2021/06/12 00:00:52 [DEBUG] raft-net: 10.242.96.138:8300 accepted connection from: 10.242.133.204:50004 2021/06/12 00:00:52 [ERR] memberlist: Failed fallback ping: write tcp 10.242.96.138:56080->10.242.133.204:8301: i/o timeout 2021/06/12 00:00:52 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received 2021/06/12 00:00:53 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2) 2021/06/12 00:00:59 [ERR] raft-net: Failed to flush response: write tcp 10.242.96.138:8300->10.242.133.204:59286: write: broken pipe 2021/06/12 00:01:02 [DEBUG] raft-net: 10.242.96.138:8300 accepted connection from: 10.242.133.204:50164 2021/06/12 00:01:13 [DEBUG] raft-net: 10.242.96.138:8300 accepted connection from: 10.242.133.204:50344 2021/06/12 00:01:23 [DEBUG] raft-net: 10.242.96.138:8300 accepted connection from: 10.242.133.204:50538 2021/06/12 00:01:24 [ERR] memberlist: Failed fallback ping: write tcp 10.242.96.138:46716->10.242.66.8:8301: i/o timeout 2021/06/12 00:01:41 [ERR] memberlist: Failed fallback ping: write tcp 10.242.96.138:48022->10.242.66.8:8301: i/o timeout 2021/06/12 00:01:41 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received 2021/06/12 00:01:52 [WARN] memberlist: Refuting a suspect message (from: dev-consul-7467bf7b46-db87f) 2021/06/12 00:01:52 [ERR] memberlist: Failed fallback ping: write tcp 10.242.96.138:48564->10.242.66.8:8301: i/o timeout 2021/06/12 00:01:52 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received 2021/06/12 00:01:57 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2) 2021/06/12 00:03:57 [WARN] memberlist: Refuting a suspect message (from: dev-consul-7467bf7b46-db87f) 2021/06/12 00:04:41 [ERR] memberlist: Failed fallback ping: write tcp 10.242.96.138:35150->10.242.66.8:8301: i/o timeout 2021/06/12 00:04:48 [DEBUG] raft-net: 10.242.96.138:8300 accepted connection from: 10.242.133.204:53694 2021/06/12 00:04:48 [DEBUG] raft-net: 10.242.96.138:8300 accepted connection from: 10.242.133.204:53856 2021/06/12 00:04:48 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received 2021/06/12 00:04:48 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2.dc1) 2021/06/12 00:04:48 [DEBUG] raft-net: 10.242.96.138:8300 accepted connection from: 10.242.133.204:53768 2021/06/12 00:04:49 [ERR] yamux: keepalive failed: session shutdown 2021/06/12 00:04:49 [ERR] memberlist: Failed fallback ping: write tcp 10.242.96.138:32966->10.242.66.8:8302: i/o timeout 2021/06/12 00:04:49 [INFO] memberlist: Suspect dev-consul-server-1.dc1 has failed, no acks received 2021/06/12 00:04:52 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-0) 2021/06/12 00:04:52 [ERR] raft-net: Failed to flush response: write tcp 10.242.96.138:8300->10.242.133.204:50164: write: broken pipe 2021/06/12 00:04:52 [ERR] memberlist: Failed fallback ping: write tcp 10.242.96.138:47242->10.242.133.204:8301: i/o timeout 2021/06/12 00:04:52 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received 2021/06/12 00:04:57 [ERR] memberlist: Failed fallback ping: write tcp 10.242.96.138:49618->10.242.133.198:8301: i/o timeout 2021/06/12 00:04:57 [INFO] memberlist: Suspect dev-consul-7467bf7b46-db87f has failed, no acks received 2021/06/12 00:04:57 [WARN] memberlist: Refuting a suspect message (from: dev-consul-7467bf7b46-db87f) 2021/06/12 00:05:02 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1) 2021/06/12 00:05:09 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1) 2021/06/12 00:05:09 [ERR] memberlist: Failed fallback ping: write tcp 10.242.96.138:35524->10.242.66.8:8301: i/o timeout 2021/06/12 00:05:09 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received 2021/06/12 00:05:14 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2) 2021/06/12 00:05:17 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1) 2021/06/12 00:05:32 [DEBUG] raft-net: 10.242.96.138:8300 accepted connection from: 10.242.133.204:54620 2021/06/12 00:05:32 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2) 2021/06/12 00:05:32 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2.dc1) 2021/06/12 00:05:32 [DEBUG] raft-net: 10.242.96.138:8300 accepted connection from: 10.242.133.204:54640 2021/06/12 00:05:32 [ERR] raft-net: Failed to flush response: write tcp 10.242.96.138:8300->10.242.133.204:53856: write: broken pipe 2021/06/12 00:06:22 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1) 2021/06/12 00:06:23 [ERR] memberlist: Failed fallback ping: write tcp 10.242.96.138:36768->10.242.66.8:8301: i/o timeout 2021/06/12 00:06:23 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received 2021/06/12 00:07:56 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-2) 2021/06/12 00:08:04 [ERR] memberlist: Failed fallback ping: write tcp 10.242.96.138:50706->10.242.133.204:8301: i/o timeout 2021/06/12 00:08:04 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received 2021/06/12 00:08:04 [WARN] memberlist: Refuting a suspect message (from: dev-consul-7467bf7b46-db87f) 2021/06/12 00:23:12 [ERR] memberlist: Failed fallback ping: write tcp 10.242.96.138:34382->10.242.133.198:8301: i/o timeout 2021/06/12 00:23:13 [WARN] memberlist: Refuting a suspect message (from: dev-consul-7467bf7b46-db87f) 2021/06/12 00:23:23 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1) 2021/06/12 00:23:23 [WARN] memberlist: Was able to connect to dev-consul-7467bf7b46-db87f but other probes failed, network may be misconfigured