By type
+ CONSUL_BIND= + [ -n ] + CONSUL_CLIENT= + [ -n ] + CONSUL_DATA_DIR=/consul/data + CONSUL_CONFIG_DIR=/consul/config + [ -n ] + [ a = - ] + [ agent = agent ] + shift + set -- consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui + [ consul = consul ] + stat -c %u /consul/data + id -u consul + [ 100 != 100 ] + stat -c %u /consul/config + id -u consul + [ 100 != 100 ] + [ ! -z ] + exec consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=dev-consul-server-0.consul-server -retry-join=dev-consul-server-1.consul-server -retry-join=dev-consul-server-2.consul-server -client=0.0.0.0 -server -ui bootstrap_expect > 0: expecting 3 servers ==> Starting Consul agent... ==> Consul agent running! Version: 'v1.0.6' Node ID: '72c8a722-0bdc-1ec0-97cd-64c3485155b2' Node name: 'dev-consul-server-0' Datacenter: 'dc1' (Segment: '
') Server: true (Bootstrap: false) Client Addr: [0.0.0.0] (HTTP: 8500, HTTPS: -1, DNS: 8600) Cluster Addr: 10.242.38.132 (LAN: 8301, WAN: 8302) Encrypt: Gossip: false, TLS-Outgoing: false, TLS-Incoming: false ==> Log data will now stream in as it occurs: 2021/07/26 09:38:29 [INFO] raft: Initial configuration (index=0): [] 2021/07/26 09:38:30 [INFO] agent: Joining LAN cluster... 2021/07/26 09:38:29 [INFO] raft: Node at 10.242.38.132:8300 [Follower] entering Follower state (Leader: "") 2021/07/26 09:38:30 [INFO] serf: EventMemberJoin: dev-consul-server-0.dc1 10.242.38.132 2021/07/26 09:38:30 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.38.132 2021/07/26 09:38:30 [INFO] consul: Handled member-join event for server "dev-consul-server-0.dc1" in area "wan" 2021/07/26 09:38:30 [INFO] agent: Started DNS server 0.0.0.0:8600 (udp) 2021/07/26 09:38:30 [INFO] agent: Started DNS server 0.0.0.0:8600 (tcp) 2021/07/26 09:38:30 [INFO] consul: Adding LAN server dev-consul-server-0 (Addr: tcp/10.242.38.132:8300) (DC: dc1) 2021/07/26 09:38:30 [INFO] agent: Started HTTP server on [::]:8500 (tcp) 2021/07/26 09:38:30 [INFO] agent: started state syncer 2021/07/26 09:38:30 [INFO] agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce os scaleway softlayer 2021/07/26 09:38:30 [INFO] agent: (LAN) joining: [dev-consul-server-0.consul-server dev-consul-server-1.consul-server dev-consul-server-2.consul-server] 2021/07/26 09:38:30 [WARN] memberlist: Failed to resolve dev-consul-server-0.consul-server: lookup dev-consul-server-0.consul-server on 10.96.0.10:53: no such host 2021/07/26 09:38:30 [WARN] memberlist: Failed to resolve dev-consul-server-1.consul-server: lookup dev-consul-server-1.consul-server on 10.96.0.10:53: no such host 2021/07/26 09:38:30 [WARN] memberlist: Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host 2021/07/26 09:38:30 [INFO] agent: (LAN) joined: 0 Err: 3 error(s) occurred: * Failed to resolve dev-consul-server-0.consul-server: lookup dev-consul-server-0.consul-server on 10.96.0.10:53: no such host * Failed to resolve dev-consul-server-1.consul-server: lookup dev-consul-server-1.consul-server on 10.96.0.10:53: no such host * Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host 2021/07/26 09:38:30 [WARN] agent: Join LAN failed: , retrying in 30s 2021/07/26 09:38:35 [WARN] raft: no known peers, aborting election 2021/07/26 09:38:37 [ERR] agent: failed to sync remote state: No cluster leader ==> Failed to check for updates: Get https://checkpoint-api.hashicorp.com/v1/check/consul?arch=amd64&os=linux&signature=1a86e1ce-1b97-dc72-dc90-eb6f17559033&version=1.0.6: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/07/26 09:38:59 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-q46vw 10.242.232.134 2021/07/26 09:39:00 [INFO] agent: (LAN) joining: [dev-consul-server-0.consul-server dev-consul-server-1.consul-server dev-consul-server-2.consul-server] 2021/07/26 09:39:00 [WARN] memberlist: Failed to resolve dev-consul-server-1.consul-server: lookup dev-consul-server-1.consul-server on 10.96.0.10:53: no such host 2021/07/26 09:39:00 [WARN] memberlist: Failed to resolve dev-consul-server-2.consul-server: lookup dev-consul-server-2.consul-server on 10.96.0.10:53: no such host 2021/07/26 09:39:00 [INFO] agent: (LAN) joined: 1 Err: 2021/07/26 09:39:00 [INFO] agent: Join LAN completed. Synced with 1 initial agents 2021/07/26 09:39:01 [ERR] agent: failed to sync remote state: No cluster leader 2021/07/26 09:39:03 [ERR] agent: Coordinate update error: No cluster leader 2021/07/26 09:39:25 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.136.9 2021/07/26 09:39:25 [INFO] consul: Adding LAN server dev-consul-server-1 (Addr: tcp/10.242.136.9:8300) (DC: dc1) 2021/07/26 09:39:25 [INFO] serf: EventMemberJoin: dev-consul-server-1.dc1 10.242.136.9 2021/07/26 09:39:25 [INFO] consul: Handled member-join event for server "dev-consul-server-1.dc1" in area "wan" 2021/07/26 09:39:36 [ERR] agent: failed to sync remote state: No cluster leader 2021/07/26 09:39:37 [ERR] agent: Coordinate update error: No cluster leader 2021/07/26 09:40:08 [ERR] agent: failed to sync remote state: No cluster leader 2021/07/26 09:40:12 [ERR] agent: Coordinate update error: No cluster leader 2021/07/26 09:40:34 [ERR] agent: failed to sync remote state: No cluster leader 2021/07/26 09:40:41 [ERR] agent: Coordinate update error: No cluster leader 2021/07/26 09:41:07 [ERR] agent: failed to sync remote state: No cluster leader 2021/07/26 09:41:16 [ERR] agent: Coordinate update error: No cluster leader 2021/07/26 09:41:37 [ERR] agent: failed to sync remote state: No cluster leader 2021/07/26 09:41:44 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.129.145 2021/07/26 09:41:44 [INFO] consul: Adding LAN server dev-consul-server-2 (Addr: tcp/10.242.129.145:8300) (DC: dc1) 2021/07/26 09:41:44 [INFO] consul: Found expected number of peers, attempting bootstrap: 10.242.38.132:8300,10.242.136.9:8300,10.242.129.145:8300 2021/07/26 09:41:45 [INFO] serf: EventMemberJoin: dev-consul-server-2.dc1 10.242.129.145 2021/07/26 09:41:45 [INFO] consul: Handled member-join event for server "dev-consul-server-2.dc1" in area "wan" 2021/07/26 09:41:51 [ERR] agent: Coordinate update error: No cluster leader 2021/07/26 09:41:52 [WARN] raft: Heartbeat timeout from "" reached, starting election 2021/07/26 09:41:52 [INFO] raft: Node at 10.242.38.132:8300 [Candidate] entering Candidate state in term 2 2021/07/26 09:41:52 [INFO] raft: Election won. Tally: 2 2021/07/26 09:41:52 [INFO] raft: Node at 10.242.38.132:8300 [Leader] entering Leader state 2021/07/26 09:41:52 [INFO] raft: Added peer d447310c-5c13-f5af-7cc4-f8505ea2fa56, starting replication 2021/07/26 09:41:52 [INFO] raft: Added peer 58c71edb-bacd-8dd6-c4ab-63327f8262a7, starting replication 2021/07/26 09:41:52 [INFO] consul: cluster leadership acquired 2021/07/26 09:41:52 [INFO] consul: New leader elected: dev-consul-server-0 2021/07/26 09:41:52 [WARN] raft: AppendEntries to {Voter d447310c-5c13-f5af-7cc4-f8505ea2fa56 10.242.136.9:8300} rejected, sending older logs (next: 1) 2021/07/26 09:41:52 [INFO] raft: pipelining replication to peer {Voter d447310c-5c13-f5af-7cc4-f8505ea2fa56 10.242.136.9:8300} 2021/07/26 09:41:52 [INFO] consul: member 'dev-consul-server-0' joined, marking health alive 2021/07/26 09:41:53 [INFO] consul: member 'dev-consul-7467bf7b46-q46vw' joined, marking health alive 2021/07/26 09:41:53 [INFO] consul: member 'dev-consul-server-1' joined, marking health alive 2021/07/26 09:41:53 [INFO] consul: member 'dev-consul-server-2' joined, marking health alive 2021/07/26 09:41:53 [INFO] agent: Synced node info 2021/07/26 09:41:53 [DEBUG] raft-net: 10.242.38.132:8300 accepted connection from: 10.242.129.145:36332 2021/07/26 09:41:53 [WARN] raft: Rejecting vote request from 10.242.129.145:8300 since we have a leader: 10.242.38.132:8300 2021/07/26 09:41:53 [INFO] raft: pipelining replication to peer {Voter 58c71edb-bacd-8dd6-c4ab-63327f8262a7 10.242.129.145:8300} 2021/07/26 09:42:11 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:42:12 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:42:15 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:42:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:42:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:42:21 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:42:21 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/07/26 09:42:57 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:43:01 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:43:03 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:43:07 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:43:07 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/07/26 09:43:23 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:43:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:43:31 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:43:47 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:44:53 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:44:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:45:03 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:45:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:45:15 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:45:17 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:45:19 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:45:32 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:45:32 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/07/26 09:45:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:45:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:45:55 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:46:01 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:46:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:46:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:46:04 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:46:23 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:46:24 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:46:26 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:46:37 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:46:53 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:46:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:47:42 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:47:55 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:47:55 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:47:56 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:48:37 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:48:37 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/07/26 09:48:37 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/07/26 09:48:38 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:48:41 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:48:45 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:48:45 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:48:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:48:48 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:48:50 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:48:57 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:48:57 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/07/26 09:48:58 [WARN] consul: error getting server health from "dev-consul-server-0": last request still outstanding 2021/07/26 09:49:16 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:49:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:49:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:49:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:49:53 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:49:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:49:57 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:49:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:50:00 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:50:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:50:08 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:50:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:50:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:50:10 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:50:15 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:50:15 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:50:16 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:50:19 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:55:31 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:55:43 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:55:53 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:55:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:55:56 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:56:09 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:56:19 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:56:19 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/07/26 09:58:53 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:58:53 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/07/26 09:58:53 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/07/26 09:59:11 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:59:15 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:59:31 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:59:31 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/07/26 09:59:32 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:59:35 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:59:36 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:59:41 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:59:42 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:59:45 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:59:46 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:59:51 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:59:52 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 09:59:57 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 09:59:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 10:00:08 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 10:00:08 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/07/26 10:00:08 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/07/26 10:00:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 10:00:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 10:00:51 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 10:00:53 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 10:00:54 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 10:00:57 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 10:00:57 [WARN] consul: error getting server health from "dev-consul-server-0": context deadline exceeded 2021/07/26 10:00:58 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 10:01:01 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 10:01:02 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 10:01:07 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 10:01:08 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 10:01:27 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 10:01:28 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 10:01:43 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 10:02:17 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 10:02:18 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 10:02:27 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 10:03:13 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 10:03:14 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 10:03:19 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded 2021/07/26 10:03:19 [WARN] consul: error getting server health from "dev-consul-server-1": context deadline exceeded 2021/07/26 10:03:20 [WARN] consul: error getting server health from "dev-consul-server-2": last request still outstanding 2021/07/26 10:06:17 [WARN] consul: error getting server health from "dev-consul-server-2": context deadline exceeded