By type
+ CONSUL_BIND=
+ [ -n ]
+ CONSUL_CLIENT=
+ [ -n ]
+ CONSUL_DATA_DIR=/consul/data
+ CONSUL_CONFIG_DIR=/consul/config
+ [ -n ]
+ [ a = - ]
+ [ agent = agent ]
+ shift
+ set -- consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=onap-consul-server-0.consul-server -retry-join=onap-consul-server-1.consul-server -retry-join=onap-consul-server-2.consul-server -client=0.0.0.0 -server -ui
+ [ consul = consul ]
+ stat -c %u /consul/data
+ id -u consul
+ [ 100 != 100 ]
+ stat -c %u /consul/config
+ id -u consul
+ [ 100 != 100 ]
+ [ ! -z ]
+ exec consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=onap-consul-server-0.consul-server -retry-join=onap-consul-server-1.consul-server -retry-join=onap-consul-server-2.consul-server -client=0.0.0.0 -server -ui
bootstrap_expect > 0: expecting 3 servers
==> Starting Consul agent...
==> Consul agent running!
Version: 'v1.0.6'
Node ID: '29edaf0d-2964-381a-6ab6-64ea4d6139c1'
Node name: 'onap-consul-server-2'
Datacenter: 'dc1' (Segment: '')
Server: true (Bootstrap: false)
Client Addr: [0.0.0.0] (HTTP: 8500, HTTPS: -1, DNS: 8600)
Cluster Addr: 10.233.74.243 (LAN: 8301, WAN: 8302)
Encrypt: Gossip: false, TLS-Outgoing: false, TLS-Incoming: false
==> Log data will now stream in as it occurs:
2021/04/30 04:07:52 [INFO] raft: Initial configuration (index=0): []
2021/04/30 04:07:52 [INFO] raft: Node at 10.233.74.243:8300 [Follower] entering Follower state (Leader: "")
2021/04/30 04:07:52 [INFO] serf: EventMemberJoin: onap-consul-server-2.dc1 10.233.74.243
2021/04/30 04:07:52 [INFO] serf: EventMemberJoin: onap-consul-server-2 10.233.74.243
2021/04/30 04:07:52 [INFO] consul: Adding LAN server onap-consul-server-2 (Addr: tcp/10.233.74.243:8300) (DC: dc1)
2021/04/30 04:07:52 [INFO] consul: Handled member-join event for server "onap-consul-server-2.dc1" in area "wan"
2021/04/30 04:07:52 [INFO] agent: Started DNS server 0.0.0.0:8600 (tcp)
2021/04/30 04:07:52 [INFO] agent: Started DNS server 0.0.0.0:8600 (udp)
2021/04/30 04:07:52 [INFO] agent: Started HTTP server on [::]:8500 (tcp)
2021/04/30 04:07:52 [INFO] agent: started state syncer
2021/04/30 04:07:52 [INFO] agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce os scaleway softlayer
2021/04/30 04:07:52 [INFO] agent: Joining LAN cluster...
2021/04/30 04:07:52 [INFO] agent: (LAN) joining: [onap-consul-server-0.consul-server onap-consul-server-1.consul-server onap-consul-server-2.consul-server]
2021/04/30 04:07:54 [INFO] serf: EventMemberJoin: onap-consul-server-1 10.233.71.152
2021/04/30 04:07:54 [INFO] serf: EventMemberJoin: onap-consul-server-0 10.233.77.170
2021/04/30 04:07:54 [INFO] serf: EventMemberJoin: onap-consul-cccf8dcbb-w5nfk 10.233.78.4
2021/04/30 04:07:54 [INFO] consul: Adding LAN server onap-consul-server-1 (Addr: tcp/10.233.71.152:8300) (DC: dc1)
2021/04/30 04:07:54 [INFO] consul: Existing Raft peers reported by onap-consul-server-0, disabling bootstrap mode
2021/04/30 04:07:54 [INFO] consul: Adding LAN server onap-consul-server-0 (Addr: tcp/10.233.77.170:8300) (DC: dc1)
2021/04/30 04:07:54 [INFO] serf: EventMemberJoin: onap-consul-server-1.dc1 10.233.71.152
2021/04/30 04:07:54 [INFO] serf: EventMemberJoin: onap-consul-server-0.dc1 10.233.77.170
2021/04/30 04:07:54 [INFO] consul: Handled member-join event for server "onap-consul-server-1.dc1" in area "wan"
2021/04/30 04:07:54 [INFO] consul: Handled member-join event for server "onap-consul-server-0.dc1" in area "wan"
2021/04/30 04:07:54 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.77.170:47432
2021/04/30 04:07:55 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.77.170:47442
2021/04/30 04:07:55 [WARN] raft: Failed to get previous log: 1 log not found (last: 0)
2021/04/30 04:07:55 [INFO] consul: New leader elected: onap-consul-server-0
2021/04/30 04:07:56 [INFO] agent: Synced node info
2021/04/30 04:07:58 [WARN] memberlist: Failed to resolve onap-consul-server-2.consul-server: lookup onap-consul-server-2.consul-server on 169.254.25.10:53: no such host
2021/04/30 04:07:58 [INFO] agent: (LAN) joined: 2 Err:
2021/04/30 04:07:58 [INFO] agent: Join LAN completed. Synced with 2 initial agents
==> Newer Consul version available: 1.9.5 (currently running: 1.0.6)
2021/04/30 04:33:48 [WARN] memberlist: Refuting a suspect message (from: onap-consul-server-1)
2021/04/30 04:33:57 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.77.170:33564
2021/04/30 04:34:07 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.77.170:33662
2021/04/30 04:34:17 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.77.170:33766
2021/04/30 04:34:27 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.77.170:33850
2021/04/30 04:34:37 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.77.170:33966
2021/04/30 04:34:47 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.77.170:34064
2021/04/30 04:34:58 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.77.170:34172
2021/04/30 04:35:08 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.77.170:34274
2021/04/30 04:35:18 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.77.170:34382
2021/04/30 04:35:29 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.77.170:34484
2021/04/30 04:35:37 [ERR] memberlist: Failed fallback ping: read tcp 10.233.74.243:59128->10.233.77.170:8301: i/o timeout
2021/04/30 04:35:37 [INFO] memberlist: Suspect onap-consul-server-0 has failed, no acks received
2021/04/30 04:35:42 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.77.170:34630
2021/04/30 04:35:47 [ERR] memberlist: Failed fallback ping: write tcp 10.233.74.243:48770->10.233.71.152:8301: i/o timeout
2021/04/30 04:35:47 [INFO] memberlist: Suspect onap-consul-server-1 has failed, no acks received
2021/04/30 04:35:58 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.77.170:34790
2021/04/30 04:35:59 [ERR] raft-net: Failed to flush response: write tcp 10.233.74.243:8300->10.233.77.170:47432: write: broken pipe
2021/04/30 04:36:11 [ERR] memberlist: Failed fallback ping: read tcp 10.233.74.243:59454->10.233.77.170:8301: i/o timeout
2021/04/30 04:36:11 [INFO] memberlist: Suspect onap-consul-server-0 has failed, no acks received
2021/04/30 04:36:12 [INFO] serf: EventMemberFailed: onap-consul-server-0 10.233.77.170
2021/04/30 04:36:12 [INFO] consul: Removing LAN server onap-consul-server-0 (Addr: tcp/10.233.77.170:8300) (DC: dc1)
2021/04/30 04:36:14 [ERR] memberlist: Failed fallback ping: read tcp 10.233.74.243:59478->10.233.77.170:8301: i/o timeout
2021/04/30 04:36:14 [INFO] memberlist: Suspect onap-consul-server-0 has failed, no acks received
2021/04/30 04:36:22 [ERR] memberlist: Failed fallback ping: read tcp 10.233.74.243:36730->10.233.77.170:8302: i/o timeout
2021/04/30 04:36:22 [INFO] memberlist: Suspect onap-consul-server-0.dc1 has failed, no acks received
2021/04/30 04:36:26 [INFO] serf: EventMemberJoin: onap-consul-server-0 10.233.77.170
2021/04/30 04:36:26 [INFO] consul: Adding LAN server onap-consul-server-0 (Addr: tcp/10.233.77.170:8300) (DC: dc1)
2021/04/30 04:36:27 [WARN] memberlist: Refuting a suspect message (from: onap-consul-server-0)
2021/04/30 04:36:36 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.77.170:35190
2021/04/30 04:36:57 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.77.170:35396
2021/04/30 04:37:04 [ERR] memberlist: Failed fallback ping: read tcp 10.233.74.243:59968->10.233.77.170:8301: i/o timeout
2021/04/30 04:37:04 [INFO] memberlist: Suspect onap-consul-server-0 has failed, no acks received
2021/04/30 04:37:07 [ERR] memberlist: Failed fallback ping: read tcp 10.233.74.243:37178->10.233.77.170:8302: i/o timeout
2021/04/30 04:37:07 [INFO] memberlist: Suspect onap-consul-server-0.dc1 has failed, no acks received
2021/04/30 04:37:07 [INFO] memberlist: Marking onap-consul-server-0 as failed, suspect timeout reached (2 peer confirmations)
2021/04/30 04:37:07 [INFO] serf: EventMemberFailed: onap-consul-server-0 10.233.77.170
2021/04/30 04:37:07 [INFO] consul: Removing LAN server onap-consul-server-0 (Addr: tcp/10.233.77.170:8300) (DC: dc1)
2021/04/30 04:37:08 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:36704
2021/04/30 04:37:16 [ERR] agent: Coordinate update error: No cluster leader
2021/04/30 04:37:17 [ERR] memberlist: Failed fallback ping: read tcp 10.233.74.243:37272->10.233.77.170:8302: i/o timeout
2021/04/30 04:37:17 [INFO] memberlist: Suspect onap-consul-server-0.dc1 has failed, no acks received
2021/04/30 04:37:18 [INFO] serf: EventMemberJoin: onap-consul-server-0 10.233.77.170
2021/04/30 04:37:18 [INFO] consul: Adding LAN server onap-consul-server-0 (Addr: tcp/10.233.77.170:8300) (DC: dc1)
2021/04/30 04:37:18 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:36832
2021/04/30 04:37:28 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.77.170:35730
2021/04/30 04:37:28 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:36972
2021/04/30 04:37:28 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.77.170:35732
2021/04/30 04:37:36 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:37058
2021/04/30 04:37:40 [ERR] http: Request GET /v1/catalog/service/config-binding-service, error: rpc error making call: No cluster leader from=10.233.73.129:41996
2021/04/30 04:37:44 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:37200
2021/04/30 04:37:49 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.77.170:35978
2021/04/30 04:37:50 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:37272
2021/04/30 04:37:53 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.77.170:36024
2021/04/30 04:37:57 [ERR] agent: Coordinate update error: rpc error making call: No cluster leader
2021/04/30 04:37:57 [WARN] raft: Rejecting vote request from 10.233.71.152:8300 since we have a leader: 10.233.77.170:8300
2021/04/30 04:37:57 [WARN] raft: Rejecting vote request from 10.233.71.152:8300 since we have a leader: 10.233.77.170:8300
2021/04/30 04:37:58 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:37374
2021/04/30 04:38:00 [INFO] raft: Duplicate RequestVote for same term: 5
2021/04/30 04:38:01 [ERR] http: Request GET /v1/catalog/service/config-binding-service, error: rpc error making call: No cluster leader from=10.233.75.55:59662
2021/04/30 04:38:01 [INFO] raft: Duplicate RequestVote for same term: 8
2021/04/30 04:38:02 [INFO] consul: New leader elected: onap-consul-server-1
2021/04/30 04:38:03 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:37442
2021/04/30 04:39:56 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:38792
2021/04/30 04:39:59 [ERR] raft-net: Failed to flush response: write tcp 10.233.74.243:8300->10.233.71.152:37374: write: broken pipe
2021/04/30 04:40:13 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:39004
2021/04/30 04:40:23 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:39120
2021/04/30 04:40:24 [ERR] memberlist: Failed fallback ping: read tcp 10.233.74.243:33786->10.233.77.170:8301: i/o timeout
2021/04/30 04:40:24 [INFO] memberlist: Suspect onap-consul-server-0 has failed, no acks received
2021/04/30 04:40:33 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:39236
2021/04/30 04:40:43 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:39362
2021/04/30 04:40:47 [ERR] memberlist: Failed fallback ping: read tcp 10.233.74.243:34012->10.233.77.170:8301: i/o timeout
2021/04/30 04:40:47 [INFO] memberlist: Suspect onap-consul-server-0 has failed, no acks received
2021/04/30 04:40:51 [INFO] memberlist: Marking onap-consul-server-0 as failed, suspect timeout reached (2 peer confirmations)
2021/04/30 04:40:51 [INFO] serf: EventMemberFailed: onap-consul-server-0 10.233.77.170
2021/04/30 04:40:51 [INFO] consul: Removing LAN server onap-consul-server-0 (Addr: tcp/10.233.77.170:8300) (DC: dc1)
2021/04/30 04:40:52 [ERR] memberlist: Failed fallback ping: read tcp 10.233.74.243:34064->10.233.77.170:8301: i/o timeout
2021/04/30 04:40:52 [INFO] memberlist: Suspect onap-consul-server-0 has failed, no acks received
2021/04/30 04:40:53 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:39484
2021/04/30 04:40:57 [ERR] memberlist: Failed fallback ping: read tcp 10.233.74.243:39512->10.233.77.170:8302: i/o timeout
2021/04/30 04:40:57 [INFO] memberlist: Suspect onap-consul-server-0.dc1 has failed, no acks received
2021/04/30 04:41:02 [INFO] serf: EventMemberJoin: onap-consul-server-0 10.233.77.170
2021/04/30 04:41:02 [INFO] consul: Adding LAN server onap-consul-server-0 (Addr: tcp/10.233.77.170:8300) (DC: dc1)
2021/04/30 04:41:03 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:39608
2021/04/30 04:41:07 [ERR] raft-net: Failed to flush response: write tcp 10.233.74.243:8300->10.233.71.152:37442: write: broken pipe
2021/04/30 04:41:13 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:39722
2021/04/30 04:41:23 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:39840
2021/04/30 04:41:34 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:39966
2021/04/30 04:41:46 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:40098
2021/04/30 04:41:46 [WARN] memberlist: Refuting a suspect message (from: onap-consul-cccf8dcbb-w5nfk)
2021/04/30 04:41:58 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:40236
2021/04/30 04:42:13 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:40430
2021/04/30 04:42:33 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:40658
2021/04/30 04:42:54 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:40902
2021/04/30 04:43:14 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:41144
2021/04/30 04:43:16 [WARN] raft: Skipping application of old log: 356
2021/04/30 04:43:34 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:41366
2021/04/30 04:45:03 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:42386
2021/04/30 04:45:12 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:42512
2021/04/30 04:45:22 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:42622
2021/04/30 04:45:32 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:42740
2021/04/30 04:45:43 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:42872
2021/04/30 04:45:51 [ERR] raft-net: Failed to flush response: write tcp 10.233.74.243:8300->10.233.71.152:41144: write: broken pipe
2021/04/30 04:45:53 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:42986
2021/04/30 04:47:59 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:44486
2021/04/30 04:48:09 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:44612
2021/04/30 04:48:18 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:44720
2021/04/30 04:48:28 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:44838
2021/04/30 04:48:39 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:44954
2021/04/30 04:48:47 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:45060
2021/04/30 04:48:47 [WARN] memberlist: Refuting a suspect message (from: onap-consul-server-2)
2021/04/30 04:48:48 [WARN] memberlist: Refuting a suspect message (from: onap-consul-server-0.dc1)
2021/04/30 04:48:48 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:45088
2021/04/30 04:48:54 [WARN] memberlist: Refuting a suspect message (from: onap-consul-server-0)
2021/04/30 04:48:55 [ERR] memberlist: Failed fallback ping: write tcp 10.233.74.243:56656->10.233.71.152:8301: i/o timeout
2021/04/30 04:48:55 [INFO] memberlist: Suspect onap-consul-server-1 has failed, no acks received
2021/04/30 04:48:55 [ERR] memberlist: Failed fallback ping: write tcp 10.233.74.243:56176->10.233.78.4:8301: i/o timeout
2021/04/30 04:48:58 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:45204
2021/04/30 04:49:05 [ERR] memberlist: Failed fallback ping: write tcp 10.233.74.243:38976->10.233.77.170:8301: i/o timeout
2021/04/30 04:49:05 [INFO] memberlist: Suspect onap-consul-server-0 has failed, no acks received
2021/04/30 04:49:15 [ERR] memberlist: Failed fallback ping: write tcp 10.233.74.243:44432->10.233.77.170:8302: i/o timeout
2021/04/30 04:49:15 [INFO] memberlist: Suspect onap-consul-server-0.dc1 has failed, no acks received
2021/04/30 04:49:15 [ERR] memberlist: Failed fallback ping: write tcp 10.233.74.243:56316->10.233.78.4:8301: i/o timeout
2021/04/30 04:49:15 [INFO] memberlist: Suspect onap-consul-cccf8dcbb-w5nfk has failed, no acks received
2021/04/30 04:49:16 [WARN] memberlist: Refuting a suspect message (from: onap-consul-server-1.dc1)
2021/04/30 04:49:16 [WARN] memberlist: Refuting a suspect message (from: onap-consul-server-1)
2021/04/30 04:49:16 [DEBUG] raft-net: 10.233.74.243:8300 accepted connection from: 10.233.71.152:45324
2021/04/30 04:49:20 [ERR] raft-net: Failed to flush response: write tcp 10.233.74.243:8300->10.233.71.152:42872: write: broken pipe