By type
+ CONSUL_BIND=
+ [ -n ]
+ CONSUL_CLIENT=
+ [ -n ]
+ CONSUL_DATA_DIR=/consul/data
+ CONSUL_CONFIG_DIR=/consul/config
+ [ -n ]
+ [ a = - ]
+ [ agent = agent ]
+ shift
+ set -- consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=onap-consul-server-0.consul-server -retry-join=onap-consul-server-1.consul-server -retry-join=onap-consul-server-2.consul-server -client=0.0.0.0 -server -ui
+ [ consul = consul ]
+ stat -c %u /consul/data
+ id -u consul
+ [ 100 != 100 ]
+ stat -c %u /consul/config
+ id -u consul
+ [ 100 != 100 ]
+ [ ! -z ]
+ exec consul agent -data-dir=/consul/data -config-dir=/consul/config -bootstrap-expect=3 -enable-script-checks -retry-join=onap-consul-server-0.consul-server -retry-join=onap-consul-server-1.consul-server -retry-join=onap-consul-server-2.consul-server -client=0.0.0.0 -server -ui
bootstrap_expect > 0: expecting 3 servers
==> Starting Consul agent...
==> Consul agent running!
Version: 'v1.0.6'
Node ID: '7ab54adf-f90a-6b08-c2cc-1860c069a287'
Node name: 'onap-consul-server-1'
Datacenter: 'dc1' (Segment: '')
Server: true (Bootstrap: false)
Client Addr: [0.0.0.0] (HTTP: 8500, HTTPS: -1, DNS: 8600)
Cluster Addr: 10.233.77.249 (LAN: 8301, WAN: 8302)
Encrypt: Gossip: false, TLS-Outgoing: false, TLS-Incoming: false
==> Log data will now stream in as it occurs:
2021/10/15 10:21:09 [INFO] raft: Initial configuration (index=0): []
2021/10/15 10:21:09 [INFO] agent: (LAN) joining: [onap-consul-server-0.consul-server onap-consul-server-1.consul-server onap-consul-server-2.consul-server]
2021/10/15 10:21:09 [INFO] raft: Node at 10.233.77.249:8300 [Follower] entering Follower state (Leader: "")
2021/10/15 10:21:09 [INFO] serf: EventMemberJoin: onap-consul-server-1.dc1 10.233.77.249
2021/10/15 10:21:09 [INFO] serf: EventMemberJoin: onap-consul-server-1 10.233.77.249
2021/10/15 10:21:09 [INFO] agent: Started DNS server 0.0.0.0:8600 (udp)
2021/10/15 10:21:09 [INFO] consul: Adding LAN server onap-consul-server-1 (Addr: tcp/10.233.77.249:8300) (DC: dc1)
2021/10/15 10:21:09 [INFO] agent: Started DNS server 0.0.0.0:8600 (tcp)
2021/10/15 10:21:09 [INFO] consul: Handled member-join event for server "onap-consul-server-1.dc1" in area "wan"
2021/10/15 10:21:09 [INFO] agent: Started HTTP server on [::]:8500 (tcp)
2021/10/15 10:21:09 [INFO] agent: started state syncer
2021/10/15 10:21:09 [INFO] agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce os scaleway softlayer
2021/10/15 10:21:09 [INFO] agent: Joining LAN cluster...
2021/10/15 10:21:11 [INFO] serf: EventMemberJoin: onap-consul-server-0 10.233.67.6
2021/10/15 10:21:11 [INFO] consul: Adding LAN server onap-consul-server-0 (Addr: tcp/10.233.67.6:8300) (DC: dc1)
2021/10/15 10:21:11 [INFO] serf: EventMemberJoin: onap-consul-587bccd8f4-jjgbc 10.233.71.51
2021/10/15 10:21:11 [INFO] serf: EventMemberJoin: onap-consul-server-0.dc1 10.233.67.6
2021/10/15 10:21:11 [INFO] consul: Handled member-join event for server "onap-consul-server-0.dc1" in area "wan"
2021/10/15 10:21:13 [WARN] memberlist: Failed to resolve onap-consul-server-1.consul-server: lookup onap-consul-server-1.consul-server on 169.254.25.10:53: no such host
2021/10/15 10:21:15 [WARN] raft: no known peers, aborting election
2021/10/15 10:21:15 [WARN] memberlist: Failed to resolve onap-consul-server-2.consul-server: lookup onap-consul-server-2.consul-server on 169.254.25.10:53: no such host
2021/10/15 10:21:15 [INFO] agent: (LAN) joined: 1 Err:
2021/10/15 10:21:15 [INFO] agent: Join LAN completed. Synced with 1 initial agents
2021/10/15 10:21:16 [ERR] agent: failed to sync remote state: No cluster leader
==> Newer Consul version available: 1.10.3 (currently running: 1.0.6)
2021/10/15 10:21:36 [ERR] agent: Coordinate update error: No cluster leader
2021/10/15 10:21:44 [INFO] serf: EventMemberJoin: onap-consul-server-2 10.233.71.152
2021/10/15 10:21:44 [INFO] consul: Adding LAN server onap-consul-server-2 (Addr: tcp/10.233.71.152:8300) (DC: dc1)
2021/10/15 10:21:44 [INFO] consul: Found expected number of peers, attempting bootstrap: 10.233.77.249:8300,10.233.67.6:8300,10.233.71.152:8300
2021/10/15 10:21:45 [INFO] serf: EventMemberJoin: onap-consul-server-2.dc1 10.233.71.152
2021/10/15 10:21:45 [INFO] consul: Handled member-join event for server "onap-consul-server-2.dc1" in area "wan"
2021/10/15 10:21:46 [WARN] raft: Heartbeat timeout from "" reached, starting election
2021/10/15 10:21:46 [INFO] raft: Node at 10.233.77.249:8300 [Candidate] entering Candidate state in term 2
2021/10/15 10:21:46 [INFO] raft: Election won. Tally: 2
2021/10/15 10:21:46 [INFO] raft: Node at 10.233.77.249:8300 [Leader] entering Leader state
2021/10/15 10:21:46 [INFO] raft: Added peer 5bef1367-944a-1188-3a7d-bc00cfbeb257, starting replication
2021/10/15 10:21:46 [INFO] raft: Added peer ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1, starting replication
2021/10/15 10:21:46 [INFO] consul: cluster leadership acquired
2021/10/15 10:21:46 [INFO] consul: New leader elected: onap-consul-server-1
2021/10/15 10:21:46 [INFO] raft: pipelining replication to peer {Voter 5bef1367-944a-1188-3a7d-bc00cfbeb257 10.233.67.6:8300}
2021/10/15 10:21:46 [INFO] consul: member 'onap-consul-server-1' joined, marking health alive
2021/10/15 10:21:47 [INFO] consul: member 'onap-consul-server-0' joined, marking health alive
2021/10/15 10:21:47 [WARN] raft: AppendEntries to {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300} rejected, sending older logs (next: 1)
2021/10/15 10:21:48 [INFO] raft: pipelining replication to peer {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}
2021/10/15 10:21:48 [INFO] agent: Synced node info
2021/10/15 10:21:48 [INFO] consul: member 'onap-consul-587bccd8f4-jjgbc' joined, marking health alive
2021/10/15 10:21:49 [INFO] consul: member 'onap-consul-server-2' joined, marking health alive
2021/10/15 10:22:01 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:23:54 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:23:54 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 10:25:25 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:25:25 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 10:25:26 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:26:19 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:26:19 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 10:26:39 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:26:40 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:26:47 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:26:49 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:26:50 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:26:51 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 10:26:53 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:26:54 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:26:56 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:27:18 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:27:19 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:27:25 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:27:37 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 10:27:37 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 10:27:38 [WARN] consul: error getting server health from "onap-consul-server-1": last request still outstanding
2021/10/15 10:27:39 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 10:27:39 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 10:27:47 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 10:27:48 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 10:28:02 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:28:02 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:28:05 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:28:06 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:28:08 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:28:10 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:30:11 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:30:17 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:30:41 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:41930->10.233.71.51:8301: i/o timeout
2021/10/15 10:30:41 [INFO] memberlist: Suspect onap-consul-587bccd8f4-jjgbc has failed, no acks received
2021/10/15 10:30:43 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:41936->10.233.71.51:8301: i/o timeout
2021/10/15 10:30:43 [INFO] memberlist: Suspect onap-consul-587bccd8f4-jjgbc has failed, no acks received
2021/10/15 10:30:51 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:30:55 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:32:47 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:42598->10.233.71.51:8301: i/o timeout
2021/10/15 10:32:47 [INFO] memberlist: Suspect onap-consul-587bccd8f4-jjgbc has failed, no acks received
2021/10/15 10:32:49 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:32:50 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:32:53 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:32:55 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:32:59 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:32:59 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 10:32:59 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 10:33:00 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:33:04 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:42686->10.233.71.51:8301: i/o timeout
2021/10/15 10:33:04 [INFO] memberlist: Suspect onap-consul-587bccd8f4-jjgbc has failed, no acks received
2021/10/15 10:33:05 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:33:06 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:33:07 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:42700->10.233.71.51:8301: i/o timeout
2021/10/15 10:33:07 [INFO] memberlist: Suspect onap-consul-587bccd8f4-jjgbc has failed, no acks received
2021/10/15 10:33:08 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:33:09 [INFO] serf: EventMemberFailed: onap-consul-587bccd8f4-jjgbc 10.233.71.51
2021/10/15 10:33:09 [INFO] consul: member 'onap-consul-587bccd8f4-jjgbc' failed, marking health critical
2021/10/15 10:33:10 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:42720->10.233.71.51:8301: i/o timeout
2021/10/15 10:33:10 [INFO] memberlist: Suspect onap-consul-587bccd8f4-jjgbc has failed, no acks received
2021/10/15 10:33:11 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:33:12 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:33:18 [ERR] yamux: keepalive failed: i/o deadline reached
2021/10/15 10:33:18 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.233.71.51:38164
2021/10/15 10:33:18 [INFO] serf: EventMemberJoin: onap-consul-587bccd8f4-jjgbc 10.233.71.51
2021/10/15 10:33:18 [INFO] consul: member 'onap-consul-587bccd8f4-jjgbc' joined, marking health alive
2021/10/15 10:33:20 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:33:20 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:33:23 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:33:24 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:42794->10.233.71.51:8301: i/o timeout
2021/10/15 10:33:24 [INFO] memberlist: Suspect onap-consul-587bccd8f4-jjgbc has failed, no acks received
2021/10/15 10:33:47 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:33:47 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 10:33:48 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:34:31 [WARN] raft: Failed to contact ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 in 2.500329829s
2021/10/15 10:34:31 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:34:32 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:49592->10.233.71.152:8301: i/o timeout
2021/10/15 10:34:32 [INFO] memberlist: Suspect onap-consul-server-2 has failed, no acks received
2021/10/15 10:34:34 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:43158->10.233.71.51:8301: i/o timeout
2021/10/15 10:34:34 [INFO] memberlist: Suspect onap-consul-587bccd8f4-jjgbc has failed, no acks received
2021/10/15 10:34:34 [INFO] memberlist: Marking onap-consul-587bccd8f4-jjgbc as failed, suspect timeout reached (2 peer confirmations)
2021/10/15 10:34:34 [INFO] serf: EventMemberFailed: onap-consul-587bccd8f4-jjgbc 10.233.71.51
2021/10/15 10:34:34 [INFO] consul: member 'onap-consul-587bccd8f4-jjgbc' failed, marking health critical
2021/10/15 10:34:35 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:34:35 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 10:34:36 [WARN] raft: Failed to contact ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 in 2.500363435s
2021/10/15 10:34:36 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:34:36 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:49610->10.233.71.152:8301: i/o timeout
2021/10/15 10:34:36 [INFO] memberlist: Suspect onap-consul-server-2 has failed, no acks received
2021/10/15 10:34:39 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:34:39 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 10:34:40 [INFO] serf: EventMemberJoin: onap-consul-587bccd8f4-jjgbc 10.233.71.51
2021/10/15 10:34:40 [INFO] consul: member 'onap-consul-587bccd8f4-jjgbc' joined, marking health alive
2021/10/15 10:34:41 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:34:42 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:34:43 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 10:34:44 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:34:44 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:49662->10.233.71.152:8301: i/o timeout
2021/10/15 10:34:44 [INFO] memberlist: Suspect onap-consul-server-2 has failed, no acks received
2021/10/15 10:34:45 [WARN] raft: Failed to contact ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 in 2.500513158s
2021/10/15 10:34:46 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:43230->10.233.71.51:8301: i/o timeout
2021/10/15 10:34:46 [INFO] memberlist: Suspect onap-consul-587bccd8f4-jjgbc has failed, no acks received
2021/10/15 10:34:46 [INFO] raft: aborting pipeline replication to peer {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}
2021/10/15 10:34:47 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:34:48 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:34:48 [WARN] memberlist: Was able to connect to onap-consul-587bccd8f4-jjgbc but other probes failed, network may be misconfigured
2021/10/15 10:34:49 [WARN] raft: Failed to contact ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 in 2.50027858s
2021/10/15 10:34:50 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:34:50 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:49700->10.233.71.152:8301: i/o timeout
2021/10/15 10:34:50 [INFO] memberlist: Suspect onap-consul-server-2 has failed, no acks received
2021/10/15 10:34:51 [WARN] raft: Failed to contact ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 in 5.000071107s
2021/10/15 10:34:52 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:34:52 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:49706->10.233.71.152:8301: i/o timeout
2021/10/15 10:34:52 [INFO] memberlist: Suspect onap-consul-server-2 has failed, no acks received
2021/10/15 10:34:53 [ERR] raft: Failed to heartbeat to 10.233.71.152:8300: read tcp 10.233.77.249:38742->10.233.71.152:8300: i/o timeout
2021/10/15 10:34:54 [WARN] raft: Failed to contact ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 in 7.459270011s
2021/10/15 10:34:54 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:46288->10.233.71.152:8302: i/o timeout
2021/10/15 10:34:54 [INFO] memberlist: Suspect onap-consul-server-2.dc1 has failed, no acks received
2021/10/15 10:34:54 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:34:54 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:43284->10.233.71.51:8301: i/o timeout
2021/10/15 10:34:54 [INFO] memberlist: Suspect onap-consul-587bccd8f4-jjgbc has failed, no acks received
2021/10/15 10:34:54 [ERR] yamux: keepalive failed: i/o deadline reached
2021/10/15 10:34:54 [WARN] consul: error getting server health from "onap-consul-server-2": rpc error making call: EOF
2021/10/15 10:34:55 [ERR] yamux: keepalive failed: i/o deadline reached
2021/10/15 10:34:55 [ERR] consul.rpc: multiplex conn accept failed: keepalive timeout from=10.233.71.152:42730
2021/10/15 10:34:56 [INFO] memberlist: Marking onap-consul-server-2 as failed, suspect timeout reached (1 peer confirmations)
2021/10/15 10:34:56 [INFO] serf: EventMemberFailed: onap-consul-server-2 10.233.71.152
2021/10/15 10:34:56 [INFO] consul: Removing LAN server onap-consul-server-2 (Addr: tcp/10.233.71.152:8300) (DC: dc1)
2021/10/15 10:34:56 [INFO] consul: member 'onap-consul-server-2' failed, marking health critical
2021/10/15 10:34:56 [INFO] serf: EventMemberFailed: onap-consul-587bccd8f4-jjgbc 10.233.71.51
2021/10/15 10:34:56 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:43296->10.233.71.51:8301: i/o timeout
2021/10/15 10:34:56 [INFO] memberlist: Suspect onap-consul-587bccd8f4-jjgbc has failed, no acks received
2021/10/15 10:34:57 [ERR] raft: Failed to AppendEntries to {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}: read tcp 10.233.77.249:38750->10.233.71.152:8300: i/o timeout
2021/10/15 10:34:57 [WARN] Unable to get address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1, using fallback address 10.233.71.152:8300: Could not find address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1
2021/10/15 10:34:57 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 10:34:57 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:34:57 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 10:34:58 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 10:34:58 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:34:59 [INFO] consul: member 'onap-consul-587bccd8f4-jjgbc' failed, marking health critical
2021/10/15 10:35:00 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:01 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 10:35:02 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:03 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 10:35:04 [ERR] raft: Failed to heartbeat to 10.233.71.152:8300: read tcp 10.233.77.249:42928->10.233.71.152:8300: i/o timeout
2021/10/15 10:35:04 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:46418->10.233.71.152:8302: i/o timeout
2021/10/15 10:35:04 [INFO] memberlist: Suspect onap-consul-server-2.dc1 has failed, no acks received
2021/10/15 10:35:04 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 10:35:04 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:05 [WARN] Unable to get address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1, using fallback address 10.233.71.152:8300: Could not find address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1
2021/10/15 10:35:06 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:07 [ERR] raft: Failed to AppendEntries to {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}: read tcp 10.233.77.249:42952->10.233.71.152:8300: i/o timeout
2021/10/15 10:35:07 [WARN] Unable to get address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1, using fallback address 10.233.71.152:8300: Could not find address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1
2021/10/15 10:35:08 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:09 [INFO] serf: attempting reconnect to onap-consul-server-2 10.233.71.152:8301
2021/10/15 10:35:10 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:12 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:14 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:46552->10.233.71.152:8302: i/o timeout
2021/10/15 10:35:14 [INFO] memberlist: Suspect onap-consul-server-2.dc1 has failed, no acks received
2021/10/15 10:35:14 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:15 [ERR] raft: Failed to heartbeat to 10.233.71.152:8300: read tcp 10.233.77.249:43164->10.233.71.152:8300: i/o timeout
2021/10/15 10:35:16 [WARN] Unable to get address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1, using fallback address 10.233.71.152:8300: Could not find address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1
2021/10/15 10:35:16 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:17 [ERR] raft: Failed to AppendEntries to {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}: read tcp 10.233.77.249:43174->10.233.71.152:8300: i/o timeout
2021/10/15 10:35:17 [WARN] Unable to get address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1, using fallback address 10.233.71.152:8300: Could not find address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1
2021/10/15 10:35:18 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:20 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:22 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:24 [INFO] memberlist: Marking onap-consul-server-2.dc1 as failed, suspect timeout reached (0 peer confirmations)
2021/10/15 10:35:24 [INFO] serf: EventMemberFailed: onap-consul-server-2.dc1 10.233.71.152
2021/10/15 10:35:24 [INFO] consul: Handled member-failed event for server "onap-consul-server-2.dc1" in area "wan"
2021/10/15 10:35:24 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:26 [ERR] raft: Failed to heartbeat to 10.233.71.152:8300: read tcp 10.233.77.249:43274->10.233.71.152:8300: i/o timeout
2021/10/15 10:35:26 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:27 [WARN] Unable to get address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1, using fallback address 10.233.71.152:8300: Could not find address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1
2021/10/15 10:35:27 [ERR] raft: Failed to AppendEntries to {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}: read tcp 10.233.77.249:43280->10.233.71.152:8300: i/o timeout
2021/10/15 10:35:27 [WARN] Unable to get address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1, using fallback address 10.233.71.152:8300: Could not find address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1
2021/10/15 10:35:28 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:29 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:46782->10.233.71.152:8302: i/o timeout
2021/10/15 10:35:29 [INFO] memberlist: Suspect onap-consul-server-2.dc1 has failed, no acks received
2021/10/15 10:35:30 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:32 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:34 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:36 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:36 [ERR] yamux: keepalive failed: i/o deadline reached
2021/10/15 10:35:36 [WARN] consul: error getting server health from "onap-consul-server-2": rpc error making call: EOF
2021/10/15 10:35:37 [ERR] raft: Failed to heartbeat to 10.233.71.152:8300: read tcp 10.233.77.249:43404->10.233.71.152:8300: i/o timeout
2021/10/15 10:35:37 [ERR] raft: Failed to AppendEntries to {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}: read tcp 10.233.77.249:43406->10.233.71.152:8300: i/o timeout
2021/10/15 10:35:37 [WARN] Unable to get address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1, using fallback address 10.233.71.152:8300: Could not find address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1
2021/10/15 10:35:37 [WARN] Unable to get address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1, using fallback address 10.233.71.152:8300: Could not find address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1
2021/10/15 10:35:39 [INFO] serf: attempting reconnect to onap-consul-server-2.dc1 10.233.71.152:8302
2021/10/15 10:35:39 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:35:39 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 10:35:40 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:42 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:44 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:47 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:47 [ERR] raft: Failed to AppendEntries to {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}: read tcp 10.233.77.249:43502->10.233.71.152:8300: i/o timeout
2021/10/15 10:35:47 [WARN] Unable to get address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1, using fallback address 10.233.71.152:8300: Could not find address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1
2021/10/15 10:35:47 [ERR] raft: Failed to heartbeat to 10.233.71.152:8300: read tcp 10.233.77.249:43506->10.233.71.152:8300: i/o timeout
2021/10/15 10:35:48 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:48 [WARN] Unable to get address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1, using fallback address 10.233.71.152:8300: Could not find address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1
2021/10/15 10:35:49 [INFO] serf: attempting reconnect to onap-consul-587bccd8f4-jjgbc 10.233.71.51:8301
2021/10/15 10:35:49 [INFO] serf: EventMemberJoin: onap-consul-server-2.dc1 10.233.71.152
2021/10/15 10:35:49 [INFO] consul: Handled member-join event for server "onap-consul-server-2.dc1" in area "wan"
2021/10/15 10:35:50 [INFO] serf: EventMemberJoin: onap-consul-587bccd8f4-jjgbc 10.233.71.51
2021/10/15 10:35:50 [INFO] consul: member 'onap-consul-587bccd8f4-jjgbc' joined, marking health alive
2021/10/15 10:35:51 [WARN] Unable to get address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1, using fallback address 10.233.71.152:8300: Could not find address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1
2021/10/15 10:35:51 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:51 [WARN] memberlist: Was able to connect to onap-consul-587bccd8f4-jjgbc but other probes failed, network may be misconfigured
2021/10/15 10:35:52 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:35:52 [WARN] Unable to get address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1, using fallback address 10.233.71.152:8300: Could not find address for server id ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1
2021/10/15 10:35:53 [INFO] serf: EventMemberJoin: onap-consul-server-2 10.233.71.152
2021/10/15 10:35:53 [INFO] consul: Adding LAN server onap-consul-server-2 (Addr: tcp/10.233.71.152:8300) (DC: dc1)
2021/10/15 10:35:53 [INFO] consul: member 'onap-consul-server-2' joined, marking health alive
2021/10/15 10:35:54 [INFO] raft: pipelining replication to peer {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}
2021/10/15 10:36:20 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:36:20 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:38:53 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 10:39:39 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:40:57 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:41:24 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:41:24 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:41:31 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:41:31 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 10:41:32 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:41:50 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:41:50 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:42:21 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:42:21 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 10:42:48 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:42:48 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:42:56 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:42:56 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:43:21 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 10:43:22 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 10:49:32 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:49:32 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 10:55:07 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:55:19 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 10:55:19 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:55:37 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 10:55:37 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:55:54 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 10:56:33 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:56:33 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:57:02 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:57:02 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 10:57:02 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:57:02 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 10:57:09 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 10:57:09 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:57:10 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 10:58:07 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 10:58:07 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:59:05 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 10:59:06 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 10:59:30 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 10:59:30 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 10:59:30 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:00:04 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:00:04 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:00:05 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:00:06 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:00:29 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:00:29 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:00:30 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:00:33 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:00:33 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:00:48 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:00:48 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 11:00:48 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:00:48 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:00:50 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:00:53 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:00:53 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:00:54 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:00:56 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:00:57 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:00:59 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:01:22 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 11:01:33 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:01:33 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:03:00 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:03:00 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:03:02 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:03:04 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:03:45 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:03:46 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:04:21 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:04:22 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:04:31 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:04:32 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:04:51 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:04:51 [WARN] memberlist: Refuting a suspect message (from: onap-consul-server-2)
2021/10/15 11:05:09 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:05:09 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:05:10 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:05:10 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:56314->10.233.71.51:8301: i/o timeout
2021/10/15 11:05:10 [INFO] memberlist: Suspect onap-consul-587bccd8f4-jjgbc has failed, no acks received
2021/10/15 11:05:18 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:56380->10.233.71.51:8301: i/o timeout
2021/10/15 11:05:18 [INFO] memberlist: Suspect onap-consul-587bccd8f4-jjgbc has failed, no acks received
2021/10/15 11:05:21 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:56406->10.233.71.51:8301: i/o timeout
2021/10/15 11:05:21 [INFO] memberlist: Suspect onap-consul-587bccd8f4-jjgbc has failed, no acks received
2021/10/15 11:05:22 [INFO] memberlist: Marking onap-consul-587bccd8f4-jjgbc as failed, suspect timeout reached (2 peer confirmations)
2021/10/15 11:05:22 [INFO] serf: EventMemberFailed: onap-consul-587bccd8f4-jjgbc 10.233.71.51
2021/10/15 11:05:22 [INFO] consul: member 'onap-consul-587bccd8f4-jjgbc' failed, marking health critical
2021/10/15 11:05:22 [INFO] serf: EventMemberJoin: onap-consul-587bccd8f4-jjgbc 10.233.71.51
2021/10/15 11:05:23 [INFO] consul: member 'onap-consul-587bccd8f4-jjgbc' joined, marking health alive
2021/10/15 11:05:25 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:05:29 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:05:30 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:05:32 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:05:33 [WARN] raft: Failed to contact ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 in 2.500252875s
2021/10/15 11:05:34 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:05:34 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:34720->10.233.71.152:8301: i/o timeout
2021/10/15 11:05:34 [INFO] memberlist: Suspect onap-consul-server-2 has failed, no acks received
2021/10/15 11:05:35 [WARN] raft: Failed to contact ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 in 4.97615311s
2021/10/15 11:05:36 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:05:36 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:56530->10.233.71.51:8301: i/o timeout
2021/10/15 11:05:36 [INFO] memberlist: Suspect onap-consul-587bccd8f4-jjgbc has failed, no acks received
2021/10/15 11:05:36 [INFO] memberlist: Marking onap-consul-587bccd8f4-jjgbc as failed, suspect timeout reached (2 peer confirmations)
2021/10/15 11:05:36 [INFO] serf: EventMemberFailed: onap-consul-587bccd8f4-jjgbc 10.233.71.51
2021/10/15 11:05:36 [INFO] consul: member 'onap-consul-587bccd8f4-jjgbc' failed, marking health critical
2021/10/15 11:05:36 [INFO] raft: aborting pipeline replication to peer {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}
2021/10/15 11:05:38 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:05:38 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:56546->10.233.71.51:8301: i/o timeout
2021/10/15 11:05:38 [INFO] memberlist: Suspect onap-consul-587bccd8f4-jjgbc has failed, no acks received
2021/10/15 11:05:39 [WARN] raft: Failed to contact ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 in 2.500331934s
2021/10/15 11:05:40 [WARN] memberlist: Refuting a suspect message (from: onap-consul-server-2)
2021/10/15 11:05:40 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:05:40 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:34768->10.233.71.152:8301: i/o timeout
2021/10/15 11:05:42 [WARN] raft: Failed to contact ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 in 2.500340365s
2021/10/15 11:05:42 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:05:44 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:05:46 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:05:46 [ERR] raft: Failed to AppendEntries to {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}: read tcp 10.233.77.249:43714->10.233.71.152:8300: i/o timeout
2021/10/15 11:05:48 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:05:50 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:05:51 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:05:52 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:05:54 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:05:56 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:05:56 [ERR] raft: Failed to AppendEntries to {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}: read tcp 10.233.77.249:56190->10.233.71.152:8300: i/o timeout
2021/10/15 11:05:58 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:06:00 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:06:02 [INFO] serf: EventMemberJoin: onap-consul-587bccd8f4-jjgbc 10.233.71.51
2021/10/15 11:06:02 [INFO] consul: member 'onap-consul-587bccd8f4-jjgbc' joined, marking health alive
2021/10/15 11:06:02 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:06:04 [INFO] raft: pipelining replication to peer {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}
2021/10/15 11:06:05 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:06:05 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 11:07:05 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:07:05 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:07:49 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:07:49 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:10:07 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 11:10:07 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:10:07 [WARN] consul: error getting server health from "onap-consul-server-1": last request still outstanding
2021/10/15 11:10:33 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:10:33 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:10:39 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:10:41 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:13:21 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:13:21 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 11:14:01 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:19:33 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:19:33 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:20:08 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:20:08 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:21:37 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:21:38 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:22:25 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:22:25 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:22:53 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:23:09 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:23:10 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:23:12 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:23:27 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:23:28 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:25:01 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:25:02 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:25:04 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:25:07 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:25:09 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:25:43 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:32:45 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:32:45 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:35:15 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:35:16 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:35:18 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:35:37 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:35:37 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:35:38 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:35:43 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:35:44 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:35:46 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:35:48 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 11:49:13 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:49:19 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:49:29 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:49:30 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:49:32 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:49:39 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:49:39 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 11:49:40 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:49:43 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:49:44 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:49:49 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:49:50 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:49:52 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:49:54 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:49:56 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:49:56 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:50418->10.233.71.51:8301: i/o timeout
2021/10/15 11:49:56 [INFO] memberlist: Suspect onap-consul-587bccd8f4-jjgbc has failed, no acks received
2021/10/15 11:49:56 [INFO] raft: aborting pipeline replication to peer {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}
2021/10/15 11:49:58 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:50:00 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:50:01 [INFO] raft: pipelining replication to peer {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}
2021/10/15 11:50:15 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:50:16 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:50:23 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:50:23 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 11:50:49 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:51:35 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:51:36 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:51:49 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:51:50 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:53:37 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:53:38 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:53:40 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:53:49 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:53:50 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:54:19 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:54:20 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:54:25 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:54:25 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:54:26 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:54:31 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:54:31 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 11:54:31 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:54:31 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:59156->10.233.71.152:8301: i/o timeout
2021/10/15 11:54:33 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:54:33 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:52734->10.233.71.51:8301: i/o timeout
2021/10/15 11:54:33 [INFO] memberlist: Suspect onap-consul-587bccd8f4-jjgbc has failed, no acks received
2021/10/15 11:54:35 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:54:36 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:54:39 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:54:49 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:54:59 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:54:59 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 11:54:59 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:55:05 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:55:05 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 11:55:05 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:55:15 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:55:16 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:55:39 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:55:55 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:55:56 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:55:58 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:00 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:07 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:56:08 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:10 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:13 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:56:14 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:16 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:18 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:20 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:23 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:56:24 [WARN] memberlist: Was able to connect to onap-consul-server-2 but other probes failed, network may be misconfigured
2021/10/15 11:56:25 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:29 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:56:30 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:30 [WARN] raft: Failed to contact ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 in 2.500305522s
2021/10/15 11:56:30 [ERR] memberlist: Failed fallback ping: write tcp 10.233.77.249:53752->10.233.71.51:8301: i/o timeout
2021/10/15 11:56:30 [INFO] memberlist: Suspect onap-consul-587bccd8f4-jjgbc has failed, no acks received
2021/10/15 11:56:32 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:34 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:36 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:37 [WARN] raft: Failed to contact ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 in 2.500303957s
2021/10/15 11:56:38 [INFO] raft: aborting pipeline replication to peer {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}
2021/10/15 11:56:38 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:39 [ERR] memberlist: Failed fallback ping: write tcp 10.233.77.249:53830->10.233.71.51:8301: i/o timeout
2021/10/15 11:56:39 [INFO] memberlist: Suspect onap-consul-587bccd8f4-jjgbc has failed, no acks received
2021/10/15 11:56:39 [WARN] memberlist: Refuting a suspect message (from: onap-consul-server-2)
2021/10/15 11:56:41 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:56:42 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:44 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:47 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:48 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:49 [ERR] raft: Failed to AppendEntries to {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}: read tcp 10.233.77.249:53476->10.233.71.152:8300: i/o timeout
2021/10/15 11:56:50 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:52 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:54 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:56 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:58 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:56:59 [ERR] raft: Failed to AppendEntries to {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}: read tcp 10.233.77.249:50072->10.233.71.152:8300: i/o timeout
2021/10/15 11:57:00 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:02 [WARN] raft: Failed to contact ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 in 2.500245857s
2021/10/15 11:57:02 [ERR] memberlist: Failed fallback ping: write tcp 10.233.77.249:32968->10.233.71.152:8301: i/o timeout
2021/10/15 11:57:02 [INFO] memberlist: Suspect onap-consul-server-2 has failed, no acks received
2021/10/15 11:57:03 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:05 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:06 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:09 [ERR] raft: Failed to AppendEntries to {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}: read tcp 10.233.77.249:53582->10.233.71.152:8300: i/o timeout
2021/10/15 11:57:09 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:57:10 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:13 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:14 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:16 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:18 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:19 [ERR] raft: Failed to AppendEntries to {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}: read tcp 10.233.77.249:54358->10.233.71.152:8300: i/o timeout
2021/10/15 11:57:21 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:57:21 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 11:57:21 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:57:22 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:24 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:26 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:28 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:30 [ERR] raft: Failed to AppendEntries to {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}: read tcp 10.233.77.249:54866->10.233.71.152:8300: i/o timeout
2021/10/15 11:57:30 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:31 [WARN] memberlist: Refuting a suspect message (from: onap-consul-server-2)
2021/10/15 11:57:32 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:34 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:36 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:37 [WARN] raft: Failed to contact ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 in 2.500340298s
2021/10/15 11:57:38 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:39 [WARN] raft: Failed to contact ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 in 4.916597402s
2021/10/15 11:57:40 [ERR] raft: Failed to AppendEntries to {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}: read tcp 10.233.77.249:54644->10.233.71.152:8300: i/o timeout
2021/10/15 11:57:40 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:42 [WARN] raft: Failed to contact ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 in 7.386994577s
2021/10/15 11:57:42 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:43 [ERR] memberlist: Failed fallback ping: write tcp 10.233.77.249:55550->10.233.71.51:8301: i/o timeout
2021/10/15 11:57:43 [INFO] memberlist: Suspect onap-consul-587bccd8f4-jjgbc has failed, no acks received
2021/10/15 11:57:44 [ERR] memberlist: Failed fallback ping: write tcp 10.233.77.249:58586->10.233.71.152:8302: i/o timeout
2021/10/15 11:57:44 [INFO] memberlist: Suspect onap-consul-server-2.dc1 has failed, no acks received
2021/10/15 11:57:44 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:45 [ERR] raft: Failed to heartbeat to 10.233.71.152:8300: read tcp 10.233.77.249:55146->10.233.71.152:8300: i/o timeout
2021/10/15 11:57:46 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:46 [ERR] memberlist: Failed fallback ping: read tcp 10.233.77.249:33836->10.233.71.152:8301: i/o timeout
2021/10/15 11:57:46 [INFO] memberlist: Suspect onap-consul-server-2 has failed, no acks received
2021/10/15 11:57:48 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 11:57:51 [INFO] raft: pipelining replication to peer {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}
2021/10/15 11:57:57 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:57:57 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 11:58:06 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 11:58:09 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 12:00:11 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 12:03:51 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 12:03:51 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 12:04:07 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 12:04:07 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 12:13:07 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 12:18:27 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 12:18:27 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 12:33:41 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 12:36:47 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 12:36:49 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 12:36:50 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 12:37:55 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 12:38:05 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 12:38:17 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 12:38:23 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 12:38:23 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 12:38:23 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 12:38:24 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 12:38:27 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 12:38:28 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 12:38:30 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 12:38:32 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 12:38:34 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 12:38:36 [INFO] raft: aborting pipeline replication to peer {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}
2021/10/15 12:38:36 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 12:38:38 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 12:38:40 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 12:38:42 [INFO] raft: pipelining replication to peer {Voter ad75f67a-c6f2-bfb6-75cd-a50e54ceaeb1 10.233.71.152:8300}
2021/10/15 12:49:01 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 12:50:41 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 12:51:15 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 12:51:15 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 12:51:15 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 12:51:15 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 12:51:31 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 12:51:31 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 12:51:32 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 12:51:55 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 12:53:01 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 12:53:01 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 12:54:06 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 12:54:06 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 12:54:06 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 12:54:06 [WARN] consul: error getting server health from "onap-consul-server-1": last request still outstanding
2021/10/15 12:54:18 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 13:00:04 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 13:00:04 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding
2021/10/15 13:45:57 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 14:05:15 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 14:09:05 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 14:09:06 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 14:09:08 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 14:09:10 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 14:09:17 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 14:12:33 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 14:12:33 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 14:12:33 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 14:48:09 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 15:16:59 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 15:16:59 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 15:17:55 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 15:22:23 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 15:22:23 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 15:28:56 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 15:42:41 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 15:42:41 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 15:56:01 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 15:56:02 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 15:56:17 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 15:56:23 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 15:56:24 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 15:56:29 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 15:56:29 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 15:56:30 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 15:57:01 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 15:57:02 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 15:57:04 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 15:57:06 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 15:57:08 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 15:57:17 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 15:57:18 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 15:57:49 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 15:57:49 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 15:57:57 [WARN] consul: error getting server health from "onap-consul-server-1": last request still outstanding
2021/10/15 15:57:58 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 15:57:58 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 15:59:33 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 16:00:38 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 16:02:57 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 16:04:39 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 16:05:53 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 16:06:00 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 16:06:55 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 16:06:55 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 16:08:35 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 16:08:35 [WARN] consul: error getting server health from "onap-consul-server-2": last request still outstanding
2021/10/15 16:09:23 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 16:09:23 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 16:13:13 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 16:13:31 [WARN] consul: error getting server health from "onap-consul-server-2": context deadline exceeded
2021/10/15 16:13:31 [WARN] consul: error getting server health from "onap-consul-server-1": context deadline exceeded
2021/10/15 16:14:54 [WARN] consul: error getting server health from "onap-consul-server-0": context deadline exceeded
2021/10/15 16:14:54 [WARN] consul: error getting server health from "onap-consul-server-0": last request still outstanding