By type
+ CONSUL_BIND=
+ [ -n ]
+ CONSUL_CLIENT=
+ [ -n ]
+ CONSUL_DATA_DIR=/consul/data
+ CONSUL_CONFIG_DIR=/consul/config
+ [ -n ]
+ [ a = - ]
+ [ agent = agent ]
+ shift
+ set -- consul agent -data-dir=/consul/data -config-dir=/consul/config -client 0.0.0.0 -enable-script-checks -retry-join consul-server
+ [ consul = consul ]
+ stat -c %u /consul/data
+ id -u consul
+ [ 100 != 100 ]
+ stat -c %u /consul/config
+ id -u consul
+ [ 100 != 100 ]
+ [ ! -z ]
+ exec consul agent -data-dir=/consul/data -config-dir=/consul/config -client 0.0.0.0 -enable-script-checks -retry-join consul-server
==> Starting Consul agent...
==> Consul agent running!
Version: 'v1.0.6'
Node ID: '667252ef-8d73-598f-9940-7ccc7d78cfe8'
Node name: 'dev-consul-7467bf7b46-4fqcf'
Datacenter: 'dc1' (Segment: '')
Server: false (Bootstrap: false)
Client Addr: [0.0.0.0] (HTTP: 8500, HTTPS: -1, DNS: 8600)
Cluster Addr: 10.242.109.220 (LAN: 8301, WAN: 8302)
Encrypt: Gossip: false, TLS-Outgoing: false, TLS-Incoming: false
==> Log data will now stream in as it occurs:
2021/04/24 11:18:36 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-4fqcf 10.242.109.220
2021/04/24 11:18:36 [WARN] Service name "Health Check: Application Authorization Framework" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] Service name "Health Check: Secret Management Service (sms)" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] Service name "A&AI Synapse Data Routing Service" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] agent: check "data-router-process" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/04/24 11:18:36 [WARN] Service name "A&AI Model Loader" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] agent: check "model-loader-process" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/04/24 11:18:36 [WARN] Service name "A&AI Search Data Service" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] agent: check "elasticsearch-write-health" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/04/24 11:18:36 [WARN] agent: check "search-data-service-availability" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/04/24 11:18:36 [WARN] agent: check "search-data-service-api" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/04/24 11:18:36 [WARN] Service name "Active and Available Inventory" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] Service name "A&AI UI Backend Service" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] agent: check "sparky-be-process" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/04/24 11:18:36 [WARN] Service name "Health Check: APPC - Dgbuilder" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] Service name "Health Check: APPC" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] agent: check "appc-dbhost-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/04/24 11:18:36 [WARN] Service name "Health Check: APPC-SDN-CTL-DB-01" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] Service name "Health Check: APPC-SDN-CTL-DB-02" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] Service name "Health Check: APPC - SDN Host" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] Service name "Health Check: CLAMP" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] Service name "Health Check: CLAMP - MariaDb" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] agent: check "clamp-mariadb" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/04/24 11:18:36 [WARN] Service name "Health Check: ONAP CLI" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] Service name "Health Check: Log - Elastic Search" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] Service name "Health Check: Log - Kibana" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] Service name "Health Check: Log - Log Stash" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] Service name "Health Check: DMaaP" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] agent: check "mr-zookeeper" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/04/24 11:18:36 [WARN] agent: check "mr-kafka" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/04/24 11:18:36 [WARN] Service name "Health Check: MSB" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] Service name "Health Check: MULTICLOUD" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] Service name "Health Check: Policy" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] agent: check "Policy-mariadb-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/04/24 11:18:36 [WARN] Service name "Health Check: SDC" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] agent: check "sdc-fe-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/04/24 11:18:36 [WARN] agent: check "sdc-be-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/04/24 11:18:36 [WARN] agent: check "sdc-titan-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/04/24 11:18:36 [WARN] agent: check "sdc-cs-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/04/24 11:18:36 [WARN] Service name "Health Check: SDNC ODL Cluster" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] agent: check "sdnc-odl-cluster-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/04/24 11:18:36 [WARN] Service name "Health Check: SDNC - DB Host" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] agent: check "sdnc-dbhost-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/04/24 11:18:36 [WARN] Service name "Health Check: SDNC - DGBuilder" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] Service name "Health Check: SDNC" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] Service name "Health Check: SDNC-SDN-CTL-DB-01" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] Service name "Health Check: SDNC-SDN-CTL-DB-02" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] Service name "Health Check: SDNC - SDN Host" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] Service name "Health Check: SO" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] agent: check "so-api-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/04/24 11:18:36 [WARN] agent: check "so-camunda-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/04/24 11:18:36 [WARN] agent: check "so-jra-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/04/24 11:18:36 [WARN] Service name "Health Check: SO - MariaDb" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] agent: check "so-mariadb" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/04/24 11:18:36 [WARN] Service name "Health Check: VFC" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] Service name "Health Check: VID" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/04/24 11:18:36 [WARN] agent: check "vid-mariadb" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/04/24 11:18:36 [INFO] agent: Started DNS server 0.0.0.0:8600 (tcp)
2021/04/24 11:18:36 [INFO] agent: Started DNS server 0.0.0.0:8600 (udp)
2021/04/24 11:18:36 [INFO] agent: Started HTTP server on [::]:8500 (tcp)
2021/04/24 11:18:36 [INFO] agent: started state syncer
2021/04/24 11:18:36 [INFO] agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce os scaleway softlayer
2021/04/24 11:18:36 [INFO] agent: Joining LAN cluster...
2021/04/24 11:18:36 [INFO] agent: (LAN) joining: [consul-server]
2021/04/24 11:18:36 [WARN] manager: No servers available
2021/04/24 11:18:36 [ERR] agent: failed to sync remote state: No known Consul servers
2021/04/24 11:18:36 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.179.88
2021/04/24 11:18:36 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.244.7
2021/04/24 11:18:36 [INFO] agent: (LAN) joined: 1 Err:
2021/04/24 11:18:36 [INFO] agent: Join LAN completed. Synced with 1 initial agents
2021/04/24 11:18:36 [INFO] consul: adding server dev-consul-server-2 (Addr: tcp/10.242.179.88:8300) (DC: dc1)
2021/04/24 11:18:36 [INFO] consul: adding server dev-consul-server-0 (Addr: tcp/10.242.244.7:8300) (DC: dc1)
2021/04/24 11:18:36 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:37 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-nslrg 10.242.179.71
2021/04/24 11:18:37 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:18:37 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:18:37 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:18:38 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:18:38 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:18:38 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:18:38 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:38 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:43420->10.242.179.71:8301: i/o timeout
2021/04/24 11:18:39 [INFO] memberlist: Suspect dev-consul-7467bf7b46-nslrg has failed, no acks received
2021/04/24 11:18:39 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:39 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:46902->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:18:39 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:18:39 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:18:39 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:39 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:18:39 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:18:39 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
==> Failed to check for updates: Get https://checkpoint-api.hashicorp.com/v1/check/consul?arch=amd64&os=linux&signature=2885cd24-ba3a-9c67-8696-f3ca3f7989f8&version=1.0.6: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:18:40 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:40 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:40 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:18:41 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:18:41 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:41 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:42 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:42 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:48854->10.242.179.88:8301: i/o timeout
2021/04/24 11:18:42 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/24 11:18:42 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:18:42 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:42 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:42 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:18:43 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:43 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:18:43 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:18:43 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:43 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:43 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:43 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:43 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:43 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:18:44 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:44 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:18:45 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:18:45 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/04/24 11:18:45 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:45 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:45 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:18:45 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/04/24 11:18:45 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:45 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:45 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:46 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:46 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:46 [INFO] consul: New leader elected: dev-consul-server-0
2021/04/24 11:18:46 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:18:46 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:18:46 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:43532->10.242.179.71:8301: i/o timeout
2021/04/24 11:18:46 [INFO] memberlist: Suspect dev-consul-7467bf7b46-nslrg has failed, no acks received
2021/04/24 11:18:46 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:46 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:46 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:47 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/04/24 11:18:47 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:47 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:18:47 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:47 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:18:47 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:48 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:48 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:48 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:48 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:18:49 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:18:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:48966->10.242.179.88:8301: i/o timeout
2021/04/24 11:18:49 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/24 11:18:49 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:18:49 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:18:49 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:49 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:49 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:50 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:18:50 [INFO] memberlist: Marking dev-consul-7467bf7b46-nslrg as failed, suspect timeout reached (1 peer confirmations)
2021/04/24 11:18:50 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-nslrg 10.242.179.71
2021/04/24 11:18:50 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:18:50 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:18:51 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:51 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:43578->10.242.179.71:8301: i/o timeout
2021/04/24 11:18:51 [INFO] memberlist: Suspect dev-consul-7467bf7b46-nslrg has failed, no acks received
2021/04/24 11:18:53 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:49032->10.242.179.88:8301: i/o timeout
2021/04/24 11:18:53 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/24 11:18:53 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:18:53 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:53 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:53 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:53 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:18:54 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:18:54 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:18:54 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:54 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:47120->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:18:54 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:18:54 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:18:54 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:55 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:18:55 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:49076->10.242.179.88:8301: i/o timeout
2021/04/24 11:18:55 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/24 11:18:55 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:55 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:55 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:18:55 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:18:55 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:18:55 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:56 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:56 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:18:56 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:56 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:56 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:18:56 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:57 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:57 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:18:57 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/04/24 11:18:57 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:18:57 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:18:57 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:18:57 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:57 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:58 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:58 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:58 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:58 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:58 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:59 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:49142->10.242.179.88:8301: i/o timeout
2021/04/24 11:18:59 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/24 11:18:59 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:18:59 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:18:59 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:18:59 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:00 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:19:00 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:00 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:19:00 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:00 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:00 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:01 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:01 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:49168->10.242.179.88:8301: i/o timeout
2021/04/24 11:19:01 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/24 11:19:01 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:01 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:19:01 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:02 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:02 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:02 [WARN] agent: Check "mr-kafka" is now warning
2021/04/24 11:19:02 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:02 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:03 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:03 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:03 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:03 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:49190->10.242.179.88:8301: i/o timeout
2021/04/24 11:19:03 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/24 11:19:03 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:03 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:04 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:19:04 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:19:04 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:19:04 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:04 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:19:04 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:05 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/04/24 11:19:05 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:19:05 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:49222->10.242.179.88:8301: i/o timeout
2021/04/24 11:19:05 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/24 11:19:05 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:19:05 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:19:05 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:06 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:06 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:19:06 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:06 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-nslrg 10.242.179.71:8301
2021/04/24 11:19:06 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:19:06 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:06 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.78.9
2021/04/24 11:19:06 [INFO] consul: adding server dev-consul-server-1 (Addr: tcp/10.242.78.9:8300) (DC: dc1)
2021/04/24 11:19:06 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/04/24 11:19:07 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:49258->10.242.179.88:8301: i/o timeout
2021/04/24 11:19:07 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/24 11:19:07 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:19:07 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:19:08 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:08 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:09 [WARN] memberlist: Was able to connect to dev-consul-server-2 but other probes failed, network may be misconfigured
2021/04/24 11:19:09 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:09 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:47342->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:19:09 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:09 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.179.88
2021/04/24 11:19:09 [INFO] consul: removing server dev-consul-server-2 (Addr: tcp/10.242.179.88:8300) (DC: dc1)
2021/04/24 11:19:09 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:19:09 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:10 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/04/24 11:19:10 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:49300->10.242.179.88:8301: i/o timeout
2021/04/24 11:19:10 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/24 11:19:10 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:10 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:10 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:10 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:19:10 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:19:10 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:11 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:19:11 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:11 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:11 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:12 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:12 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:46004->10.242.78.9:8301: i/o timeout
2021/04/24 11:19:12 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/04/24 11:19:12 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:19:12 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:12 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:19:12 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:13 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:13 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:13 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:13 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:13 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:13 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:13 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:14 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:19:14 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:46042->10.242.78.9:8301: i/o timeout
2021/04/24 11:19:14 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/04/24 11:19:14 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:15 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:19:15 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:15 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:15 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:15 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:19:15 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:19:15 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:15 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:15 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:16 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:16 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:16 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:19:16 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:19:16 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:46094->10.242.78.9:8301: i/o timeout
2021/04/24 11:19:16 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/04/24 11:19:16 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:16 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:16 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:17 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:17 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:19:17 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:17 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:19:17 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:19:17 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:17 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:19:18 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:18 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:18 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:18 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:18 [ERR] consul: "Health.NodeChecks" RPC failed to server 10.242.179.88:8300: rpc error making call: rpc error making call: No cluster leader
2021/04/24 11:19:18 [ERR] agent: failed to sync remote state: rpc error making call: rpc error making call: No cluster leader
2021/04/24 11:19:18 [ERR] consul: "Coordinate.Update" RPC failed to server 10.242.179.88:8300: rpc error making call: rpc error making call: No cluster leader
2021/04/24 11:19:18 [ERR] agent: Coordinate update error: rpc error making call: rpc error making call: No cluster leader
2021/04/24 11:19:19 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-nslrg 10.242.179.71
2021/04/24 11:19:19 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:19 [INFO] agent: Synced service "A&AI Synapse Data Routing Service"
2021/04/24 11:19:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:46130->10.242.78.9:8301: i/o timeout
2021/04/24 11:19:19 [INFO] consul: New leader elected: dev-consul-server-0
2021/04/24 11:19:19 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/04/24 11:19:19 [INFO] agent: Synced service "Health Check: APPC-SDN-CTL-DB-02"
2021/04/24 11:19:19 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:19:19 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:19:19 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:19 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:19 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (1 peer confirmations)
2021/04/24 11:19:19 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.78.9
2021/04/24 11:19:19 [INFO] consul: removing server dev-consul-server-1 (Addr: tcp/10.242.78.9:8300) (DC: dc1)
2021/04/24 11:19:19 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:19 [INFO] agent: Synced service "Health Check: Log - Kibana"
2021/04/24 11:19:20 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:19:20 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:19:21 [WARN] agent: Check "elasticsearch-write-health" is now warning
2021/04/24 11:19:21 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:21 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:44052->10.242.179.71:8301: i/o timeout
2021/04/24 11:19:21 [INFO] memberlist: Suspect dev-consul-7467bf7b46-nslrg has failed, no acks received
2021/04/24 11:19:21 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:19:22 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:19:22 [ERR] consul: "Catalog.Register" RPC failed to server 10.242.244.7:8300: rpc error making call: leadership lost while committing log
2021/04/24 11:19:22 [WARN] agent: Syncing service "Health Check: MSB" failed. rpc error making call: leadership lost while committing log
2021/04/24 11:19:22 [ERR] agent: failed to sync remote state: rpc error making call: leadership lost while committing log
2021/04/24 11:19:23 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-jkmlv 10.242.78.50
2021/04/24 11:19:23 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:19:23 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:23 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:23 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:24 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:19:24 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:44082->10.242.179.71:8301: i/o timeout
2021/04/24 11:19:24 [INFO] memberlist: Suspect dev-consul-7467bf7b46-nslrg has failed, no acks received
2021/04/24 11:19:24 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:24 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:47566->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:19:24 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:19:24 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:25 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:19:25 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:25 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:25 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:19:25 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:26 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:26 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:26 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:19:26 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:26 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:26 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:26 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:19:26 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:27 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:27 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:19:27 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:45638->10.242.78.50:8301: i/o timeout
2021/04/24 11:19:27 [INFO] memberlist: Suspect dev-consul-7467bf7b46-jkmlv has failed, no acks received
2021/04/24 11:19:27 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:27 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:19:27 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:19:27 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:19:27 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:27 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:28 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:28 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:28 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:19:28 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:28 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:28 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:28 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:19:29 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:29 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:30 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:45722->10.242.78.50:8301: i/o timeout
2021/04/24 11:19:30 [INFO] memberlist: Suspect dev-consul-7467bf7b46-jkmlv has failed, no acks received
2021/04/24 11:19:30 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:30 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:30 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1)
2021/04/24 11:19:30 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:30 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:31 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:31 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:31 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:31 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:31 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.78.9
2021/04/24 11:19:31 [INFO] consul: adding server dev-consul-server-1 (Addr: tcp/10.242.78.9:8300) (DC: dc1)
2021/04/24 11:19:32 [ERR] consul: "Catalog.NodeServices" RPC failed to server 10.242.244.7:8300: rpc error making call: No cluster leader
2021/04/24 11:19:32 [ERR] agent: failed to sync remote state: rpc error making call: No cluster leader
2021/04/24 11:19:32 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:32 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:32 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:19:32 [WARN] agent: Check "mr-kafka" is now warning
2021/04/24 11:19:32 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:32 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:33 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:33 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:33 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:45732->10.242.78.50:8301: i/o timeout
2021/04/24 11:19:33 [INFO] memberlist: Suspect dev-consul-7467bf7b46-jkmlv has failed, no acks received
2021/04/24 11:19:33 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:33 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:19:33 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:19:33 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:34 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:19:34 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:34 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/04/24 11:19:34 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:19:35 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:19:35 [INFO] memberlist: Marking dev-consul-7467bf7b46-jkmlv as failed, suspect timeout reached (2 peer confirmations)
2021/04/24 11:19:35 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-jkmlv 10.242.78.50
2021/04/24 11:19:35 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:19:35 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:36 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:36 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:19:36 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:36 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.179.88
2021/04/24 11:19:36 [INFO] consul: adding server dev-consul-server-2 (Addr: tcp/10.242.179.88:8300) (DC: dc1)
2021/04/24 11:19:37 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:19:37 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:37 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:37 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:19:37 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:37 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:19:37 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:19:37 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:19:37 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:19:38 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:19:38 [WARN] memberlist: Was able to connect to dev-consul-server-1 but other probes failed, network may be misconfigured
2021/04/24 11:19:38 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:39 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:39 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:39 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:47804->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:19:39 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:19:39 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:19:39 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:19:39 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:40 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:40 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:40 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.78.9
2021/04/24 11:19:40 [INFO] consul: removing server dev-consul-server-1 (Addr: tcp/10.242.78.9:8300) (DC: dc1)
2021/04/24 11:19:41 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/04/24 11:19:41 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:41 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:41 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:41 [INFO] serf: EventMemberUpdate: dev-consul-server-2
2021/04/24 11:19:42 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:42 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/24 11:19:42 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:42 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:19:42 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:19:42 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:42 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:42 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:43 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:43 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:43 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:43 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:43 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:43 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:44 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:44 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:19:44 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:44 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:19:44 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:19:44 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-jkmlv 10.242.78.50
2021/04/24 11:19:45 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:45 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:19:45 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:45 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:45 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:19:45 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:19:45 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:45 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:45 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:46 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:46 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:46 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:19:46 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:45978->10.242.78.50:8301: i/o timeout
2021/04/24 11:19:46 [INFO] memberlist: Suspect dev-consul-7467bf7b46-jkmlv has failed, no acks received
2021/04/24 11:19:46 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:46 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:46 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:47 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:47 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:47 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:19:47 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:47 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:19:47 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:48 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:48 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:48 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:48 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/04/24 11:19:48 [INFO] agent: Synced service "Health Check: CLAMP"
2021/04/24 11:19:48 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/04/24 11:19:49 [INFO] agent: Synced service "Health Check: SDNC - DGBuilder"
2021/04/24 11:19:49 [INFO] agent: Synced service "Health Check: APPC - SDN Host"
2021/04/24 11:19:49 [INFO] agent: Synced service "Health Check: SDNC ODL Cluster"
2021/04/24 11:19:50 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:50 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:50 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:44452->10.242.179.71:8301: i/o timeout
2021/04/24 11:19:50 [INFO] memberlist: Suspect dev-consul-7467bf7b46-nslrg has failed, no acks received
2021/04/24 11:19:50 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/04/24 11:19:50 [INFO] consul: New leader elected: dev-consul-server-0
2021/04/24 11:19:50 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:19:52 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:19:52 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:52 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:52 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:52 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:19:52 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:52 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:19:52 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:19:53 [INFO] agent: Synced service "Health Check: SDNC"
2021/04/24 11:19:53 [INFO] agent: Synced service "Health Check: SO"
2021/04/24 11:19:53 [INFO] agent: Synced service "Health Check: MSB"
2021/04/24 11:19:53 [INFO] agent: Synced service "Health Check: ONAP CLI"
2021/04/24 11:19:53 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.78.9
2021/04/24 11:19:53 [INFO] consul: adding server dev-consul-server-1 (Addr: tcp/10.242.78.9:8300) (DC: dc1)
2021/04/24 11:19:53 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:54 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:54 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:54 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:19:54 [WARN] memberlist: Was able to connect to dev-consul-7467bf7b46-jkmlv but other probes failed, network may be misconfigured
2021/04/24 11:19:54 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:54 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:48016->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:19:54 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:19:55 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:55 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:19:55 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:55 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:55 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:19:55 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:19:55 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:19:55 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:56 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:56 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/04/24 11:19:56 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:19:56 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:46674->10.242.78.9:8301: i/o timeout
2021/04/24 11:19:56 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/04/24 11:19:56 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:56 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:56 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:19:56 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:57 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:57 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:19:57 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:19:57 [INFO] memberlist: Marking dev-consul-7467bf7b46-jkmlv as failed, suspect timeout reached (1 peer confirmations)
2021/04/24 11:19:57 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-jkmlv 10.242.78.50
2021/04/24 11:19:57 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:19:57 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:57 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:58 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:58 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:58 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:19:58 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:58 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:58 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:59 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:19:59 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:19:59 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:20:00 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/04/24 11:20:00 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.78.9
2021/04/24 11:20:00 [INFO] consul: removing server dev-consul-server-1 (Addr: tcp/10.242.78.9:8300) (DC: dc1)
2021/04/24 11:20:00 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:46702->10.242.78.9:8301: i/o timeout
2021/04/24 11:20:00 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/04/24 11:20:00 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:00 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:00 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:00 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:01 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:01 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:20:01 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:01 [INFO] serf: EventMemberLeave: dev-consul-7467bf7b46-nslrg 10.242.179.71
2021/04/24 11:20:01 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:02 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:02 [ERR] consul: "Catalog.Register" RPC failed to server 10.242.244.7:8300: rpc error making call: leadership lost while committing log
2021/04/24 11:20:02 [WARN] agent: Syncing service "Health Check: Log - Log Stash" failed. rpc error making call: leadership lost while committing log
2021/04/24 11:20:02 [ERR] agent: failed to sync remote state: rpc error making call: leadership lost while committing log
2021/04/24 11:20:02 [WARN] agent: Check "mr-kafka" is now warning
2021/04/24 11:20:02 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:02 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:03 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:03 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:03 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:03 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:20:03 [ERR] consul: "Catalog.NodeServices" RPC failed to server 10.242.179.88:8300: rpc error getting client: failed to get conn: dial tcp ->10.242.179.88:8300: getsockopt: connection refused
2021/04/24 11:20:03 [ERR] agent: failed to sync remote state: rpc error getting client: failed to get conn: dial tcp ->10.242.179.88:8300: getsockopt: connection refused
2021/04/24 11:20:04 [INFO] memberlist: Suspect dev-consul-server-2 has failed, no acks received
2021/04/24 11:20:05 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-jkmlv 10.242.78.50
2021/04/24 11:20:05 [WARN] memberlist: Refuting a suspect message (from: dev-consul-7467bf7b46-jkmlv)
2021/04/24 11:20:07 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.78.9
2021/04/24 11:20:07 [INFO] memberlist: Marking dev-consul-server-2 as failed, suspect timeout reached (2 peer confirmations)
2021/04/24 11:20:07 [INFO] serf: EventMemberFailed: dev-consul-server-2 10.242.179.88
2021/04/24 11:20:07 [INFO] consul: adding server dev-consul-server-1 (Addr: tcp/10.242.78.9:8300) (DC: dc1)
2021/04/24 11:20:07 [INFO] consul: removing server dev-consul-server-2 (Addr: tcp/10.242.179.88:8300) (DC: dc1)
2021/04/24 11:20:09 [INFO] consul: New leader elected: dev-consul-server-0
2021/04/24 11:20:09 [INFO] agent: Synced service "Health Check: SDNC-SDN-CTL-DB-02"
2021/04/24 11:20:09 [INFO] agent: Synced service "Health Check: SO - MariaDb"
2021/04/24 11:20:09 [INFO] agent: Synced service "Health Check: VID"
2021/04/24 11:20:09 [INFO] agent: Synced service "Health Check: Log - Log Stash"
2021/04/24 11:20:10 [INFO] agent: Synced service "Health Check: MULTICLOUD"
2021/04/24 11:20:10 [INFO] agent: Synced service "Health Check: SDC"
2021/04/24 11:20:10 [INFO] agent: Synced service "Health Check: SDNC-SDN-CTL-DB-01"
2021/04/24 11:20:10 [INFO] agent: Synced service "Health Check: VFC"
2021/04/24 11:20:10 [INFO] agent: Synced service "Health Check: Application Authorization Framework"
2021/04/24 11:20:10 [INFO] agent: Synced service "Health Check: APPC"
2021/04/24 11:20:10 [INFO] agent: Synced service "Health Check: APPC-SDN-CTL-DB-01"
2021/04/24 11:20:10 [INFO] agent: Synced service "Health Check: SDNC - DB Host"
2021/04/24 11:20:10 [INFO] agent: Synced service "Health Check: CLAMP - MariaDb"
2021/04/24 11:20:10 [INFO] agent: Synced service "Health Check: Log - Elastic Search"
2021/04/24 11:20:10 [INFO] agent: Synced service "Health Check: DMaaP"
2021/04/24 11:20:10 [INFO] agent: Synced service "Health Check: Secret Management Service (sms)"
2021/04/24 11:20:10 [INFO] agent: Synced service "A&AI Model Loader"
2021/04/24 11:20:10 [INFO] agent: Synced service "A&AI Search Data Service"
2021/04/24 11:20:10 [INFO] agent: Synced service "Active and Available Inventory"
2021/04/24 11:20:10 [INFO] agent: Synced service "A&AI UI Backend Service"
2021/04/24 11:20:10 [INFO] agent: Synced service "Health Check: APPC - Dgbuilder"
2021/04/24 11:20:11 [INFO] agent: Synced service "Health Check: Policy"
2021/04/24 11:20:11 [INFO] agent: Synced service "Health Check: SDNC - SDN Host"
2021/04/24 11:20:12 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:20:12 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:12 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:12 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:12 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:12 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:12 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:20:12 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:20:12 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:20:12 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:20:12 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:20:12 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:20:12 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/04/24 11:20:12 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/04/24 11:20:12 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/04/24 11:20:13 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:20:13 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:20:13 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:20:13 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:20:13 [INFO] agent: Synced check "dmaap"
2021/04/24 11:20:17 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:48318->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:20:17 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:20:17 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:20:17 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/04/24 11:20:17 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:20:17 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:20:17 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:20:17 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/04/24 11:20:17 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:17 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:18 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:18 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:18 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:20:18 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:20:18 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:20:18 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:20:18 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:19 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:20:21 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:46458->10.242.78.50:8301: i/o timeout
2021/04/24 11:20:21 [INFO] memberlist: Suspect dev-consul-7467bf7b46-jkmlv has failed, no acks received
2021/04/24 11:20:22 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:22 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:22 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:22 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:22 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:20:22 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:22 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:20:22 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:20:22 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:20:22 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:20:22 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:20:22 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:20:23 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:20:23 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:20:23 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:20:24 [WARN] memberlist: Was able to connect to dev-consul-server-1 but other probes failed, network may be misconfigured
2021/04/24 11:20:24 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:20:24 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:20:24 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:20:24 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:20:25 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-jkmlv 10.242.78.50
2021/04/24 11:20:26 [ERR] memberlist: Failed fallback ping: read tcp 10.242.109.220:46532->10.242.78.50:8301: i/o timeout
2021/04/24 11:20:26 [INFO] memberlist: Suspect dev-consul-7467bf7b46-jkmlv has failed, no acks received
2021/04/24 11:20:26 [WARN] memberlist: Refuting a suspect message (from: dev-consul-7467bf7b46-jkmlv)
2021/04/24 11:20:27 [WARN] agent: Check "elasticsearch-write-health" is now warning
2021/04/24 11:20:28 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-jkmlv 10.242.78.50
2021/04/24 11:20:32 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:48556->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:20:32 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:20:32 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: dial tcp 10.96.164.158:3000: getsockopt: connection refused
2021/04/24 11:20:32 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:20:32 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:20:32 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:20:32 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:20:32 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:20:32 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:20:32 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:20:32 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:20:32 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:20:32 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:20:32 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/04/24 11:20:32 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:20:32 [WARN] agent: Check "mr-kafka" is now warning
2021/04/24 11:20:32 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:32 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:33 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:33 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:33 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:34 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/04/24 11:20:34 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/04/24 11:20:34 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/04/24 11:20:34 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:20:34 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:20:34 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:20:34 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:20:35 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:20:35 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:20:35 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:20:35 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:20:35 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:20:39 [ERR] memberlist: Push/Pull with dev-consul-server-1 failed: dial tcp 10.242.78.9:8301: getsockopt: connection refused
2021/04/24 11:20:39 [INFO] serf: EventMemberLeave: dev-consul-7467bf7b46-jkmlv 10.242.78.50
2021/04/24 11:20:40 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/04/24 11:20:42 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:42 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:42 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:42 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:20:42 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:42 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:42 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:20:42 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:20:42 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:20:42 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:20:42 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:20:42 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:20:42 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:20:43 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/04/24 11:20:44 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/04/24 11:20:44 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/04/24 11:20:44 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/04/24 11:20:45 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/04/24 11:20:46 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:20:46 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:20:46 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:20:46 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:20:47 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:48848->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:20:47 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:20:47 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:20:47 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:20:47 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:20:47 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:20:47 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/04/24 11:20:47 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:47 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:48 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:48 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:48 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:20:48 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:49 [ERR] consul: "Catalog.Register" RPC failed to server 10.242.244.7:8300: rpc error making call: No cluster leader
2021/04/24 11:20:49 [WARN] agent: Syncing check "dmaap" failed. rpc error making call: No cluster leader
2021/04/24 11:20:49 [ERR] agent: failed to sync changes: rpc error making call: No cluster leader
2021/04/24 11:20:50 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:20:50 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:20:50 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:20:50 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:20:51 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (1 peer confirmations)
2021/04/24 11:20:51 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.78.9
2021/04/24 11:20:51 [INFO] consul: removing server dev-consul-server-1 (Addr: tcp/10.242.78.9:8300) (DC: dc1)
2021/04/24 11:20:51 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:20:52 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:52 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:52 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:20:52 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:52 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:52 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:20:52 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:20:52 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:20:52 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:20:52 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:20:52 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:20:52 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:20:57 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/04/24 11:21:00 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/04/24 11:21:00 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/04/24 11:21:00 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/04/24 11:21:00 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:21:00 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:21:00 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:21:00 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:21:02 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:21:02 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:02 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:02 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:02 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:02 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:21:02 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:02 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:21:02 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:21:02 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:21:02 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:21:02 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:21:02 [WARN] agent: Check "mr-kafka" is now warning
2021/04/24 11:21:04 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:21:04 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:21:04 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:49130->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:21:04 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:04 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:21:05 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:21:05 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/04/24 11:21:05 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:21:05 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:05 [ERR] memberlist: Conflicting address for dev-consul-server-1. Mine: 10.242.78.9:8301 Theirs: 10.242.179.120:8301
2021/04/24 11:21:05 [WARN] serf: Name conflict for 'dev-consul-server-1' both 10.242.78.9:8301 and 10.242.179.120:8301 are claiming
2021/04/24 11:21:05 [ERR] memberlist: Conflicting address for dev-consul-server-1. Mine: 10.242.78.9:8301 Theirs: 10.242.179.120:8301
2021/04/24 11:21:05 [WARN] serf: Name conflict for 'dev-consul-server-1' both 10.242.78.9:8301 and 10.242.179.120:8301 are claiming
2021/04/24 11:21:06 [ERR] memberlist: Conflicting address for dev-consul-server-1. Mine: 10.242.78.9:8301 Theirs: 10.242.179.120:8301
2021/04/24 11:21:06 [WARN] serf: Name conflict for 'dev-consul-server-1' both 10.242.78.9:8301 and 10.242.179.120:8301 are claiming
2021/04/24 11:21:06 [ERR] memberlist: Conflicting address for dev-consul-server-1. Mine: 10.242.78.9:8301 Theirs: 10.242.179.120:8301
2021/04/24 11:21:06 [WARN] serf: Name conflict for 'dev-consul-server-1' both 10.242.78.9:8301 and 10.242.179.120:8301 are claiming
2021/04/24 11:21:06 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:06 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:06 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:06 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:07 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:10 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/04/24 11:21:10 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/04/24 11:21:10 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/04/24 11:21:11 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:21:11 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:21:11 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:21:11 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:21:12 [ERR] consul: "Coordinate.Update" RPC failed to server 10.242.244.7:8300: rpc error making call: No cluster leader
2021/04/24 11:21:12 [ERR] agent: Coordinate update error: rpc error making call: No cluster leader
2021/04/24 11:21:12 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:21:12 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:12 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:12 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:12 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:12 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:21:12 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:12 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:21:12 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:21:12 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:21:12 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:21:12 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:21:16 [INFO] serf: attempting reconnect to dev-consul-server-2 10.242.179.88:8301
2021/04/24 11:21:19 [ERR] consul: "Catalog.Register" RPC failed to server 10.242.244.7:8300: rpc error making call: No cluster leader
2021/04/24 11:21:19 [WARN] agent: Syncing check "dmaap" failed. rpc error making call: No cluster leader
2021/04/24 11:21:19 [ERR] agent: failed to sync changes: rpc error making call: No cluster leader
2021/04/24 11:21:19 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:21:19 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:49352->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:21:20 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:21:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:21:20 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:20 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:21:20 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:21:21 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:21 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:21:21 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:21:21 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:21:21 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.78.56
2021/04/24 11:21:21 [INFO] consul: adding server dev-consul-server-2 (Addr: tcp/10.242.78.56:8300) (DC: dc1)
2021/04/24 11:21:21 [ERR] memberlist: Conflicting address for dev-consul-server-1. Mine: 10.242.78.9:8301 Theirs: 10.242.179.120:8301
2021/04/24 11:21:21 [WARN] serf: Name conflict for 'dev-consul-server-1' both 10.242.78.9:8301 and 10.242.179.120:8301 are claiming
2021/04/24 11:21:21 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:22 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:22 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:22 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:22 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:22 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:21:22 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:22 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:22 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:22 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:21:22 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:22 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:22 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:21:22 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:21:22 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:21:22 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:21:22 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:21:22 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:21:22 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:21:22 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:21:22 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:21:23 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:30 [WARN] Check "sdnc-odl-cluster-healthcheck": Timed out (10s) running check
2021/04/24 11:21:30 [ERR] consul: "Catalog.NodeServices" RPC failed to server 10.242.244.7:8300: rpc error making call: No cluster leader
2021/04/24 11:21:30 [ERR] agent: failed to sync remote state: rpc error making call: No cluster leader
2021/04/24 11:21:32 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:21:32 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:21:32 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:21:32 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:32 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:21:32 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:32 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:32 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:21:32 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:32 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:32 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:21:32 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:21:32 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:21:32 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:21:32 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:21:32 [WARN] agent: Check "mr-kafka" is now warning
2021/04/24 11:21:33 [WARN] agent: Check "elasticsearch-write-health" is now warning
2021/04/24 11:21:33 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:21:33 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:21:33 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:21:33 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:21:34 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:21:34 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:49616->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:21:35 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:21:35 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:21:35 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:35 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:21:35 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:21:37 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:37 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:38 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:38 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:38 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:38 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:39 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:40 [ERR] consul: "Coordinate.Update" RPC failed to server 10.242.78.56:8300: rpc error making call: No cluster leader
2021/04/24 11:21:40 [ERR] agent: Coordinate update error: rpc error making call: No cluster leader
2021/04/24 11:21:42 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:42 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:21:42 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:42 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:42 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:42 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:21:42 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:42 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:21:42 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:21:42 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:21:42 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:21:42 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:21:43 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:21:43 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:21:43 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:21:44 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:21:44 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:21:44 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:21:44 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:21:45 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:21:49 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:21:50 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:49824->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:21:50 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:21:50 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:21:50 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:50 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:21:50 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:21:52 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:21:52 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:52 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:52 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:21:52 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:52 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:52 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:21:52 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:21:52 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:21:52 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:21:52 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:21:52 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:21:53 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:53 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:54 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:21:54 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:21:54 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:21:54 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:54 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:54 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:54 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:55 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:21:55 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:21:55 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:21:56 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:21:56 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:21:56 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.179.120
2021/04/24 11:21:56 [INFO] consul: adding server dev-consul-server-1 (Addr: tcp/10.242.179.120:8300) (DC: dc1)
2021/04/24 11:22:00 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:22:02 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:22:02 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:02 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:02 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:02 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:22:02 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:22:02 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:02 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:22:02 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:02 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:22:02 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:22:02 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:22:02 [WARN] agent: Check "mr-kafka" is now warning
2021/04/24 11:22:04 [ERR] consul: "Catalog.NodeServices" RPC failed to server 10.242.244.7:8300: rpc error making call: No cluster leader
2021/04/24 11:22:04 [ERR] agent: failed to sync remote state: rpc error making call: No cluster leader
2021/04/24 11:22:05 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:22:05 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:50038->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:22:05 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:22:05 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:22:05 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:05 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:22:05 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:22:05 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:22:05 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:22:05 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:22:06 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:22:06 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:22:07 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:22:07 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:22:09 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:09 [ERR] consul: "Coordinate.Update" RPC failed to server 10.242.244.7:8300: rpc error making call: No cluster leader
2021/04/24 11:22:09 [ERR] agent: Coordinate update error: rpc error making call: No cluster leader
2021/04/24 11:22:09 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:10 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:10 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:10 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:10 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:11 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:12 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:12 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:22:12 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:12 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:12 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:12 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:12 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:22:12 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:22:12 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:22:12 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:22:12 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:22:12 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:22:15 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:22:16 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:22:16 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:22:16 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:22:18 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:22:18 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:22:18 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:22:18 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:22:20 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:22:20 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:50284->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:22:20 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:20 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:22:20 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:22:20 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:22:20 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:22:22 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:22 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:22:22 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:22 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:22 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:22 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:22 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:22:22 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:22:22 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:22:22 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:22:22 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:22:22 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:22:25 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:25 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:26 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:26 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:26 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:26 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:27 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:22:27 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:22:27 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:22:27 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:29 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:22:29 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:22:29 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:22:29 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:22:30 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:22:32 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:32 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:22:32 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:32 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:32 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:32 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:32 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:22:32 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:22:32 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:22:32 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:22:32 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:22:32 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:22:32 [WARN] agent: Check "mr-kafka" is now warning
2021/04/24 11:22:35 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:22:35 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:50504->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:22:35 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:35 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:22:35 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:22:35 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:22:35 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:22:36 [ERR] consul: "Coordinate.Update" RPC failed to server 10.242.78.56:8300: rpc error making call: No cluster leader
2021/04/24 11:22:36 [ERR] agent: Coordinate update error: rpc error making call: No cluster leader
2021/04/24 11:22:36 [ERR] consul: "Catalog.NodeServices" RPC failed to server 10.242.78.56:8300: rpc error making call: No cluster leader
2021/04/24 11:22:36 [ERR] agent: failed to sync remote state: rpc error making call: No cluster leader
2021/04/24 11:22:38 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:22:38 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:22:38 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:22:39 [WARN] agent: Check "elasticsearch-write-health" is now warning
2021/04/24 11:22:40 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:22:40 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:22:40 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:22:40 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:22:41 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:41 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:42 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:42 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:42 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:42 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:42 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:22:42 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:42 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:42 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:42 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:42 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:22:42 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:42 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:22:42 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:22:42 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:22:42 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:22:42 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:22:43 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:45 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:22:49 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:22:49 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:22:49 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:22:50 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:22:50 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:50718->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:22:50 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:50 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:22:50 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:22:50 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:22:50 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:22:51 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:22:51 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:22:51 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:22:51 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:22:52 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:52 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:22:52 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:52 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:52 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:52 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:22:52 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:22:52 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:22:52 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:22:52 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:22:52 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:22:52 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:22:57 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:57 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:58 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:58 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:58 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:58 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:22:59 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:23:00 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:23:00 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:23:00 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:23:00 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:23:02 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:23:02 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:23:02 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:23:02 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:23:02 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:02 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:02 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:23:02 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:23:02 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:23:02 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:02 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:23:02 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:23:02 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:23:02 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:02 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:02 [WARN] agent: Check "mr-kafka" is now warning
2021/04/24 11:23:02 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:23:05 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:50920->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:23:05 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:23:05 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:23:05 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:23:05 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:23:05 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:05 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:23:07 [ERR] consul: "Catalog.NodeServices" RPC failed to server 10.242.179.120:8300: rpc error making call: No cluster leader
2021/04/24 11:23:07 [ERR] agent: failed to sync remote state: rpc error making call: No cluster leader
2021/04/24 11:23:11 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:23:11 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:23:11 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:23:11 [ERR] consul: "Coordinate.Update" RPC failed to server 10.242.179.120:8300: rpc error making call: No cluster leader
2021/04/24 11:23:11 [ERR] agent: Coordinate update error: rpc error making call: No cluster leader
2021/04/24 11:23:12 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:12 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:12 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:23:12 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:23:12 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:23:12 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:23:12 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:12 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:12 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:23:12 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:12 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:23:12 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:23:13 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:23:13 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:23:13 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:23:13 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:23:13 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:23:13 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:23:14 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:23:14 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:23:14 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:23:14 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:23:15 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:23:15 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:23:20 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:51128->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:23:20 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:23:20 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:23:20 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:23:20 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:20 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:23:20 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:23:22 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:23:22 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:23:22 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:23:22 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:22 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:22 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:23:22 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:23:22 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:23:22 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:22 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:23:22 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:22 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:22 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:23:22 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:23:22 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:23:24 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:23:24 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:23:24 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:23:24 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:23:29 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:23:29 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:23:30 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:23:30 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:23:30 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:23:30 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:23:30 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:23:31 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:23:32 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:32 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:32 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:23:32 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:23:32 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:23:32 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:32 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:23:32 [WARN] agent: Check "mr-kafka" is now warning
2021/04/24 11:23:32 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:32 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:32 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:23:32 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:23:32 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:23:33 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:23:33 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:23:33 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:23:35 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:51346->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:23:35 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:23:35 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:23:35 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:23:35 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:23:35 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:23:35 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:35 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:23:35 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:23:35 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:23:35 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:23:42 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:42 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:42 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:23:42 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:23:42 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:23:42 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:42 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:23:42 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:42 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:42 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:23:42 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:23:42 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:23:43 [ERR] consul: "Catalog.NodeServices" RPC failed to server 10.242.244.7:8300: rpc error making call: No cluster leader
2021/04/24 11:23:43 [ERR] agent: failed to sync remote state: rpc error making call: No cluster leader
2021/04/24 11:23:44 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:23:44 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:23:44 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:23:44 [WARN] agent: Check "elasticsearch-write-health" is now warning
2021/04/24 11:23:45 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:23:45 [ERR] consul: "Coordinate.Update" RPC failed to server 10.242.244.7:8300: rpc error making call: No cluster leader
2021/04/24 11:23:45 [ERR] agent: Coordinate update error: rpc error making call: No cluster leader
2021/04/24 11:23:45 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:23:45 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:23:46 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:23:46 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:23:46 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:23:46 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:23:46 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:23:46 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:23:46 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:23:46 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:23:47 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:23:50 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:51570->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:23:50 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:23:50 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:23:50 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:23:50 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:50 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:23:50 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:23:52 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:23:52 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:52 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:52 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:23:52 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:23:52 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:23:52 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:52 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:23:52 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:52 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:23:52 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:23:52 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:23:55 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:23:55 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:23:55 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:23:57 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:23:57 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:23:57 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:23:57 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:24:00 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:24:01 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:01 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:02 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:02 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:02 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:02 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:02 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:24:02 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:02 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:02 [WARN] agent: Check "mr-kafka" is now warning
2021/04/24 11:24:02 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:24:02 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:24:02 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:02 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:24:02 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:02 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:02 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:24:02 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:24:02 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:24:03 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:05 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:51782->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:24:05 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:24:05 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:05 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:24:05 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:24:05 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:24:05 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:24:06 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:24:06 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:24:06 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:24:08 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:24:08 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:24:08 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:24:08 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:24:12 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:24:12 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:12 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:12 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:24:12 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:12 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:24:12 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:24:12 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:12 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:12 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:24:12 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:24:12 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:24:15 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:24:17 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:17 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:24:17 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:24:17 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:24:17 [ERR] consul: "Catalog.NodeServices" RPC failed to server 10.242.78.56:8300: rpc error making call: No cluster leader
2021/04/24 11:24:17 [ERR] agent: failed to sync remote state: rpc error making call: No cluster leader
2021/04/24 11:24:17 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:18 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:18 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:18 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:18 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:19 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:24:19 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:24:19 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:24:19 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:24:19 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:19 [ERR] consul: "Coordinate.Update" RPC failed to server 10.242.78.56:8300: rpc error making call: No cluster leader
2021/04/24 11:24:19 [ERR] agent: Coordinate update error: rpc error making call: No cluster leader
2021/04/24 11:24:20 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:52008->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:24:20 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:24:20 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:20 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:24:20 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:24:20 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:24:20 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:24:22 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:24:22 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:22 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:22 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:24:22 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:22 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:24:22 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:24:22 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:22 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:22 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:24:22 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:24:22 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:24:28 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:24:28 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:24:28 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:24:30 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:24:30 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:24:30 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:24:30 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:24:30 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:24:32 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:24:32 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:32 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:32 [WARN] agent: Check "mr-kafka" is now warning
2021/04/24 11:24:32 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:24:32 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:24:32 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:32 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:24:32 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:32 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:32 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:24:32 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:24:32 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:24:33 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:33 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:34 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:34 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:34 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:34 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:35 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:52210->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:24:35 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:24:35 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:35 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:24:35 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:24:35 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:24:35 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:24:35 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:39 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:24:39 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:24:39 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:24:41 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:24:41 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:24:41 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:24:41 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:24:42 [ERR] consul: "Catalog.NodeServices" RPC failed to server 10.242.179.120:8300: rpc error making call: No cluster leader
2021/04/24 11:24:42 [ERR] agent: failed to sync remote state: rpc error making call: No cluster leader
2021/04/24 11:24:42 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:24:42 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:42 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:42 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:24:42 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:24:42 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:42 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:24:42 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:24:42 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:24:42 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:42 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:42 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:24:45 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:24:49 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:49 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:50 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:52428->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:24:50 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:24:50 [WARN] agent: Check "elasticsearch-write-health" is now warning
2021/04/24 11:24:50 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:24:50 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:24:50 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:24:50 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:24:50 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:24:50 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:24:50 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:50 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:50 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:50 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:50 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:50 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:24:51 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:24:52 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:24:52 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:24:52 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:24:52 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:24:52 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:24:52 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:52 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:52 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:24:52 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:52 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:24:52 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:24:52 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:24:52 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:24:52 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:52 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:24:52 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:24:56 [ERR] consul: "Coordinate.Update" RPC failed to server 10.242.244.7:8300: rpc error making call: No cluster leader
2021/04/24 11:24:56 [ERR] agent: Coordinate update error: rpc error making call: No cluster leader
2021/04/24 11:25:00 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:25:01 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:25:01 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:25:01 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:25:02 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:25:02 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:02 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:02 [WARN] agent: Check "mr-kafka" is now warning
2021/04/24 11:25:02 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:25:02 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:02 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:25:02 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:25:02 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:25:02 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:25:02 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:02 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:02 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:25:03 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:25:03 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:25:03 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:25:03 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:25:05 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:05 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:52622->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:25:05 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:25:05 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:25:05 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:25:05 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:25:05 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:05 [ERR] consul: "Catalog.NodeServices" RPC failed to server 10.242.78.56:8300: rpc error making call: No cluster leader
2021/04/24 11:25:05 [ERR] agent: failed to sync remote state: rpc error making call: No cluster leader
2021/04/24 11:25:05 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:25:05 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:06 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:06 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:06 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:06 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:07 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:12 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:25:12 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:25:12 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:25:12 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:25:12 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:12 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:12 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:25:12 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:12 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:25:12 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:25:12 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:25:12 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:25:12 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:12 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:12 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:25:14 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:25:14 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:25:14 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:25:14 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:25:15 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:25:20 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:52840->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:25:20 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:25:20 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:25:20 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:25:20 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:20 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:25:20 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:25:21 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:21 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:22 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:22 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:22 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:22 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:22 [ERR] consul: "Coordinate.Update" RPC failed to server 10.242.179.120:8300: rpc error making call: No cluster leader
2021/04/24 11:25:22 [ERR] agent: Coordinate update error: rpc error making call: No cluster leader
2021/04/24 11:25:22 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:25:22 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:22 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:22 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:25:22 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:22 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:25:22 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:25:22 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:25:22 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:25:22 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:22 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:22 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:25:23 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:25:23 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:25:23 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:25:23 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:25 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:25:25 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:25:25 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:25:25 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:25:30 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:25:32 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:32 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:32 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:25:32 [WARN] agent: Check "mr-kafka" is now warning
2021/04/24 11:25:32 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:25:32 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:32 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:25:32 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:25:32 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:25:32 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:25:32 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:32 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:32 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:25:34 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:25:34 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:25:34 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:25:35 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:53054->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:25:35 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:25:35 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:25:35 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:25:35 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:25:35 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:35 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:25:36 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:25:36 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:25:36 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:25:36 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:25:37 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:37 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:38 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:38 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:38 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:38 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:39 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:40 [ERR] consul: "Catalog.NodeServices" RPC failed to server 10.242.244.7:8300: rpc error making call: No cluster leader
2021/04/24 11:25:40 [ERR] agent: failed to sync remote state: rpc error making call: No cluster leader
2021/04/24 11:25:42 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:42 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:42 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:25:42 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:25:42 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:25:42 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:42 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:25:42 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:25:42 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:25:42 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:42 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:42 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:25:45 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:25:45 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:25:45 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:25:45 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:25:47 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:25:47 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:25:47 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:25:47 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:25:50 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:53284->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:25:50 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:25:50 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:25:50 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:25:50 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:25:50 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:50 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:25:52 [ERR] consul: "Coordinate.Update" RPC failed to server 10.242.78.56:8300: rpc error making call: No cluster leader
2021/04/24 11:25:52 [ERR] agent: Coordinate update error: rpc error making call: No cluster leader
2021/04/24 11:25:52 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:52 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:52 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:25:52 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:25:52 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:52 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:25:52 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:25:52 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:25:52 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:25:52 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:52 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:25:52 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:25:53 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:53 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:54 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:54 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:54 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:54 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:55 [WARN] agent: Check "elasticsearch-write-health" is now warning
2021/04/24 11:25:55 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:25:56 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:25:56 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:25:56 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:25:58 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:25:58 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:25:58 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:25:58 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:26:00 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:26:02 [WARN] agent: Check "mr-kafka" is now warning
2021/04/24 11:26:02 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:26:02 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:02 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:02 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:26:02 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:02 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:26:02 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:26:02 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:26:02 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:26:02 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:02 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:02 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:26:05 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:53498->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:26:05 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:26:05 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:05 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:26:05 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:26:05 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:26:05 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:26:07 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:26:07 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:26:07 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:26:09 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:09 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:26:09 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:26:09 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:26:09 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:26:09 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:10 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:10 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:10 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:10 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:11 [ERR] consul: "Catalog.NodeServices" RPC failed to server 10.242.179.120:8300: rpc error making call: No cluster leader
2021/04/24 11:26:11 [ERR] agent: failed to sync remote state: rpc error making call: No cluster leader
2021/04/24 11:26:11 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:12 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:26:12 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:12 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:12 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:26:12 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:26:12 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:12 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:26:12 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:26:12 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:26:12 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:12 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:12 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:26:15 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:26:18 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:26:18 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:26:18 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:26:20 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:53742->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:26:20 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:26:20 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:26:20 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:26:20 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:26:20 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:26:20 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:20 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:26:20 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:26:20 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:26:20 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:26:22 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:22 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:26:22 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:22 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:26:22 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:22 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:26:22 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:26:22 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:26:22 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:26:22 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:22 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:22 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:26:25 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:25 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:26 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:26 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:26 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:26 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:26 [ERR] consul: "Coordinate.Update" RPC failed to server 10.242.244.7:8300: rpc error making call: No cluster leader
2021/04/24 11:26:26 [ERR] agent: Coordinate update error: rpc error making call: No cluster leader
2021/04/24 11:26:27 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:29 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:26:29 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:26:29 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:26:30 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:26:31 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:26:31 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:26:31 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:26:31 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:26:32 [WARN] agent: Check "mr-kafka" is now warning
2021/04/24 11:26:32 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:32 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:26:32 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:32 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:26:32 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:32 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:26:32 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:26:32 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:26:32 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:26:32 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:32 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:32 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:26:35 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:53970->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:26:35 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:26:35 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:26:35 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:26:35 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:26:35 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:35 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:26:40 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:26:40 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:26:40 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:26:40 [ERR] consul: "Catalog.NodeServices" RPC failed to server 10.242.78.56:8300: rpc error making call: No cluster leader
2021/04/24 11:26:40 [ERR] agent: failed to sync remote state: rpc error making call: No cluster leader
2021/04/24 11:26:41 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:41 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:42 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:26:42 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:26:42 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:26:42 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:26:42 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:42 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:42 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:42 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:42 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:42 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:26:42 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:42 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:26:42 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:42 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:26:42 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:26:42 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:26:42 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:42 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:26:42 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:42 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:26:43 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:45 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:26:50 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:54214->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:26:50 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:26:50 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:26:50 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:26:50 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:26:50 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:50 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:26:51 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:26:51 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:26:51 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:26:52 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:52 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:26:52 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:52 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:26:52 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:52 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:26:52 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:26:52 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:26:52 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:52 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:26:52 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:26:52 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:26:53 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:26:53 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:26:53 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:26:53 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:26:57 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:57 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:58 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:58 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:58 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:58 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:26:58 [ERR] consul: "Coordinate.Update" RPC failed to server 10.242.179.120:8300: rpc error making call: No cluster leader
2021/04/24 11:26:58 [ERR] agent: Coordinate update error: rpc error making call: No cluster leader
2021/04/24 11:26:59 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:27:00 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:27:01 [WARN] agent: Check "elasticsearch-write-health" is now warning
2021/04/24 11:27:02 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:27:02 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:27:02 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:27:02 [WARN] agent: Check "mr-kafka" is now warning
2021/04/24 11:27:02 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:02 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:27:02 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:02 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:27:02 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:02 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:27:02 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:27:02 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:27:02 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:02 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:27:02 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:02 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:27:04 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:27:04 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:27:04 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:27:04 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:27:05 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:54424->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:27:05 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:27:05 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:27:05 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:27:05 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:27:05 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:05 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:27:05 [ERR] consul: "Catalog.NodeServices" RPC failed to server 10.242.244.7:8300: rpc error making call: No cluster leader
2021/04/24 11:27:05 [ERR] agent: failed to sync remote state: rpc error making call: No cluster leader
2021/04/24 11:27:12 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:27:12 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:12 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:12 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:12 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:27:12 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:27:12 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:27:12 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:27:12 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:12 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:12 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:27:12 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:27:13 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:27:13 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:27:13 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:27:13 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:27:13 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:27:14 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:27:14 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:27:14 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:27:14 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:27:15 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:27:15 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:27:15 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:27:15 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:27:15 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:27:15 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:27:20 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:54638->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:27:20 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:27:20 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:27:20 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:27:20 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:27:20 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:20 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:27:22 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:27:22 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:22 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:22 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:22 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:27:22 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:27:22 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:27:22 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:27:22 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:22 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:22 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:27:22 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:27:24 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:27:24 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:27:24 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:27:26 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:27:26 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:27:26 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:27:26 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:27:27 [ERR] consul: "Coordinate.Update" RPC failed to server 10.242.78.56:8300: rpc error making call: No cluster leader
2021/04/24 11:27:27 [ERR] agent: Coordinate update error: rpc error making call: No cluster leader
2021/04/24 11:27:29 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:27:29 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:27:30 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:27:30 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:27:30 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:27:30 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:27:30 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:27:31 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:27:32 [ERR] consul: "Catalog.NodeServices" RPC failed to server 10.242.78.56:8300: rpc error making call: No cluster leader
2021/04/24 11:27:32 [ERR] agent: failed to sync remote state: rpc error making call: No cluster leader
2021/04/24 11:27:32 [WARN] agent: Check "mr-kafka" is now warning
2021/04/24 11:27:32 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:27:32 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:32 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:32 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:32 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:27:32 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:27:32 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:27:32 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:27:32 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:32 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:32 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:27:33 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:27:35 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:54848->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:27:35 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:27:35 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:27:35 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:27:35 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:27:35 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:27:35 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:27:35 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:27:35 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:35 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:27:37 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:27:37 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:27:37 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:27:37 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:27:42 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:27:42 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:42 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:42 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:42 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:27:42 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:27:42 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:27:42 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:27:42 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:42 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:42 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:27:43 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:27:45 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:27:45 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:27:45 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:27:46 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:27:46 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:27:46 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:27:46 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:27:46 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:27:46 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:27:46 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:27:47 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:27:48 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:27:48 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:27:48 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:27:48 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:27:50 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:55068->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:27:50 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:27:50 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:27:50 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:27:50 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:27:50 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:50 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:27:52 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:27:52 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:52 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:52 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:52 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:27:53 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:27:53 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:53 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:27:53 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:27:53 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:27:53 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:27:53 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:27:55 [ERR] consul: "Coordinate.Update" RPC failed to server 10.242.179.120:8300: rpc error making call: No cluster leader
2021/04/24 11:27:55 [ERR] agent: Coordinate update error: rpc error making call: No cluster leader
2021/04/24 11:27:57 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:27:57 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:27:57 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:27:59 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:27:59 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:27:59 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:27:59 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:28:00 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:28:01 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:01 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:02 [ERR] consul: "Catalog.NodeServices" RPC failed to server 10.242.179.120:8300: rpc error making call: No cluster leader
2021/04/24 11:28:02 [ERR] agent: failed to sync remote state: rpc error making call: No cluster leader
2021/04/24 11:28:02 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:02 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:02 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:02 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:02 [WARN] agent: Check "mr-kafka" is now warning
2021/04/24 11:28:02 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:28:02 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:02 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:02 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:02 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:28:03 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:28:03 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:03 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:03 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:28:03 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:28:03 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:28:03 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:28:03 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:05 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:55264->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:28:05 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:28:05 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:28:05 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:28:05 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:28:05 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:05 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:28:06 [WARN] agent: Check "elasticsearch-write-health" is now warning
2021/04/24 11:28:08 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:28:08 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:28:08 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:28:10 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:28:10 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:28:10 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:28:10 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:28:12 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:28:12 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:12 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:12 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:12 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:28:13 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:28:13 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:13 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:13 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:28:13 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:28:13 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:28:13 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:28:15 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:28:17 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:17 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:18 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:18 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:18 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:18 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:19 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:28:19 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:28:19 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:28:19 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:20 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:55484->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:28:20 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:28:20 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:28:20 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:28:20 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:28:20 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:20 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:28:21 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:28:21 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:28:21 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:28:21 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:28:22 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:28:22 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:22 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:22 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:22 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:28:23 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:23 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:28:23 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:23 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:28:23 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:28:23 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:28:23 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:28:25 [ERR] consul: "Coordinate.Update" RPC failed to server 10.242.244.7:8300: rpc error making call: No cluster leader
2021/04/24 11:28:25 [ERR] agent: Coordinate update error: rpc error making call: No cluster leader
2021/04/24 11:28:30 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:28:30 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:28:30 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:28:30 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:28:32 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:28:32 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:28:32 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:28:32 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:28:32 [WARN] agent: Check "mr-kafka" is now warning
2021/04/24 11:28:32 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:28:32 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:32 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:33 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:33 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:28:33 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:33 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:33 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:33 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:28:33 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:28:33 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:28:33 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:28:33 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:28:33 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:34 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:34 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:34 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:34 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:34 [ERR] consul: "Catalog.NodeServices" RPC failed to server 10.242.179.120:8300: rpc error making call: No cluster leader
2021/04/24 11:28:34 [ERR] agent: failed to sync remote state: rpc error making call: No cluster leader
2021/04/24 11:28:35 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:55700->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:28:35 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:28:35 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:28:35 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:28:35 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:28:35 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:35 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:35 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:28:41 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:28:41 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:28:41 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:28:42 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:28:42 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:43 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:43 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:43 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:28:43 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:43 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:43 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:28:43 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:28:43 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:28:43 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:28:43 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:28:43 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:28:43 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:28:43 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:28:43 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:28:45 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:28:49 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:49 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:50 [ERR] consul: "Coordinate.Update" RPC failed to server 10.242.78.56:8300: rpc error making call: No cluster leader
2021/04/24 11:28:50 [ERR] agent: Coordinate update error: rpc error making call: No cluster leader
2021/04/24 11:28:50 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.109.220:55914->10.96.185.246:9009: read: connection reset by peer
2021/04/24 11:28:50 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/04/24 11:28:50 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:50 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:50 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:50 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:50 [WARN] agent: Check "data-router-process" is now warning
2021/04/24 11:28:50 [WARN] agent: Check "model-loader-process" is now warning
2021/04/24 11:28:50 [WARN] agent: Check "sparky-be-process" is now warning
2021/04/24 11:28:50 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:50 [WARN] agent: Check "search-data-service-api" is now warning
2021/04/24 11:28:51 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/04/24 11:28:52 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check
2021/04/24 11:28:52 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check
2021/04/24 11:28:52 [WARN] Check "so-api-healthcheck": Timed out (1s) running check
2021/04/24 11:28:52 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:28:53 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:53 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:53 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:53 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:28:53 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:53 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:28:53 [WARN] agent: Check "vid-mariadb" is now warning
2021/04/24 11:28:53 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/04/24 11:28:53 [WARN] agent: Check "so-mariadb" is now warning
2021/04/24 11:28:53 [WARN] agent: Check "mr-zookeeper" is now warning
2021/04/24 11:28:53 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/04/24 11:28:54 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/04/24 11:28:54 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/04/24 11:28:54 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/04/24 11:28:54 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/04/24 11:29:00 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical
2021/04/24 11:29:02 [WARN] agent: Check "mr-kafka" is now warning
2021/04/24 11:29:02 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/04/24 11:29:03 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/04/24 11:29:03 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/04/24 11:29:03 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/04/24 11:29:03 [WARN] agent: Check "clamp-mariadb" is now warning
2021/04/24 11:29:03 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup a