By type
+ CONSUL_BIND= + [ -n ] + CONSUL_CLIENT= + [ -n ] + CONSUL_DATA_DIR=/consul/data + CONSUL_CONFIG_DIR=/consul/config + [ -n ] + [ a = - ] + [ agent = agent ] + shift + set -- consul agent -data-dir=/consul/data -config-dir=/consul/config -client 0.0.0.0 -enable-script-checks -retry-join consul-server + [ consul = consul ] + stat -c %u /consul/data + id -u consul + [ 100 != 100 ] + stat -c %u /consul/config + id -u consul + [ 100 != 100 ] + [ ! -z ] + exec consul agent -data-dir=/consul/data -config-dir=/consul/config -client 0.0.0.0 -enable-script-checks -retry-join consul-server ==> Starting Consul agent... ==> Consul agent running! Version: 'v1.0.6' Node ID: '4886ee4b-ec67-9057-43ee-8bf5b2229410' Node name: 'dev-consul-7467bf7b46-h84nh' Datacenter: 'dc1' (Segment: '') Server: false (Bootstrap: false) Client Addr: [0.0.0.0] (HTTP: 8500, HTTPS: -1, DNS: 8600) Cluster Addr: 10.242.20.135 (LAN: 8301, WAN: 8302) Encrypt: Gossip: false, TLS-Outgoing: false, TLS-Incoming: false ==> Log data will now stream in as it occurs: 2021/04/13 08:37:15 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-h84nh 10.242.20.135 2021/04/13 08:37:15 [WARN] Service name "Health Check: Application Authorization Framework" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] Service name "Health Check: Secret Management Service (sms)" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] Service name "A&AI Synapse Data Routing Service" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] manager: No servers available 2021/04/13 08:37:15 [ERR] agent: failed to sync remote state: No known Consul servers 2021/04/13 08:37:15 [WARN] agent: check "data-router-process" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/04/13 08:37:15 [WARN] Service name "A&AI Model Loader" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] agent: check "model-loader-process" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/04/13 08:37:15 [WARN] Service name "A&AI Search Data Service" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] agent: check "elasticsearch-write-health" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/04/13 08:37:15 [WARN] agent: check "search-data-service-availability" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/04/13 08:37:15 [WARN] agent: check "search-data-service-api" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/04/13 08:37:15 [WARN] Service name "Active and Available Inventory" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] Service name "A&AI UI Backend Service" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] agent: check "sparky-be-process" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/04/13 08:37:15 [WARN] Service name "Health Check: APPC - Dgbuilder" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] Service name "Health Check: APPC" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] agent: check "appc-dbhost-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/04/13 08:37:15 [WARN] Service name "Health Check: APPC-SDN-CTL-DB-01" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] Service name "Health Check: APPC-SDN-CTL-DB-02" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] Service name "Health Check: APPC - SDN Host" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] Service name "Health Check: CLAMP" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] Service name "Health Check: CLAMP - MariaDb" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] agent: check "clamp-mariadb" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/04/13 08:37:15 [WARN] Service name "Health Check: ONAP CLI" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] Service name "Health Check: Log - Elastic Search" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] Service name "Health Check: Log - Kibana" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] Service name "Health Check: Log - Log Stash" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] Service name "Health Check: DMaaP" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] agent: check "mr-zookeeper" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/04/13 08:37:15 [WARN] agent: check "mr-kafka" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/04/13 08:37:15 [WARN] Service name "Health Check: MSB" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] Service name "Health Check: MULTICLOUD" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] Service name "Health Check: Policy" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] agent: check "Policy-mariadb-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/04/13 08:37:15 [WARN] Service name "Health Check: SDC" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] agent: check "sdc-fe-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/04/13 08:37:15 [WARN] agent: check "sdc-be-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/04/13 08:37:15 [WARN] agent: check "sdc-titan-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/04/13 08:37:15 [WARN] agent: check "sdc-cs-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/04/13 08:37:15 [WARN] Service name "Health Check: SDNC ODL Cluster" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] agent: check "sdnc-odl-cluster-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/04/13 08:37:15 [WARN] Service name "Health Check: SDNC - DB Host" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] agent: check "sdnc-dbhost-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/04/13 08:37:15 [WARN] Service name "Health Check: SDNC - DGBuilder" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] Service name "Health Check: SDNC" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] Service name "Health Check: SDNC-SDN-CTL-DB-01" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] Service name "Health Check: SDNC-SDN-CTL-DB-02" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] Service name "Health Check: SDNC - SDN Host" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] Service name "Health Check: SO" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] agent: check "so-api-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/04/13 08:37:15 [WARN] agent: check "so-camunda-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/04/13 08:37:15 [WARN] agent: check "so-jra-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/04/13 08:37:15 [WARN] Service name "Health Check: SO - MariaDb" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] agent: check "so-mariadb" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/04/13 08:37:15 [WARN] Service name "Health Check: VFC" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] Service name "Health Check: VID" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/04/13 08:37:15 [WARN] agent: check "vid-mariadb" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/04/13 08:37:15 [INFO] agent: Started DNS server 0.0.0.0:8600 (tcp) 2021/04/13 08:37:15 [INFO] agent: Started DNS server 0.0.0.0:8600 (udp) 2021/04/13 08:37:15 [INFO] agent: Started HTTP server on [::]:8500 (tcp) 2021/04/13 08:37:15 [INFO] agent: started state syncer 2021/04/13 08:37:15 [INFO] agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce os scaleway softlayer 2021/04/13 08:37:15 [INFO] agent: Joining LAN cluster... 2021/04/13 08:37:15 [INFO] agent: (LAN) joining: [consul-server] 2021/04/13 08:37:15 [WARN] memberlist: Failed to resolve consul-server: lookup consul-server on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:15 [INFO] agent: (LAN) joined: 0 Err: 1 error(s) occurred: * Failed to resolve consul-server: lookup consul-server on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:15 [WARN] agent: Join LAN failed:
, retrying in 30s 2021/04/13 08:37:15 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:15 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: dial tcp: lookup msb-iag on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:15 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:16 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:16 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:16 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:16 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:16 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:16 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:37:16 [WARN] agent: Check "multicloud-vio" HTTP request failed: Head http://multicloud-vio:9004/api/multicloud-vio/v0/swagger.json: dial tcp: lookup multicloud-vio on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:17 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:37:17 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:17 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:37:17 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:17 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:17 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:17 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:18 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: dial tcp: lookup multicloud-starlingx on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:18 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:19 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:37:19 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:37:19 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:37:20 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:37:20 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:20 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:20 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:37:20 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:37:20 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:37:20 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:20 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:37:20 [WARN] agent: Check "elasticsearch-write-health" is now warning 2021/04/13 08:37:21 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:37:21 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:21 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:21 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:21 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:37:21 [WARN] agent: Check "mr-kafka" is now warning 2021/04/13 08:37:22 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:37:22 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:37:22 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:22 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:22 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:22 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:23 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:37:23 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:37:23 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:23 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:23 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:23 [WARN] agent: Check "aaf-sms-health" HTTP request failed: Get https://aaf-sms.onap:10443/v1/sms/healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:37:23 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:23 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:37:23 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:23 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:23 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:23 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:37:24 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:24 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:24 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:37:24 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:24 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:24 [WARN] agent: Check "multicloud-pike" HTTP request failed: Head http://multicloud-pike:9007/api/multicloud-pike/v0/swagger.json: dial tcp: lookup multicloud-pike on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:25 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:25 [WARN] agent: Check "msb-consul" socket connection failed: dial tcp: lookup msb-consul on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:25 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:25 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:25 [WARN] agent: Check "msb-discovery" socket connection failed: dial tcp: lookup msb-discovery on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:26 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: dial tcp: lookup msb-eag on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:26 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:26 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:26 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:37:26 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:37:27 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:37:27 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:27 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:27 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:27 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:28 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:37:28 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:28 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:37:28 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:28 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:29 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:29 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:37:29 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:37:29 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:29 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:29 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:30 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:30 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:37:30 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:37:30 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:37:30 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:37:30 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:30 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: dial tcp: lookup msb-iag on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:30 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:31 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:37:31 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:31 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:31 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:31 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:31 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:31 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:31 [WARN] agent: Check "multicloud-vio" HTTP request failed: Head http://multicloud-vio:9004/api/multicloud-vio/v0/swagger.json: dial tcp: lookup multicloud-vio on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:32 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:32 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:32 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:32 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:32 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:37:32 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:33 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: dial tcp: lookup multicloud-starlingx on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:33 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:37:33 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:37:33 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:34 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:37:34 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check ==> Failed to check for updates: Get https://checkpoint-api.hashicorp.com/v1/check/consul?arch=amd64&os=linux&signature=b62edb5a-5a19-068e-9bc2-9da83b304e24&version=1.0.6: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:37:35 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:37:35 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:35 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:35 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:35 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:37:36 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:36 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:37:36 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:36 [WARN] manager: No servers available 2021/04/13 08:37:36 [ERR] agent: failed to sync remote state: No known Consul servers 2021/04/13 08:37:36 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:37:37 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:37:37 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:37 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:37 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:37 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:38 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:37:38 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:38 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:38 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:38 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:38 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:38 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: dial tcp: lookup message-router on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:38 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:38 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:38 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:37:39 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:39 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:39 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:39 [WARN] agent: Check "aaf-service" HTTP request failed: Get https://aaf-service:8100/authz/perms/user/demo@people.osaaf.org: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:37:39 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:37:39 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:39 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:37:39 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:37:39 [WARN] agent: Check "multicloud-pike" HTTP request failed: Head http://multicloud-pike:9007/api/multicloud-pike/v0/swagger.json: dial tcp: lookup multicloud-pike on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:40 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:40 [WARN] agent: Check "msb-consul" socket connection failed: dial tcp: lookup msb-consul on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:40 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:37:40 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:40 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:37:40 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:40 [WARN] agent: Check "msb-discovery" socket connection failed: dial tcp: lookup msb-discovery on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:41 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:37:41 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:37:41 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: dial tcp: lookup msb-eag on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:41 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:41 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:41 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:37:41 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:42 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:42 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:42 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:42 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:37:42 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:43 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:43 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:43 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:37:43 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:44 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:44 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:37:44 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:37:44 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:37:44 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:37:44 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:37:44 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:44 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:44 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:45 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:45 [INFO] agent: (LAN) joining: [consul-server] 2021/04/13 08:37:45 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.9.70 2021/04/13 08:37:45 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.20.141 2021/04/13 08:37:45 [INFO] consul: adding server dev-consul-server-0 (Addr: tcp/10.242.9.70:8300) (DC: dc1) 2021/04/13 08:37:45 [INFO] consul: adding server dev-consul-server-1 (Addr: tcp/10.242.20.141:8300) (DC: dc1) 2021/04/13 08:37:45 [INFO] agent: (LAN) joined: 2 Err: 2021/04/13 08:37:45 [INFO] agent: Join LAN completed. Synced with 2 initial agents 2021/04/13 08:37:45 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:37:45 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:45 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: dial tcp: lookup msb-iag on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:45 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:46 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:46 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:46 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:46 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:46 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:46 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:37:46 [WARN] agent: Check "multicloud-vio" HTTP request failed: Head http://multicloud-vio:9004/api/multicloud-vio/v0/swagger.json: dial tcp: lookup multicloud-vio on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:47 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:37:47 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:47 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:47 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:47 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:48 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:48 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: dial tcp: lookup multicloud-starlingx on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:48 [WARN] agent: Check "aaf-sms-health" HTTP request failed: Get https://aaf-sms.onap:10443/v1/sms/healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:37:48 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:49 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:37:50 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:37:50 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:50 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:50 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:37:50 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:37:50 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:37:50 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:50 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:37:51 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:37:51 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:51 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:51 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:52 [WARN] agent: Check "mr-kafka" is now warning 2021/04/13 08:37:52 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:37:52 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:37:52 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:52 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:52 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:37:52 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:52 [ERR] consul: "Catalog.NodeServices" RPC failed to server 10.242.9.70:8300: rpc error making call: No cluster leader 2021/04/13 08:37:52 [ERR] agent: failed to sync remote state: rpc error making call: No cluster leader 2021/04/13 08:37:52 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:53 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:37:53 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:53 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:53 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:53 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:53 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:53 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:53 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:54 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:37:54 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:54 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:54 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:37:54 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:54 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:54 [WARN] agent: Check "multicloud-pike" HTTP request failed: Head http://multicloud-pike:9007/api/multicloud-pike/v0/swagger.json: dial tcp: lookup multicloud-pike on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:54 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:37:55 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:55 [WARN] agent: Check "msb-consul" socket connection failed: dial tcp: lookup msb-consul on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:55 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:37:55 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:37:55 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:55 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:55 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:37:55 [WARN] agent: Check "msb-discovery" socket connection failed: dial tcp: lookup msb-discovery on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:56 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:37:56 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: dial tcp: lookup msb-eag on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:56 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:56 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:56 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:37:57 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:37:57 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:57 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:57 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:57 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:58 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:58 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:37:58 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:58 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:59 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:59 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:37:59 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:37:59 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:59 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:37:59 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:00 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:00 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:38:00 [ERR] consul: "Catalog.NodeServices" RPC failed to server 10.242.20.141:8300: rpc error making call: No cluster leader 2021/04/13 08:38:00 [ERR] agent: failed to sync remote state: rpc error making call: No cluster leader 2021/04/13 08:38:00 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:38:00 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:38:00 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:00 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: dial tcp: lookup msb-iag on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:00 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:01 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:38:01 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:01 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:38:01 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:01 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:01 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:01 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:01 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:01 [WARN] agent: Check "multicloud-vio" HTTP request failed: Head http://multicloud-vio:9004/api/multicloud-vio/v0/swagger.json: dial tcp: lookup multicloud-vio on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:02 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:02 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:02 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:02 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:03 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:03 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: dial tcp: lookup multicloud-starlingx on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:03 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:38:03 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:38:03 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:04 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:38:04 [WARN] agent: Check "aaf-service" HTTP request failed: Get https://aaf-service:8100/authz/perms/user/demo@people.osaaf.org: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:38:05 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:38:05 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:05 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:05 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:05 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:38:05 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:38:06 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:06 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:38:06 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:06 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:38:06 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:38:07 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:38:07 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:38:07 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:07 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:07 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:07 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:08 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:38:08 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:38:08 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:08 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:08 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:08 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:08 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:08 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: dial tcp: lookup message-router on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:08 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:08 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:09 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:38:09 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:09 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:09 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:09 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:09 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:38:09 [WARN] agent: Check "multicloud-pike" HTTP request failed: Head http://multicloud-pike:9007/api/multicloud-pike/v0/swagger.json: dial tcp: lookup multicloud-pike on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:10 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:10 [WARN] agent: Check "msb-consul" socket connection failed: dial tcp: lookup msb-consul on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:10 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:38:10 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:10 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:38:10 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:10 [WARN] agent: Check "msb-discovery" socket connection failed: dial tcp: lookup msb-discovery on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:11 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:38:11 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: dial tcp: lookup msb-eag on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:11 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:11 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:11 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:38:11 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:12 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:12 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:38:12 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:12 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:12 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:13 [ERR] consul: "Coordinate.Update" RPC failed to server 10.242.9.70:8300: rpc error making call: No cluster leader 2021/04/13 08:38:13 [ERR] agent: Coordinate update error: rpc error making call: No cluster leader 2021/04/13 08:38:13 [WARN] agent: Check "aaf-sms-health" HTTP request failed: Get https://aaf-sms.onap:10443/v1/sms/healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:38:13 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:13 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:13 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:14 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:14 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:38:14 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:38:14 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:38:14 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.36.8 2021/04/13 08:38:14 [INFO] consul: adding server dev-consul-server-2 (Addr: tcp/10.242.36.8:8300) (DC: dc1) 2021/04/13 08:38:14 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:38:14 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:38:14 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:14 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:14 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:15 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:15 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:15 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: dial tcp: lookup msb-iag on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:15 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:16 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:16 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:16 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:16 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:38:16 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:16 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:16 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:38:16 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:38:16 [WARN] agent: Check "multicloud-vio" HTTP request failed: Head http://multicloud-vio:9004/api/multicloud-vio/v0/swagger.json: dial tcp: lookup multicloud-vio on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:17 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:38:17 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:17 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:38:17 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:17 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:38:17 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:17 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:18 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:18 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: dial tcp: lookup multicloud-starlingx on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:18 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:38:18 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:19 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:38:20 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:38:20 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:20 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:20 [INFO] consul: New leader elected: dev-consul-server-0 2021/04/13 08:38:20 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:38:20 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: MULTICLOUD" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: APPC" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: Log - Log Stash" 2021/04/13 08:38:20 [INFO] agent: Synced service "A&AI Search Data Service" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: APPC - Dgbuilder" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: Log - Elastic Search" 2021/04/13 08:38:20 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: SDNC - DB Host" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: SDNC - DGBuilder" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: SDNC-SDN-CTL-DB-01" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: Application Authorization Framework" 2021/04/13 08:38:20 [INFO] agent: Synced service "A&AI Model Loader" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: CLAMP - MariaDb" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: SDC" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: SO - MariaDb" 2021/04/13 08:38:20 [INFO] agent: Synced service "A&AI Synapse Data Routing Service" 2021/04/13 08:38:20 [INFO] agent: Synced service "Active and Available Inventory" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: Policy" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: APPC - SDN Host" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: DMaaP" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: SDNC" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: SO" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: CLAMP" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: MSB" 2021/04/13 08:38:20 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: SDNC-SDN-CTL-DB-02" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: SDNC - SDN Host" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: VFC" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: APPC-SDN-CTL-DB-01" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: Log - Kibana" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: Secret Management Service (sms)" 2021/04/13 08:38:20 [INFO] agent: Synced service "A&AI UI Backend Service" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: SDNC ODL Cluster" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: VID" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: APPC-SDN-CTL-DB-02" 2021/04/13 08:38:20 [INFO] agent: Synced service "Health Check: ONAP CLI" 2021/04/13 08:38:21 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:38:21 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:21 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:21 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:22 [WARN] agent: Check "mr-kafka" is now warning 2021/04/13 08:38:22 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:22 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:22 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:22 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:23 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:38:23 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:38:23 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:23 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:23 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:23 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:23 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:23 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:23 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:24 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:24 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:38:24 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:24 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:38:24 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:38:24 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:24 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:24 [WARN] agent: Check "multicloud-pike" HTTP request failed: Head http://multicloud-pike:9007/api/multicloud-pike/v0/swagger.json: dial tcp: lookup multicloud-pike on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:24 [INFO] agent: Synced check "aaf-service" 2021/04/13 08:38:25 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:25 [WARN] agent: Check "msb-consul" socket connection failed: dial tcp: lookup msb-consul on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:25 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:38:25 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:25 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:25 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:38:25 [WARN] agent: Check "msb-discovery" socket connection failed: dial tcp: lookup msb-discovery on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:26 [WARN] agent: Check "elasticsearch-write-health" is now warning 2021/04/13 08:38:26 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: dial tcp: lookup msb-eag on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:26 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:26 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:26 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:38:27 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:38:27 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:27 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:27 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:38:27 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:27 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:27 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:38:28 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:38:28 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:38:28 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:28 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:28 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:29 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:29 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:38:29 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:38:29 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:38:29 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:29 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:29 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:30 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:30 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:38:30 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:38:30 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:38:30 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:30 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: dial tcp: lookup msb-iag on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:30 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:31 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:38:31 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:31 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:31 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:31 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:31 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:31 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:31 [WARN] agent: Check "multicloud-vio" HTTP request failed: Head http://multicloud-vio:9004/api/multicloud-vio/v0/swagger.json: dial tcp: lookup multicloud-vio on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:32 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:32 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:32 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:32 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:38:32 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:33 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:33 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: dial tcp: lookup multicloud-starlingx on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:33 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:34 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:38:34 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:38:35 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:38:35 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:35 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:35 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:35 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:38:36 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:36 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:38:36 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:36 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:38:36 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:38:37 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:38:37 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:37 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:37 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:37 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:38 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:38:38 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:38 [WARN] agent: Check "aaf-sms-health" HTTP request failed: Get https://aaf-sms.onap:10443/v1/sms/healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:38:38 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:38 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:38 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:38 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:38 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:38:38 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: dial tcp: lookup message-router on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:38 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:39 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:39 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:39 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:38:39 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:39 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:39 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:38:39 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:38:39 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:39 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:38:39 [WARN] agent: Check "multicloud-pike" HTTP request failed: Head http://multicloud-pike:9007/api/multicloud-pike/v0/swagger.json: dial tcp: lookup multicloud-pike on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:40 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:40 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:38:40 [WARN] agent: Check "msb-consul" socket connection failed: dial tcp: lookup msb-consul on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:40 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:38:40 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:38:40 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:40 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:38:40 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:40 [WARN] agent: Check "msb-discovery" socket connection failed: dial tcp: lookup msb-discovery on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:41 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:38:41 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: dial tcp: lookup msb-eag on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:41 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:41 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:41 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:42 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:42 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:42 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:42 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:43 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:43 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:38:43 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:43 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:44 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:44 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:38:44 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:38:44 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:44 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:44 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:45 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:45 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:38:45 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:45 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: dial tcp: lookup msb-iag on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:46 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:46 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:46 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:46 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:46 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:38:46 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:46 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:46 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:38:46 [WARN] agent: Check "multicloud-vio" HTTP request failed: Head http://multicloud-vio:9004/api/multicloud-vio/v0/swagger.json: dial tcp: lookup multicloud-vio on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:47 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:38:47 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:47 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:38:47 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:47 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:47 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:38:47 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:48 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:48 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: dial tcp: lookup multicloud-starlingx on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:48 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:38:48 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:49 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:38:49 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:38:50 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:38:50 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:50 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:50 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:38:50 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:38:50 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:38:50 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:38:50 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:50 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:38:51 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:38:51 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:51 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:38:51 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:51 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:52 [WARN] agent: Check "mr-kafka" is now warning 2021/04/13 08:38:52 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:52 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:52 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:52 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:53 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:38:53 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:53 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:53 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:53 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:53 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:53 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:54 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:54 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:54 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:38:54 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:54 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:38:54 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:54 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:54 [WARN] agent: Check "multicloud-pike" HTTP request failed: Head http://multicloud-pike:9007/api/multicloud-pike/v0/swagger.json: dial tcp: lookup multicloud-pike on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:55 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:55 [WARN] agent: Check "msb-consul" socket connection failed: dial tcp: lookup msb-consul on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:55 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:55 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:55 [WARN] agent: Check "msb-discovery" socket connection failed: dial tcp: lookup msb-discovery on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:56 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:38:56 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:38:56 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: dial tcp: lookup msb-eag on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:56 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:56 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:56 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:38:57 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:38:57 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:57 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:57 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:57 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:58 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:38:58 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:58 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:38:58 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:58 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:59 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:59 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:38:59 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:38:59 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:38:59 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:59 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:38:59 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:00 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:00 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:39:00 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:39:00 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:00 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: dial tcp: lookup msb-iag on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:00 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:39:01 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:01 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:39:01 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:01 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:39:01 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:39:01 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:01 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:01 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:01 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:01 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:01 [WARN] agent: Check "multicloud-vio" HTTP request failed: Head http://multicloud-vio:9004/api/multicloud-vio/v0/swagger.json: dial tcp: lookup multicloud-vio on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:02 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:02 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:39:02 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:02 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:02 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:02 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:03 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:03 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: dial tcp: lookup multicloud-starlingx on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:03 [WARN] agent: Check "aaf-sms-health" HTTP request failed: Get https://aaf-sms.onap:10443/v1/sms/healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:03 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:04 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:39:04 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:05 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:39:05 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:05 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:05 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:05 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:39:06 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:06 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:06 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:39:07 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:39:07 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:39:07 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:07 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:07 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:07 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:08 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:39:08 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:08 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:08 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:08 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:08 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:08 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: dial tcp: lookup message-router on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:08 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:09 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:09 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:09 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:39:09 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:09 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:09 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:39:09 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:09 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:39:09 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:39:09 [WARN] agent: Check "multicloud-pike" HTTP request failed: Head http://multicloud-pike:9007/api/multicloud-pike/v0/swagger.json: dial tcp: lookup multicloud-pike on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:10 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:10 [WARN] agent: Check "msb-consul" socket connection failed: dial tcp: lookup msb-consul on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:10 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:39:10 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:10 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:39:10 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:10 [WARN] agent: Check "msb-discovery" socket connection failed: dial tcp: lookup msb-discovery on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:11 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:39:11 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: dial tcp: lookup msb-eag on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:11 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:11 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:11 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:11 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:39:12 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:12 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:12 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:39:12 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:39:12 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:12 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:12 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:13 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:39:13 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:13 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:13 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:14 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:14 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:39:14 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:39:14 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:14 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:15 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:15 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:15 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:15 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:15 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: dial tcp: lookup msb-iag on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:16 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:16 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:16 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:16 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:16 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:16 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:16 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:39:16 [WARN] agent: Check "multicloud-vio" HTTP request failed: Head http://multicloud-vio:9004/api/multicloud-vio/v0/swagger.json: dial tcp: lookup multicloud-vio on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:17 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:39:17 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:17 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:17 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:17 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:18 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:18 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: dial tcp: lookup multicloud-starlingx on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:18 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:39:18 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:18 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:19 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:39:20 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:39:20 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:20 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:20 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:39:20 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:39:20 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:20 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:39:20 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:39:20 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:20 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:39:21 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:39:21 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:21 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:21 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:22 [WARN] agent: Check "mr-kafka" is now warning 2021/04/13 08:39:22 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:22 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:22 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:22 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:39:22 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:23 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:39:23 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:39:23 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:39:23 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:23 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:23 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:23 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:23 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:23 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:24 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:24 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:24 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:39:24 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:24 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:39:24 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:24 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:39:24 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:24 [WARN] agent: Check "multicloud-pike" HTTP request failed: Head http://multicloud-pike:9007/api/multicloud-pike/v0/swagger.json: dial tcp: lookup multicloud-pike on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:25 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:25 [WARN] agent: Check "msb-consul" socket connection failed: dial tcp: lookup msb-consul on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:25 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:25 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:25 [WARN] agent: Check "msb-discovery" socket connection failed: dial tcp: lookup msb-discovery on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:26 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: dial tcp: lookup msb-eag on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:26 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:26 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:26 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:39:27 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:39:27 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:27 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:27 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:27 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:28 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:28 [WARN] agent: Check "aaf-sms-health" HTTP request failed: Get https://aaf-sms.onap:10443/v1/sms/healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:28 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:28 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:28 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:29 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:29 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:39:29 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:39:29 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:39:29 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:29 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:30 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:30 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:30 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:39:30 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:39:30 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:30 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: dial tcp: lookup msb-iag on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:31 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:31 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:39:31 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:31 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:39:31 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:31 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:31 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:31 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:39:31 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:31 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:31 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:31 [WARN] agent: Check "elasticsearch-write-health" is now warning 2021/04/13 08:39:32 [WARN] agent: Check "multicloud-vio" HTTP request failed: Head http://multicloud-vio:9004/api/multicloud-vio/v0/swagger.json: dial tcp: lookup multicloud-vio on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:32 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:32 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:32 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:32 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:33 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:33 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: dial tcp: lookup multicloud-starlingx on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:33 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:33 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:39:34 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:39:34 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:39:34 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:39:34 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:35 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:39:35 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:35 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:35 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:39:35 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:35 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:39:36 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:36 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:36 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:36 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:39:37 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:39:37 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:37 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:37 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:37 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:38 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:39:38 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:38 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:38 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:38 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:38 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:39 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:39 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:39 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:39 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:39:39 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:39 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:39 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:39:39 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:39 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:39 [WARN] agent: Check "multicloud-pike" HTTP request failed: Head http://multicloud-pike:9007/api/multicloud-pike/v0/swagger.json: dial tcp: lookup multicloud-pike on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:40 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:40 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:39:40 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:39:40 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:40 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:39:40 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:41 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:39:41 [WARN] agent: Check "msb-consul" socket connection failed: dial tcp 10.96.87.116:8500: i/o timeout 2021/04/13 08:39:41 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:41 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:41 [WARN] agent: Check "msb-discovery" socket connection failed: dial tcp 10.96.31.18:10081: i/o timeout 2021/04/13 08:39:41 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:42 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:42 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:39:42 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:42 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:42 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:39:42 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:42 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:43 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:43 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:44 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:44 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:44 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:44 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:39:44 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:39:44 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:44 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:44 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:39:45 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:45 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:45 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:39:45 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:39:45 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:46 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:46 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:46 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:39:46 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:46 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:46 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:46 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:46 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:39:46 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:47 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:39:47 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:47 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:47 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:47 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:47 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:48 [WARN] agent: Check "multicloud-vio" HTTP request failed: Head http://multicloud-vio:9004/api/multicloud-vio/v0/swagger.json: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:48 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:48 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: dial tcp: lookup multicloud-starlingx on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:49 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:49 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:39:50 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:39:50 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:50 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:50 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:39:50 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:50 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:39:50 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:51 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:39:51 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:39:51 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:51 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:39:51 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:51 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:52 [INFO] agent: Synced check "framework" 2021/04/13 08:39:52 [WARN] agent: Check "mr-kafka" is now warning 2021/04/13 08:39:52 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:52 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:52 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:52 [INFO] agent: Synced check "vfc-nokiavnfmdriver" 2021/04/13 08:39:52 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:52 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:53 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:39:53 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:39:53 [WARN] agent: Check "aaf-sms-health" HTTP request failed: Get https://aaf-sms.onap:10443/v1/sms/healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:53 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:53 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:53 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:53 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:53 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:39:53 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:53 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:54 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:54 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:54 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:39:54 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:54 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:54 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:39:54 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:55 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:55 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:55 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:55 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:39:55 [WARN] agent: Check "multicloud-pike" HTTP request failed: Head http://multicloud-pike:9007/api/multicloud-pike/v0/swagger.json: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:56 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:39:56 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:39:56 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:56 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:56 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:39:57 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:39:57 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:57 [WARN] agent: Check "msb-consul" socket connection failed: dial tcp 10.96.87.116:8500: i/o timeout 2021/04/13 08:39:57 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:39:57 [INFO] agent: Synced check "vfc-hwvnfmdriver" 2021/04/13 08:39:57 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:57 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:57 [WARN] agent: Check "msb-discovery" socket connection failed: dial tcp 10.96.31.18:10081: i/o timeout 2021/04/13 08:39:57 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:58 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:39:58 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:59 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:59 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:59 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:59 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:39:59 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:39:59 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:39:59 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:00 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:00 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:00 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:00 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:40:00 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:40:00 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:01 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:01 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:40:01 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:01 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:01 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:01 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:01 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:01 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:02 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:02 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:40:02 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:02 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:02 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:02 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:03 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:03 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:03 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:04 [WARN] agent: Check "multicloud-vio" HTTP request failed: Head http://multicloud-vio:9004/api/multicloud-vio/v0/swagger.json: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:04 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:04 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:40:04 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:40:04 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:40:05 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:40:05 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:05 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:05 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:06 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:40:06 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:06 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:06 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:06 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:40:06 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:40:07 [INFO] agent: Synced check "so-camunda-healthcheck" 2021/04/13 08:40:07 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:40:07 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:40:07 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:40:07 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:07 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:07 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:07 [INFO] agent: Synced check "vfc-vnfres" 2021/04/13 08:40:07 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:08 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:40:08 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:40:08 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:08 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:08 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:08 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:08 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:08 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:09 [INFO] agent: Synced check "sdnc-dgbuilder" 2021/04/13 08:40:09 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:09 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:09 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:09 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:40:09 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:09 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:09 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:40:09 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:10 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:10 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:40:10 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:10 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:40:10 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:10 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:11 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:40:11 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:11 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:11 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:11 [WARN] agent: Check "multicloud-pike" HTTP request failed: Head http://multicloud-pike:9007/api/multicloud-pike/v0/swagger.json: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:12 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:12 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:12 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:12 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:13 [WARN] agent: Check "msb-consul" socket connection failed: dial tcp 10.96.87.116:8500: i/o timeout 2021/04/13 08:40:13 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:40:13 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:13 [WARN] agent: Check "msb-discovery" socket connection failed: dial tcp 10.96.31.18:10081: i/o timeout 2021/04/13 08:40:13 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:13 [INFO] agent: Synced check "sdc-catalog-healthcheck" 2021/04/13 08:40:14 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:14 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:14 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:40:14 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:14 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:40:14 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:14 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:15 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:15 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:15 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:40:15 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:40:15 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:16 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:16 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:16 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:16 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:16 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:16 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:16 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:16 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:40:17 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:17 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:40:17 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:17 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:17 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:17 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:40:18 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:18 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:40:18 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:40:18 [WARN] agent: Check "aaf-sms-health" HTTP request failed: Get https://aaf-sms.onap:10443/v1/sms/healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:18 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:19 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:19 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:45448->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:40:19 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:40:19 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:40:19 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:19 [INFO] agent: Synced check "multicloud-vio" 2021/04/13 08:40:20 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:40:20 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:20 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:20 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:40:20 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:40:20 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:21 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:40:21 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:40:21 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:21 [INFO] agent: Synced check "vfc-gvnfmdriver" 2021/04/13 08:40:21 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:21 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:22 [WARN] agent: Check "mr-kafka" is now warning 2021/04/13 08:40:22 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:22 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:22 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:22 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:22 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:23 [INFO] agent: Synced check "sdc-be-healthcheck" 2021/04/13 08:40:23 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:40:23 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:23 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:23 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:23 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:23 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:23 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:24 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:24 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:24 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:40:24 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:24 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:24 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:40:24 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:40:24 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:24 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:24 [INFO] agent: Synced check "vfc-catalog" 2021/04/13 08:40:25 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:25 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:25 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:26 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:40:26 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:26 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:40:26 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:26 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:40:27 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:40:27 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:27 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:27 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:27 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:27 [WARN] agent: Check "multicloud-pike" HTTP request failed: Head http://multicloud-pike:9007/api/multicloud-pike/v0/swagger.json: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:28 [INFO] agent: Synced check "msb-consul" 2021/04/13 08:40:28 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:28 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:40:29 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:29 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:29 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:29 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:40:29 [INFO] agent: Synced check "multicloud-windriver" 2021/04/13 08:40:29 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:40:29 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:40:29 [INFO] agent: Synced check "pap" 2021/04/13 08:40:29 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:40:29 [WARN] agent: Check "msb-discovery" socket connection failed: dial tcp 10.96.31.18:10081: i/o timeout 2021/04/13 08:40:29 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:29 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:30 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:30 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:30 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:40:30 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:30 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:40:30 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:40:30 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:31 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:31 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:40:31 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:31 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:31 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:31 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:31 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:31 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:32 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:32 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:32 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:32 [INFO] agent: Synced check "aai-service" 2021/04/13 08:40:32 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:32 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:33 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:33 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:34 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:45594->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:40:34 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:40:34 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:35 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:40:35 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:35 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:35 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:40:35 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:35 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:36 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:40:36 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:36 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:36 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:40:37 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:40:37 [WARN] agent: Check "elasticsearch-write-health" is now warning 2021/04/13 08:40:37 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:40:37 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:37 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:37 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:40:37 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:37 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:38 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:40:38 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:38 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:38 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:38 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:38 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:38 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:39 [INFO] agent: Synced check "log-logstash-internal-server-plugin-info" 2021/04/13 08:40:39 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:39 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:39 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:39 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:40:39 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:39 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:39 [INFO] agent: Synced check "vfc-ztevnfmdriver" 2021/04/13 08:40:39 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:40:39 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:39 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:40:40 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:40 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:40:40 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:40:40 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:40:40 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:40 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:40 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:40:40 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:41 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:40:41 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:40:41 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:41 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:41 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:41 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:42 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:42 [INFO] agent: Synced check "vfc-nokiav2vnfmdriver" 2021/04/13 08:40:42 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:42 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:42 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:43 [WARN] agent: Check "aaf-sms-health" HTTP request failed: Get https://aaf-sms.onap:10443/v1/sms/healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:43 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:43 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:43 [WARN] agent: Check "multicloud-pike" HTTP request failed: Head http://multicloud-pike:9007/api/multicloud-pike/v0/swagger.json: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:44 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:44 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:44 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:40:44 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:40:44 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:44 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:45 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:45 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:45 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:45 [WARN] agent: Check "msb-discovery" socket connection failed: dial tcp 10.96.31.18:10081: i/o timeout 2021/04/13 08:40:46 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:46 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:46 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:40:46 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:46 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:46 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:46 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:46 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:46 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:40:47 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:47 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:40:47 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:47 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:47 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:48 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:48 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:48 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:40:48 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:40:49 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:49 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:45696->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:40:49 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:40:50 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:40:50 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:50 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:50 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:40:50 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:40:50 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:50 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:40:51 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:51 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:40:51 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:40:51 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:51 [INFO] agent: Synced check "so-jra-healthcheck" 2021/04/13 08:40:51 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:40:51 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:40:51 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:51 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:51 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:52 [WARN] agent: Check "mr-kafka" is now warning 2021/04/13 08:40:52 [INFO] agent: Synced check "vfc-workflowengineactiviti" 2021/04/13 08:40:52 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:40:52 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:52 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:52 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:53 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:53 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:40:53 [INFO] agent: Synced check "vfc-jujudriver" 2021/04/13 08:40:53 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:53 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:53 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:53 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:53 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:53 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:54 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:54 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:54 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:54 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:40:54 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:54 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:40:54 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:54 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:55 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:55 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:55 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:56 [INFO] agent: Synced check "sdc-titan-healthcheck" 2021/04/13 08:40:56 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:56 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:40:56 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:56 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:40:57 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:40:57 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:57 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:40:57 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:57 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:57 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:57 [INFO] agent: Synced check "policy-nexus-local-status" 2021/04/13 08:40:58 [INFO] agent: Synced check "msb-eag" 2021/04/13 08:40:58 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:59 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:59 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:59 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:59 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:40:59 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:40:59 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:40:59 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:40:59 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:59 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:40:59 [WARN] agent: Check "multicloud-pike" HTTP request failed: Head http://multicloud-pike:9007/api/multicloud-pike/v0/swagger.json: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:00 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:00 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:00 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:41:00 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:41:00 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:00 [INFO] agent: Synced check "msb-discovery" 2021/04/13 08:41:01 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:01 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:41:01 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:01 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:01 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:01 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:01 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:01 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:01 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:41:02 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:02 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:41:02 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:41:02 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:02 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:02 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:02 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:03 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:03 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:41:03 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:04 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:04 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:45808->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:41:04 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:41:05 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:41:05 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:05 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:06 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:06 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:41:06 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:06 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:06 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:41:06 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:07 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:41:07 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:07 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:07 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:07 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:08 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:08 [INFO] agent: Synced check "vfc-ztesdncdriver" 2021/04/13 08:41:08 [INFO] agent: Synced check "log-elasticsearch-server" 2021/04/13 08:41:08 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:41:08 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:41:08 [WARN] agent: Check "aaf-sms-health" HTTP request failed: Get https://aaf-sms.onap:10443/v1/sms/healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:08 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:08 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:08 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:08 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:08 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:09 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:09 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:09 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:09 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:09 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:41:09 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:09 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:41:09 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:10 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:10 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:41:10 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:41:10 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:10 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:10 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:41:10 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:41:10 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:11 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:41:11 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:11 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:11 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:12 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:12 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:12 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:12 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:12 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:12 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:12 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:41:13 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:41:13 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:41:13 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:13 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:14 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:14 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:14 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:41:14 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:41:14 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:41:14 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:14 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:14 [INFO] agent: Synced check "vfc-workflow" 2021/04/13 08:41:15 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:15 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:15 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:15 [WARN] agent: Check "multicloud-pike" HTTP request failed: Head http://multicloud-pike:9007/api/multicloud-pike/v0/swagger.json: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:16 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:16 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:16 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:16 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:16 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:16 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:16 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:41:17 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:17 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:41:17 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:17 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:17 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:18 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:18 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:18 [INFO] agent: Synced check "log-logstash-internal-server-gi" 2021/04/13 08:41:19 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:19 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:45934->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:41:19 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:41:19 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:41:20 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:41:20 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:20 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:20 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:20 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:41:20 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:41:21 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:21 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:41:21 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:41:21 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:21 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:41:21 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:21 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:41:21 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:22 [WARN] agent: Check "mr-kafka" is now warning 2021/04/13 08:41:22 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:22 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:22 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:22 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:23 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:23 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:41:23 [INFO] agent: Synced check "multicloud-pike" 2021/04/13 08:41:23 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:23 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:23 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:23 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:23 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:23 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:23 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:23 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:41:24 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:24 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:24 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:24 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:41:24 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:24 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:41:24 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:41:24 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:41:24 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:25 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:25 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:41:25 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:25 [INFO] agent: Synced check "vfc-nslcm" 2021/04/13 08:41:25 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:26 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:26 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:26 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:26 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:41:27 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:41:27 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:27 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:27 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:27 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:28 [INFO] agent: Synced check "so-api-healthcheck" 2021/04/13 08:41:28 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:28 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:29 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:29 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:29 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:29 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:41:29 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:41:29 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:29 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:30 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:30 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:30 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:41:30 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:41:30 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:41:30 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:31 [INFO] agent: Synced check "multicloud-pike" 2021/04/13 08:41:31 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:31 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:41:31 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:31 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:31 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:31 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:31 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:31 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:32 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:32 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:41:32 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:32 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:32 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:41:32 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:33 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:33 [WARN] agent: Check "aaf-sms-health" HTTP request failed: Get https://aaf-sms.onap:10443/v1/sms/healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:34 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:34 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:46218->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:41:34 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:41:34 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:34 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:41:35 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:41:35 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:35 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:35 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:41:35 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:41:36 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:36 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:36 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:41:36 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:36 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:41:36 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:36 [INFO] agent: Synced check "log-logstash-internal-server-jvm-stat" 2021/04/13 08:41:37 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:41:37 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:41:37 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:37 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:37 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:38 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:38 [INFO] agent: Synced check "log-kibana-server" 2021/04/13 08:41:38 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:41:38 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:38 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:38 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:38 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:38 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:39 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:39 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:39 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:39 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:39 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:39 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:39 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:41:39 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:39 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:41:39 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:40 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:40 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:40 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:41:40 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:41:40 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:41 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:41:41 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:41:41 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:41 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:42 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:42 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:42 [INFO] agent: Synced check "drools" 2021/04/13 08:41:42 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:42 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:42 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:42 [WARN] agent: Check "elasticsearch-write-health" is now warning 2021/04/13 08:41:43 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:43 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:41:43 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:41:43 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:43 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:44 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:44 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:44 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:44 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:41:44 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:41:44 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:44 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:44 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:45 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:45 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:45 [INFO] agent: Synced check "vfc-resmgr" 2021/04/13 08:41:45 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:46 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:41:46 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:46 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:46 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:41:46 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:41:46 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:46 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:46 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:46 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:47 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:41:47 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:41:47 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:47 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:41:47 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:47 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:47 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:48 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:49 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:49 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:46494->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:41:49 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:41:50 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:41:50 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:50 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:50 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:50 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:41:50 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:41:51 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:51 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:41:51 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:41:51 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:51 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:52 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:52 [WARN] agent: Check "mr-kafka" is now warning 2021/04/13 08:41:52 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:52 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:41:52 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:52 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:53 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:53 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:53 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:41:53 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:53 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:53 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:53 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:54 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:54 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:54 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:54 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:54 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:54 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:54 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:41:54 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:41:54 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:41:54 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:54 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:41:54 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:55 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:55 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:55 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:55 [INFO] agent: Synced check "vid-server" 2021/04/13 08:41:55 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:56 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:56 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:57 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:41:57 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:41:57 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:57 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:41:57 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:41:57 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:41:57 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:57 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:58 [INFO] agent: Synced check "sdnctldb02" 2021/04/13 08:41:58 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:58 [WARN] agent: Check "aaf-sms-health" HTTP request failed: Get https://aaf-sms.onap:10443/v1/sms/healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:58 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:41:58 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:41:58 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:59 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:59 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:59 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:59 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:41:59 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:41:59 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:41:59 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:00 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:00 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:00 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:00 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:42:00 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:42:00 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:01 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:01 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:42:01 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:01 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:01 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:01 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:01 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:02 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:02 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:02 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:02 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:02 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:03 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:03 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:42:04 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:04 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:46768->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:42:04 [INFO] agent: Synced check "appc-dgbuilder" 2021/04/13 08:42:04 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:42:05 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:42:05 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:05 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:05 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:42:05 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:42:06 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:06 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:42:06 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:06 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:06 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:07 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:42:07 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:42:07 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:07 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:08 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:08 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:08 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:42:08 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:08 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:42:08 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:42:08 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:42:08 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:08 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:08 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:08 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:09 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:09 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:09 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:09 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:09 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:09 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:09 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:42:09 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:42:09 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:42:09 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:10 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:10 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:10 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:42:10 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:42:10 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:10 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:11 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:42:11 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:11 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:11 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:12 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:12 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:12 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:12 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:13 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:13 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:14 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:14 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:14 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:14 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:42:14 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:42:14 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:42:14 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:14 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:14 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:14 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:15 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:15 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:15 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:16 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:16 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:16 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:42:16 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:16 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:16 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:16 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:42:16 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:16 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:17 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:42:17 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:42:17 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:17 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:17 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:17 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:18 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:18 [INFO] agent: Synced check "policy-nexus-internal-metrics" 2021/04/13 08:42:19 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:42:19 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:19 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:47030->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:42:19 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:42:19 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:42:19 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:42:20 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:42:20 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:20 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:20 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:42:20 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:42:20 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:42:21 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:42:21 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:21 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:42:21 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:21 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:22 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:22 [WARN] agent: Check "mr-kafka" is now warning 2021/04/13 08:42:22 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:22 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:22 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:23 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:23 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:23 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:42:23 [WARN] agent: Check "aaf-sms-health" HTTP request failed: Get https://aaf-sms.onap:10443/v1/sms/healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:23 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:23 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:23 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:23 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:24 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:24 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:24 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:24 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:24 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:24 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:24 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:24 [INFO] agent: Synced check "log-logstash-internal-server-jvm-info" 2021/04/13 08:42:24 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:42:24 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:42:24 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:25 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:25 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:42:25 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:25 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:26 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:26 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:26 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:27 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:42:27 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:27 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:42:27 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:42:27 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:27 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:27 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:42:27 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:28 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:28 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:29 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:29 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:29 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:29 [INFO] agent: Synced check "vfc-emsdriver" 2021/04/13 08:42:29 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:42:29 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:42:29 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:30 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:30 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:42:30 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:30 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:30 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:42:30 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:42:30 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:30 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:42:30 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:42:30 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:31 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:31 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:42:31 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:31 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:42:31 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:31 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:31 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:31 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:32 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:32 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:32 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:32 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:32 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:32 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:33 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:34 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:34 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:47216->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:42:34 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:42:35 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:42:35 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:35 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:36 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:36 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:36 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:42:36 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:42:36 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:37 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:42:37 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:42:37 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:37 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:38 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:38 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:38 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:42:38 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:38 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:42:38 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:38 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:38 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:38 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:38 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:42:39 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:39 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:39 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:39 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:39 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:39 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:39 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:42:39 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:42:39 [INFO] agent: Synced check "log-logstash-internal-server-os-info" 2021/04/13 08:42:39 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:40 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:40 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:40 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:40 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:42:40 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:40 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:42:41 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:42:41 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:42:41 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:42:41 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:42:41 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:41 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:42 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:42 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:42 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:42:42 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:42 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:42 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:43 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:43 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:43 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:44 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:44 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:44 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:44 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:42:44 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:42:44 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:45 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:45 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:45 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:45 [INFO] agent: Synced check "sdnc-odl-cluster-healthcheck" 2021/04/13 08:42:45 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:45 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:46 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:46 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:46 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:46 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:46 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:46 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:46 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:47 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:42:47 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:42:47 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:47 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:42:47 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:47 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:47 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:48 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:48 [WARN] agent: Check "elasticsearch-write-health" is now warning 2021/04/13 08:42:48 [WARN] agent: Check "aaf-sms-health" HTTP request failed: Get https://aaf-sms.onap:10443/v1/sms/healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:48 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:49 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:49 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:47384->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:42:49 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:42:49 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:42:49 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:42:50 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:42:50 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:50 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:50 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:42:50 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:42:51 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:42:51 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:51 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:51 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:42:51 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:52 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:52 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:42:52 [WARN] agent: Check "mr-kafka" is now warning 2021/04/13 08:42:52 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:42:52 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:42:52 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:52 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:53 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:53 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:53 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:42:53 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:42:53 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:53 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:53 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:53 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:54 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:54 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:54 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:54 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:54 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:54 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:54 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:54 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:42:54 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:42:54 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:55 [INFO] agent: Synced check "log-logstash-internal-server-node-stat" 2021/04/13 08:42:55 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:55 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:55 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:56 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:56 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:56 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:57 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:42:57 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:57 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:42:57 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:57 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:57 [INFO] agent: Synced check "appc-sdnctldb01" 2021/04/13 08:42:58 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:58 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:42:58 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:58 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:59 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:59 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:59 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:42:59 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:42:59 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:42:59 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:42:59 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:00 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:00 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:00 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:00 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:43:00 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:43:00 [INFO] agent: Synced check "aaf-sms-health" 2021/04/13 08:43:00 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:43:00 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:43:00 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:01 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:01 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:43:01 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:01 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:01 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:01 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:01 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:02 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:02 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:02 [INFO] agent: Synced check "sdnctldb01" 2021/04/13 08:43:02 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:02 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:02 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:02 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:03 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:43:03 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:03 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:43:03 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:43:04 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:04 [INFO] agent: Synced check "brmsgw-tcp" 2021/04/13 08:43:04 [INFO] agent: Synced check "msb-iag" 2021/04/13 08:43:04 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:47568->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:43:04 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:43:04 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:43:04 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:05 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:43:05 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:05 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:06 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:06 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:06 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:43:06 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:07 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:43:07 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:43:07 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:07 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:08 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:08 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:08 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:43:08 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:08 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:08 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:08 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:09 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:09 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:09 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:09 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:09 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:09 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:43:09 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:09 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:43:09 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:43:09 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:10 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:10 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:10 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:10 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:43:10 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:10 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:43:11 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:43:11 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:43:11 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:11 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:43:11 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:12 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:12 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:12 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:12 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:12 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:13 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:13 [WARN] agent: Check "aaf-sms-health" HTTP request failed: Get https://aaf-sms.onap:10443/v1/sms/healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:13 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:14 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:43:14 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:14 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:14 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:14 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:43:14 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:43:14 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:43:14 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:43:14 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:15 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:15 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:15 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:15 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:15 [INFO] agent: Synced check "sdc-cs-healthcheck" 2021/04/13 08:43:15 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:43:15 [INFO] agent: Synced check "clamp-health" 2021/04/13 08:43:15 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:15 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:16 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:16 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:16 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:16 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:16 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:16 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:16 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:17 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:43:17 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:43:17 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:17 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:17 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:17 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:18 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:18 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:19 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:47748->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:43:19 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:19 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:43:20 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:43:20 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:20 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:20 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:43:20 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:20 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:43:20 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:43:21 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:43:21 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:21 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:21 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:43:21 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:22 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:22 [WARN] agent: Check "mr-kafka" is now warning 2021/04/13 08:43:22 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:43:22 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:22 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:43:22 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:23 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:23 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:23 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:43:23 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:23 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:23 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:23 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:24 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:24 [INFO] agent: Synced check "appc-sdnhost" 2021/04/13 08:43:24 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:24 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:24 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:24 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:24 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:24 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:43:24 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:24 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:43:25 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:43:25 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:25 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:43:25 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:43:25 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:25 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:26 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:26 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:43:26 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:26 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:27 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:43:27 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:43:27 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:27 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:27 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:28 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:28 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:28 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:28 [INFO] agent: Synced check "log-logstash-tcp" 2021/04/13 08:43:29 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:29 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:29 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:29 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:43:29 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:43:30 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:30 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:30 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:30 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:30 [INFO] agent: Synced check "dmaap" 2021/04/13 08:43:30 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:43:30 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:43:30 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:31 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:31 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:31 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:43:31 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:31 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:43:31 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:31 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:31 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:31 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:31 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:32 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:32 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:32 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:32 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:32 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:33 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:33 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:43:33 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/04/13 08:43:33 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:43:34 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:34 [INFO] agent: Synced check "elasticsearch" 2021/04/13 08:43:34 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:47986->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:43:34 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:43:35 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:43:35 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:35 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:36 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:43:36 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:36 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:36 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:43:36 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:43:36 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:43:36 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:36 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:37 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:43:37 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:43:37 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:43:37 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:37 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:38 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:38 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:38 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:43:38 [WARN] agent: Check "aaf-sms-health" HTTP request failed: Get https://aaf-sms.onap:10443/v1/sms/healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:38 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:38 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:38 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:38 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:39 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:39 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:39 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:39 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:39 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:39 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:39 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:43:39 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:39 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:43:40 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:40 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:40 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:43:40 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:40 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:43:41 [INFO] agent: Synced check "log-logstash-internal-server-node-info" 2021/04/13 08:43:41 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:43:41 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:41 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:42 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:42 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:42 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:43:42 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:42 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:42 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:43 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:43 [INFO] agent: Synced check "log-logstash-internal-server-process-stat" 2021/04/13 08:43:43 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:44 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:44 [INFO] agent: Synced check "sdc-fe-healthcheck" 2021/04/13 08:43:44 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:44 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:44 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:44 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:43:44 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:43:44 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:43:44 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:43:45 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:45 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:45 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:45 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:45 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:46 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:46 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:46 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:46 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:46 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:46 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:47 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:47 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:43:47 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:43:47 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:43:47 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:47 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:43:47 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:47 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:43:47 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:47 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:47 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:47 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:48 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:48 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:43:48 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/04/13 08:43:49 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:48144->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:43:49 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:49 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:43:50 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:43:50 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:50 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:50 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:43:50 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:43:51 [INFO] agent: Synced check "multicloud-starlingx" 2021/04/13 08:43:51 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:43:51 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:51 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:51 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:43:51 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:52 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:52 [WARN] agent: Check "mr-kafka" is now warning 2021/04/13 08:43:52 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:52 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:52 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:53 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:53 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:53 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:43:53 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:43:53 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:53 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:53 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:53 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:54 [WARN] agent: Check "elasticsearch-write-health" is now warning 2021/04/13 08:43:54 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:54 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:54 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:54 [INFO] agent: Synced check "aai-traversal" 2021/04/13 08:43:54 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:54 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:54 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:54 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:43:54 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:54 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:43:55 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:55 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:43:55 [INFO] agent: Synced check "aai-resources" 2021/04/13 08:43:55 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:55 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:43:55 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:56 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:56 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:57 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:43:57 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:43:57 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:57 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:57 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:58 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:43:58 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:58 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:43:58 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:43:58 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:43:58 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:58 [INFO] agent: Synced check "pdp" 2021/04/13 08:43:59 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:59 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:59 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:43:59 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:43:59 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:43:59 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:44:00 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:00 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:00 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:00 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:00 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:00 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:44:00 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:44:01 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:01 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:01 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:44:01 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:01 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:01 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:01 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:01 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:02 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:02 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:02 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:02 [INFO] agent: Synced check "vfc-vnflcm" 2021/04/13 08:44:02 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:02 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:03 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:03 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:03 [WARN] agent: Check "aaf-sms-health" HTTP request failed: Get https://aaf-sms.onap:10443/v1/sms/healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:03 [INFO] agent: Synced check "sdnc-sdnhost" 2021/04/13 08:44:03 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/04/13 08:44:03 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:04 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:04 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:48432->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:44:04 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:44:04 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:44:04 [INFO] agent: Synced check "vfc-vnfmgr" 2021/04/13 08:44:05 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:44:05 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:05 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:06 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:06 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:06 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:44:06 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:44:06 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:06 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:44:07 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:44:07 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:44:07 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:07 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:08 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:08 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:08 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:44:08 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:08 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:08 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:08 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:08 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:09 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:44:09 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:09 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:09 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:09 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:09 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:09 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:09 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:44:09 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:44:09 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:44:09 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:09 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:44:10 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:10 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:44:10 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:10 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:44:10 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:10 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:44:11 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:44:11 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:11 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:12 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:12 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:12 [INFO] agent: Synced check "odl-api-healthcheck" 2021/04/13 08:44:12 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:12 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:13 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:13 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:14 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:14 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:14 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:14 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:14 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:44:14 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:44:15 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:15 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:15 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:15 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:15 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:44:16 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:16 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:16 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:16 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:16 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:16 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:16 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:16 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:17 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:44:17 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:44:17 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:17 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:44:17 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:17 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:44:17 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:17 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:18 [INFO] agent: Synced check "appc-sdnctldb02" 2021/04/13 08:44:18 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:18 [INFO] agent: Synced check "policy-nexus-internal-healthcheck" 2021/04/13 08:44:18 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/04/13 08:44:18 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:19 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:19 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:48614->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:44:19 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:19 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:19 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:44:20 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:44:20 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:44:20 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:20 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:20 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:44:20 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:44:20 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:44:20 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:44:21 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:44:21 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:21 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:21 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:44:21 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:44:21 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:22 [WARN] agent: Check "mr-kafka" is now warning 2021/04/13 08:44:22 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:22 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:22 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:23 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:23 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:23 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:44:23 [WARN] agent: Check "aaf-sms-health" is now critical 2021/04/13 08:44:23 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:23 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:23 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:23 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:24 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:24 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:24 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:24 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:24 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:24 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:24 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:44:24 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:24 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:24 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:44:25 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:25 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:25 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:26 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:44:26 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:26 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:27 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:44:27 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:44:27 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:27 [INFO] agent: Synced check "log-elasticsearch-tcp" 2021/04/13 08:44:27 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:27 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:28 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:28 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:44:28 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:44:28 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:29 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:29 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:29 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:29 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:44:29 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:44:30 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:30 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:30 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:30 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:30 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:30 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:44:30 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:44:31 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:31 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:44:31 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:31 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:44:31 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:31 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:44:31 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:44:31 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:31 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:31 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: dial tcp: lookup sdc-be on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:31 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:32 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:32 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:32 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:32 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:44:32 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:32 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:32 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:33 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:33 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/04/13 08:44:34 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:34 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:48824->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:44:34 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:44:35 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:35 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:44:35 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:35 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:35 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:36 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:36 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:36 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:44:36 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:37 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:44:37 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:44:37 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:44:37 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:37 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:38 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:38 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:38 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:44:38 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:38 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:38 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:38 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:39 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:39 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:39 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:39 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:39 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:39 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:39 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:44:39 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:44:39 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:44:39 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:39 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:44:40 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:40 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:40 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:40 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:44:40 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:41 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:44:41 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:44:41 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:41 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:42 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:44:42 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:42 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:42 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:44:42 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:44:42 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:43 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:43 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:43 [WARN] agent: Check "aaf-sms-health" HTTP request failed: Get https://aaf-sms.onap:10443/v1/sms/healthcheck: dial tcp 10.96.87.196:10443: getsockopt: connection refused 2021/04/13 08:44:43 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:44:43 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:44 [INFO] agent: Synced check "log-logstash-internal-server-os-stat" 2021/04/13 08:44:44 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:44 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:44 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:44 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:44:44 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:44:45 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:45 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:45 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:45 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:46 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:46 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:46 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:46 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:46 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:46 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:47 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:47 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:44:47 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:44:47 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:47 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:47 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:47 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:47 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:48 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:48 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:48 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:44:48 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/04/13 08:44:49 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:48994->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:44:49 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:49 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:44:49 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:50 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:44:50 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:50 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:50 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:44:50 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:44:50 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:44:51 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:44:51 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:51 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:44:51 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:51 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:51 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:44:51 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:51 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:52 [WARN] agent: Check "mr-kafka" is now warning 2021/04/13 08:44:52 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:52 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:53 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:53 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:53 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:44:53 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:53 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:44:53 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:44:53 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:44:53 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:53 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:53 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:53 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:54 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:54 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:54 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:54 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:54 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:54 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:54 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:44:54 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:44:54 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:55 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:44:55 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:55 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:55 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:56 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:44:56 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:56 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:57 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:44:57 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:44:57 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:57 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:58 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:58 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:58 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:59 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:59 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:59 [WARN] agent: Check "elasticsearch-write-health" is now warning 2021/04/13 08:44:59 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:44:59 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:44:59 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:44:59 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:45:00 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:00 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:00 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:00 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:00 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:45:01 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:45:01 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:01 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:01 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:45:01 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:01 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:45:01 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:01 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:45:01 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:02 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:02 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:02 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:02 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:02 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:02 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:03 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:03 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:03 [WARN] agent: Check "aaf-sms-health" HTTP request failed: Get https://aaf-sms.onap:10443/v1/sms/healthcheck: dial tcp 10.96.87.196:10443: getsockopt: connection refused 2021/04/13 08:45:03 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/04/13 08:45:03 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:04 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:45:04 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:04 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:04 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:49182->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:45:04 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:45:04 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:45:04 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:45:05 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:45:05 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:05 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:05 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:45:06 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:06 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:06 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:45:06 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:07 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:07 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:45:07 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:45:07 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:07 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:07 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:08 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:08 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:08 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:45:08 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:08 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:08 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:08 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:09 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:09 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:09 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:09 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:09 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:09 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:09 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:45:09 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:10 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:45:10 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:10 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:45:10 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:10 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:45:10 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:11 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:45:11 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:45:11 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:11 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:12 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:12 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:12 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:45:12 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:12 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:45:13 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:13 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:13 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:13 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:14 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:14 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:14 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:14 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:45:14 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:45:15 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:15 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:15 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:45:15 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:15 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:15 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:45:15 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:45:16 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:16 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:16 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:16 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:45:16 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:16 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:17 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:17 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:45:17 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:45:17 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:17 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:17 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:17 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:18 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:18 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:18 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/04/13 08:45:19 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:49410->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:45:19 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:19 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:45:19 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:20 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:45:20 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:20 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:20 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:20 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:20 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:45:21 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:45:21 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:45:21 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:21 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:21 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:45:21 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:45:21 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:22 [WARN] agent: Check "mr-kafka" is now warning 2021/04/13 08:45:22 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:22 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:23 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:23 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:23 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:23 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:23 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:45:23 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:45:23 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:23 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:23 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:23 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:23 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:45:23 [INFO] agent: Synced check "aaf-sms-health" 2021/04/13 08:45:23 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:24 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:24 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:24 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:24 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:24 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:24 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:24 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:45:24 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:25 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:45:25 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:25 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:26 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:26 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:45:26 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:45:26 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:45:26 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:27 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:27 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:45:27 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:27 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:45:27 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:45:27 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:28 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:28 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:28 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:28 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:29 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:29 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:29 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:29 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:45:29 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:45:30 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:30 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:30 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:30 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:30 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:45:31 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:45:31 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:31 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:31 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:45:31 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:31 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:31 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:32 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:32 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:32 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:32 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:45:32 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:32 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:33 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:33 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:33 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/04/13 08:45:34 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:34 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:49702->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:45:34 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:34 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:45:34 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:45:34 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:45:35 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:45:35 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:35 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:35 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:36 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:36 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:36 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:36 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:45:36 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:37 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:45:37 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:45:37 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:45:37 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:45:37 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:45:37 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:37 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:38 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:38 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:38 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:45:38 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:45:38 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:38 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:38 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:38 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:39 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:39 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:39 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:39 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:39 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:39 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:39 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:39 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:39 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:39 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:45:40 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:45:40 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:40 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:40 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:45:41 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:41 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:45:41 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:45:41 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:42 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:42 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:42 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:43 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:43 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:43 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:43 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:45:43 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:44 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:44 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:44 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:44 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:44 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:45:44 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:45:45 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:45 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:45 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:45 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:45 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:45:45 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:45:46 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:46 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:46 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:46 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:46 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:47 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:47 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:45:47 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:45:47 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:47 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:47 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:48 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:48 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:45:48 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:48 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:45:48 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:45:48 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/04/13 08:45:49 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:49918->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:45:49 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:45:49 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:49 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:45:50 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:45:50 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:50 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:50 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:51 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:45:51 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:45:51 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:45:51 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:51 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:51 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:51 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:45:51 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:52 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:52 [WARN] agent: Check "mr-kafka" is now warning 2021/04/13 08:45:52 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:52 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:52 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:53 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:53 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:53 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:53 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:45:53 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:53 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:53 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:53 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:54 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:54 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:54 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:54 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:54 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:54 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:54 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:45:54 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:45:54 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:55 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:55 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:45:55 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:55 [WARN] agent: Check "aai-service" HTTP request failed: Get https://aai.onap:8443/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:45:55 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:56 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:56 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:45:56 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:56 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:45:57 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: dial tcp: lookup vid on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:57 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:45:57 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:57 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:45:58 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:58 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:58 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:59 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:59 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:45:59 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:59 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: dial tcp: lookup sdnc-dgbuilder on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:59 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:45:59 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:45:59 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:45:59 [WARN] agent: Check "sparky-be-process" is now warning 2021/04/13 08:45:59 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:46:00 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:00 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:00 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:00 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp: lookup vfc-zte-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:00 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/04/13 08:46:00 [WARN] agent: Check "aai-resources" HTTP request failed: Get https://aai-resources.onap:8447/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:46:01 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/04/13 08:46:01 [WARN] agent: Check "clamp-mariadb" is now warning 2021/04/13 08:46:01 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:01 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:01 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:01 [WARN] agent: Check "mr-zookeeper" is now warning 2021/04/13 08:46:01 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:01 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:02 [WARN] agent: Check "vfc-hwvnfmdriver" socket connection failed: dial tcp: lookup vfc-huawei-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:02 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:02 [WARN] agent: Check "vfc-vnfres" socket connection failed: dial tcp: lookup vfc-vnfres on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:02 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:02 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:03 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:03 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:03 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/04/13 08:46:04 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:04 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.20.135:50154->10.96.102.54:9009: read: connection reset by peer 2021/04/13 08:46:04 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/04/13 08:46:05 [WARN] agent: Check "elasticsearch-write-health" is now warning 2021/04/13 08:46:05 [WARN] agent: Check "data-router-process" is now warning 2021/04/13 08:46:05 [WARN] agent: Check "vfc-vnfmgr" socket connection failed: dial tcp: lookup vfc-vnfmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:05 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:05 [WARN] Check "so-jra-healthcheck": Timed out (1s) running check 2021/04/13 08:46:06 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:46:06 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:06 [WARN] agent: Check "vfc-vnflcm" socket connection failed: dial tcp: lookup vfc-vnflcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:06 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:06 [WARN] agent: Check "search-data-service-api" is now warning 2021/04/13 08:46:07 [WARN] agent: Check "vid-mariadb" is now warning 2021/04/13 08:46:07 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/04/13 08:46:07 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/04/13 08:46:07 [WARN] agent: Check "vfc-nslcm" socket connection failed: dial tcp: lookup vfc-nslcm on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:07 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/04/13 08:46:08 [WARN] agent: Check "sdc-catalog-healthcheck" HTTP request failed: Get https://sdc-be:8443/asdc/v1/catalog/services: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:46:08 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:08 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:08 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:08 [WARN] agent: Check "aai-traversal" HTTP request failed: Get https://aai-traversal.onap:8446/aai/util/echo: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/04/13 08:46:08 [WARN] agent: Check "model-loader-process" is now warning 2021/04/13 08:46:08 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:08 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:08 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:08 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:09 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: dial tcp: lookup sdnc on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:09 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:09 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:09 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:09 [WARN] agent: Check "vfc-gvnfmdriver" socket connection failed: dial tcp: lookup vfc-generic-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:09 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:09 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:09 [WARN] agent: Check "so-mariadb" is now warning 2021/04/13 08:46:10 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/04/13 08:46:10 [WARN] agent: Check "sdnc-odl-cluster-healthcheck" is now critical 2021/04/13 08:46:10 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/04/13 08:46:10 [WARN] Check "so-api-healthcheck": Timed out (1s) running check 2021/04/13 08:46:10 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/04/13 08:46:10 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 202