By type
+ CONSUL_BIND= + [ -n ] + CONSUL_CLIENT= + [ -n ] + CONSUL_DATA_DIR=/consul/data + CONSUL_CONFIG_DIR=/consul/config + [ -n ] + [ a = - ] + [ agent = agent ] + shift + set -- consul agent -data-dir=/consul/data -config-dir=/consul/config -client 0.0.0.0 -enable-script-checks -retry-join consul-server + [ consul = consul ] + stat -c %u /consul/data + id -u consul + [ 100 != 100 ] + stat -c %u /consul/config + id -u consul + [ 100 != 100 ] + [ ! -z ] + exec consul agent -data-dir=/consul/data -config-dir=/consul/config -client 0.0.0.0 -enable-script-checks -retry-join consul-server ==> Starting Consul agent... ==> Consul agent running! Version: 'v1.0.6' Node ID: '604401d2-d357-b98c-de07-07313f419c7a' Node name: 'dev-consul-7467bf7b46-rgrsk' Datacenter: 'dc1' (Segment: '') Server: false (Bootstrap: false) Client Addr: [0.0.0.0] (HTTP: 8500, HTTPS: -1, DNS: 8600) Cluster Addr: 10.242.2.83 (LAN: 8301, WAN: 8302) Encrypt: Gossip: false, TLS-Outgoing: false, TLS-Incoming: false ==> Log data will now stream in as it occurs: 2021/06/17 11:47:35 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-rgrsk 10.242.2.83 2021/06/17 11:47:35 [WARN] Service name "Health Check: Application Authorization Framework" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] Service name "Health Check: Secret Management Service (sms)" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] Service name "A&AI Synapse Data Routing Service" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] agent: check "data-router-process" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/06/17 11:47:35 [WARN] Service name "A&AI Model Loader" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] agent: check "model-loader-process" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/06/17 11:47:35 [WARN] Service name "A&AI Search Data Service" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] agent: check "elasticsearch-write-health" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/06/17 11:47:35 [WARN] agent: check "search-data-service-availability" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/06/17 11:47:35 [WARN] agent: check "search-data-service-api" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/06/17 11:47:35 [WARN] Service name "Active and Available Inventory" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] Service name "A&AI UI Backend Service" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] agent: check "sparky-be-process" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/06/17 11:47:35 [WARN] Service name "Health Check: APPC - Dgbuilder" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] Service name "Health Check: APPC" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] agent: check "appc-dbhost-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/06/17 11:47:35 [WARN] Service name "Health Check: APPC-SDN-CTL-DB-01" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] Service name "Health Check: APPC-SDN-CTL-DB-02" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] Service name "Health Check: APPC - SDN Host" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] Service name "Health Check: CLAMP" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] Service name "Health Check: CLAMP - MariaDb" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] agent: check "clamp-mariadb" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/06/17 11:47:35 [WARN] Service name "Health Check: ONAP CLI" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] Service name "Health Check: Log - Elastic Search" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] Service name "Health Check: Log - Kibana" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] Service name "Health Check: Log - Log Stash" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] Service name "Health Check: DMaaP" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] agent: check "mr-zookeeper" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/06/17 11:47:35 [WARN] agent: check "mr-kafka" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/06/17 11:47:35 [WARN] Service name "Health Check: MSB" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] Service name "Health Check: MULTICLOUD" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] Service name "Health Check: Policy" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] agent: check "Policy-mariadb-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/06/17 11:47:35 [WARN] Service name "Health Check: SDC" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] agent: check "sdc-fe-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/06/17 11:47:35 [WARN] agent: check "sdc-be-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/06/17 11:47:35 [WARN] agent: check "sdc-titan-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/06/17 11:47:35 [WARN] agent: check "sdc-cs-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/06/17 11:47:35 [WARN] Service name "Health Check: SDNC ODL Cluster" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] agent: check "sdnc-odl-cluster-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/06/17 11:47:35 [WARN] Service name "Health Check: SDNC - DB Host" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] agent: check "sdnc-dbhost-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/06/17 11:47:35 [WARN] Service name "Health Check: SDNC - DGBuilder" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] Service name "Health Check: SDNC" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] Service name "Health Check: SDNC-SDN-CTL-DB-01" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] Service name "Health Check: SDNC-SDN-CTL-DB-02" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] Service name "Health Check: SDNC - SDN Host" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] Service name "Health Check: SO" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] agent: check "so-api-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/06/17 11:47:35 [WARN] agent: check "so-camunda-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/06/17 11:47:35 [WARN] agent: check "so-jra-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/06/17 11:47:35 [WARN] Service name "Health Check: SO - MariaDb" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] agent: check "so-mariadb" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/06/17 11:47:35 [WARN] Service name "Health Check: VFC" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] Service name "Health Check: VID" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes. 2021/06/17 11:47:35 [WARN] agent: check "vid-mariadb" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html 2021/06/17 11:47:35 [INFO] agent: Started DNS server 0.0.0.0:8600 (tcp) 2021/06/17 11:47:35 [INFO] agent: Started DNS server 0.0.0.0:8600 (udp) 2021/06/17 11:47:35 [INFO] agent: Started HTTP server on [::]:8500 (tcp) 2021/06/17 11:47:35 [INFO] agent: started state syncer 2021/06/17 11:47:35 [INFO] agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce os scaleway softlayer 2021/06/17 11:47:35 [INFO] agent: Joining LAN cluster... 2021/06/17 11:47:35 [INFO] agent: (LAN) joining: [consul-server] 2021/06/17 11:47:35 [WARN] manager: No servers available 2021/06/17 11:47:35 [ERR] agent: failed to sync remote state: No known Consul servers 2021/06/17 11:47:35 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.105.8 2021/06/17 11:47:35 [INFO] consul: adding server dev-consul-server-1 (Addr: tcp/10.242.105.8:8300) (DC: dc1) 2021/06/17 11:47:35 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.224.74 2021/06/17 11:47:35 [INFO] consul: adding server dev-consul-server-2 (Addr: tcp/10.242.224.74:8300) (DC: dc1) 2021/06/17 11:47:35 [INFO] agent: (LAN) joined: 2 Err:
2021/06/17 11:47:35 [INFO] agent: Join LAN completed. Synced with 2 initial agents 2021/06/17 11:47:35 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:35 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:47:35 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:35 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:36 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:36 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:47:36 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:47:36 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:36 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:36 [WARN] agent: Check "mr-kafka" is now warning 2021/06/17 11:47:37 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:47:37 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:47:37 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: MSB" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: SDNC - DB Host" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: SO" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: Secret Management Service (sms)" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: APPC" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: CLAMP" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: CLAMP - MariaDb" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: ONAP CLI" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: VFC" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: VID" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: Application Authorization Framework" 2021/06/17 11:47:37 [INFO] agent: Synced service "A&AI Model Loader" 2021/06/17 11:47:37 [INFO] agent: Synced service "A&AI UI Backend Service" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: SDNC - SDN Host" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: APPC - SDN Host" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: SDC" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: SDNC-SDN-CTL-DB-01" 2021/06/17 11:47:37 [INFO] agent: Synced service "Active and Available Inventory" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: Log - Log Stash" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: DMaaP" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: SDNC ODL Cluster" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: SDNC-SDN-CTL-DB-02" 2021/06/17 11:47:37 [INFO] agent: Synced service "A&AI Search Data Service" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: APPC-SDN-CTL-DB-02" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: MULTICLOUD" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: Policy" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: SDNC" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: APPC - Dgbuilder" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: Log - Elastic Search" 2021/06/17 11:47:37 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: Log - Kibana" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: SDNC - DGBuilder" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: SO - MariaDb" 2021/06/17 11:47:37 [INFO] agent: Synced service "A&AI Synapse Data Routing Service" 2021/06/17 11:47:37 [INFO] agent: Synced service "Health Check: APPC-SDN-CTL-DB-01" 2021/06/17 11:47:37 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:38 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:38 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:38 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:38 [INFO] agent: Synced check "aai-resources" 2021/06/17 11:47:38 [INFO] agent: Synced check "vfc-hwvnfmdriver" ==> Failed to check for updates: Get https://checkpoint-api.hashicorp.com/v1/check/consul?arch=amd64&os=linux&signature=aa97ea1d-6ea5-9f99-c3b2-1b466344f144&version=1.0.6: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:47:39 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:39 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:47:39 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:47:39 [INFO] agent: Synced check "Policy-mariadb-healthcheck" 2021/06/17 11:47:39 [INFO] agent: Synced check "msb-discovery" 2021/06/17 11:47:39 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:47:39 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:39 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:47:40 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:40 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:47:40 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:47:40 [INFO] agent: Synced check "vid-mariadb" 2021/06/17 11:47:40 [INFO] agent: Synced check "sdnc-dbhost-healthcheck" 2021/06/17 11:47:40 [INFO] agent: Synced check "multicloud-pike" 2021/06/17 11:47:41 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:47:41 [INFO] agent: Synced check "search-data-service-api" 2021/06/17 11:47:41 [INFO] agent: Synced check "dmaap" 2021/06/17 11:47:41 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:41 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:42 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:42 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:42 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:47:42 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:42 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:42 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:47:42 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:47:42 [INFO] agent: Synced check "msb-consul" 2021/06/17 11:47:43 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:47:43 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:43 [INFO] agent: Synced check "vfc-vnfmgr" 2021/06/17 11:47:43 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:47:43 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:47:43 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:43 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:43 [INFO] agent: Synced check "sdnc-odl-cluster-healthcheck" 2021/06/17 11:47:43 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:47:43 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:44 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:47:44 [INFO] agent: Synced check "data-router-process" 2021/06/17 11:47:44 [INFO] agent: Synced check "vfc-gvnfmdriver" 2021/06/17 11:47:44 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:47:44 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:45 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:45 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:47:45 [INFO] agent: Synced check "sparky-be-process" 2021/06/17 11:47:45 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:47:45 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:46 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:46 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:47:47 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:47 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:47:47 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:47:47 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:47 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:47:47 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:47:47 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:47 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:47:47 [INFO] agent: Synced check "multicloud-vio" 2021/06/17 11:47:47 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:48 [INFO] agent: Synced check "vfc-ztevnfmdriver" 2021/06/17 11:47:48 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:48 [INFO] agent: Synced check "vfc-vnfres" 2021/06/17 11:47:48 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:48 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:47:48 [INFO] agent: Synced check "model-loader-process" 2021/06/17 11:47:48 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:48 [INFO] agent: Synced check "vfc-nslcm" 2021/06/17 11:47:48 [INFO] agent: Synced check "aaf-sms-health" 2021/06/17 11:47:49 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:49 [INFO] agent: Synced check "vfc-vnflcm" 2021/06/17 11:47:49 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:47:49 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:47:49 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:49 [INFO] agent: Synced check "aai-service" 2021/06/17 11:47:49 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:49 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:49270->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:47:49 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:47:50 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:50 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:47:50 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:47:50 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:50 [INFO] agent: Synced check "aaf-service" 2021/06/17 11:47:50 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:51 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:51 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:51 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:52 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:52 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:53 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:47:53 [INFO] agent: Synced check "search-data-service-availability" 2021/06/17 11:47:53 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:53 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:47:53 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:47:53 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:53 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:53 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:54 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:54 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:47:54 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:54 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:47:55 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:47:55 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:47:55 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:55 [WARN] agent: Check "multicloud-pike" HTTP request failed: Head http://multicloud-pike:9007/api/multicloud-pike/v0/swagger.json: dial tcp 10.96.107.118:9007: getsockopt: connection refused 2021/06/17 11:47:56 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:47:56 [INFO] agent: Synced check "multicloud-pike" 2021/06/17 11:47:56 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:56 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:56 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:47:57 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:57 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:47:57 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:57 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:47:57 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:47:57 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:57 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:58 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:47:58 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:58 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:58 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:47:58 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: dial tcp 10.96.19.3:3000: getsockopt: connection refused 2021/06/17 11:47:58 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:59 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:47:59 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:47:59 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:47:59 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:47:59 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:47:59 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:00 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:00 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:48:00 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:48:00 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:00 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:48:01 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:02 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:02 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:02 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:02 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:03 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:03 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:03 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:03 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:48:03 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:04 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:04 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp 10.96.102.9:8410: i/o timeout 2021/06/17 11:48:04 [INFO] agent: Synced check "vfc-ztevnfmdriver" 2021/06/17 11:48:04 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:48:04 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:04 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:04 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:48:04 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:48:04 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:48:04 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:04 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:49452->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:48:05 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:05 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:05 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:48:05 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:05 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:06 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:06 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:48:06 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:06 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:06 [WARN] agent: Check "elasticsearch-write-health" is now warning 2021/06/17 11:48:06 [INFO] agent: Synced check "elasticsearch-write-health" 2021/06/17 11:48:06 [WARN] agent: Check "mr-kafka" is now warning 2021/06/17 11:48:07 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:48:07 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:48:07 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:48:07 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.2.87 2021/06/17 11:48:07 [INFO] consul: adding server dev-consul-server-0 (Addr: tcp/10.242.2.87:8300) (DC: dc1) 2021/06/17 11:48:07 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:07 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:08 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:08 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:08 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:09 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:09 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:48:09 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:48:09 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:09 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:48:09 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:48:10 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:10 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:48:10 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:48:11 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:48:11 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:11 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:11 [INFO] agent: Synced check "multicloud-pike" 2021/06/17 11:48:11 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:12 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:12 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:12 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:12 [INFO] agent: Synced check "dmaap" 2021/06/17 11:48:12 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:12 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:13 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:13 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:48:13 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:13 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:14 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:14 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:48:14 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:48:14 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:14 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:15 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:48:15 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:15 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:15 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:48:15 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:48:15 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:48:15 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:48:15 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:15 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:16 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:16 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:48:17 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:17 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:48:17 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:17 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:48:17 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:48:17 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:17 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:18 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:18 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:18 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:48:18 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:19 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:19 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:19 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:48:19 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:19 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:19 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:49656->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:48:19 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:48:20 [WARN] agent: Check "vfc-ztevnfmdriver" socket connection failed: dial tcp 10.96.102.9:8410: i/o timeout 2021/06/17 11:48:20 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:20 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:48:20 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:48:20 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:20 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:48:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:20 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:21 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:21 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:21 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:21 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:22 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:22 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:23 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:23 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:23 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:24 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:24 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:24 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:48:24 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:24 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:48:25 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:48:25 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:26 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:48:26 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:48:26 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:26 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:26 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:48:26 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:48:26 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:48:27 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:27 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:27 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:48:27 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:27 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:27 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:48:27 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:48:27 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:28 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:28 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:48:28 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:28 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:29 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:48:29 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:48:29 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:29 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:48:30 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:30 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:48:30 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:48:30 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:30 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:48:30 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:31 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:31 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:31 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:48:31 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:32 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:32 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:32 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:32 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:33 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:33 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:33 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:48:33 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:34 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:34 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:34 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:34 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:48:34 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:34 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:49850->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:48:35 [INFO] agent: Synced check "vfc-ztevnfmdriver" 2021/06/17 11:48:35 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:35 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:35 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:35 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:35 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:48:36 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:36 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:48:36 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:36 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:36 [WARN] agent: Check "mr-kafka" is now warning 2021/06/17 11:48:37 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:48:37 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:48:37 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:48:37 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:48:37 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:37 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:37 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:48:37 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:48:37 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:38 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:38 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:38 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:39 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:39 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:48:39 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:48:39 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:39 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:48:40 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:40 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:48:40 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:48:41 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:48:41 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:41 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:42 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:42 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:42 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:42 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:42 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:48:43 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:43 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:48:43 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:43 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:43 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:43 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:44 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:44 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:48:44 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:44 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:48:45 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:45 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:48:45 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:45 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:48:46 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:46 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:48:46 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:47 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:47 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:48:47 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:47 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:47 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:48:47 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:48:47 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:47 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:47 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:48 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:48 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:48:48 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:48 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:48:48 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:48 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:48:48 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:48:49 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:49 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:48:49 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:49 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:49 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:50044->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:48:50 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:50 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:48:50 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:48:50 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:50 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:51 [WARN] Check "so-camunda-healthcheck": Timed out (1s) running check 2021/06/17 11:48:51 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:51 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:51 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:51 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:52 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:52 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:53 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:48:53 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:53 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:53 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:53 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:54 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:54 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:54 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:48:54 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:54 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:48:55 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:55 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:48:56 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:48:56 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:56 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:56 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:48:57 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:57 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:57 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:48:57 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:57 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:57 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:48:57 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:48:58 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:58 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:48:58 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:58 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:48:59 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:48:59 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:48:59 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:48:59 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:48:59 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:48:59 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:48:59 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:00 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:00 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:49:00 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:49:00 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:00 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:49:01 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:49:01 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:02 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:02 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:02 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:02 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:02 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:03 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:03 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:03 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:03 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:49:03 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:03 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:04 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:04 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:04 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:49:04 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:04 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:04 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:50216->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:49:04 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:49:05 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:05 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:05 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:06 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:49:06 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:06 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:49:06 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:06 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:06 [WARN] agent: Check "mr-kafka" is now warning 2021/06/17 11:49:07 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:07 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:49:07 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:49:07 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:49:07 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:07 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:08 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:08 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:08 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:09 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:09 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:49:09 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:09 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:49:09 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:10 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:49:10 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:10 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:49:10 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:49:10 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:49:10 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:49:11 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:49:11 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:49:11 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:11 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:12 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:12 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:12 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:12 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:12 [WARN] agent: Check "elasticsearch-write-health" is now warning 2021/06/17 11:49:13 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:13 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:49:13 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:13 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:14 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:14 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:49:14 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:14 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:14 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:49:15 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:15 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:15 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:49:15 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:49:15 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:16 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:49:16 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:16 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:49:17 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:17 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:17 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:49:17 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:49:17 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:49:17 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:17 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:18 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:18 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:18 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:49:18 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:18 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:19 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:19 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:19 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:49:19 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:19 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:19 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:50386->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:49:19 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:20 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:20 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:49:20 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:49:20 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:20 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:21 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:49:21 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:49:21 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:21 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:49:21 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:49:21 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:21 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:22 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:22 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:23 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:23 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:23 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:23 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:24 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:24 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:24 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:49:24 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:24 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:49:25 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:25 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:26 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:49:26 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:49:26 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:26 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:26 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:49:26 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:49:27 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:27 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:27 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:49:27 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:27 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:27 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:49:27 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:49:28 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:28 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:49:28 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:28 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:29 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:49:29 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:49:29 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:30 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:30 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:49:30 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:49:30 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:30 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:49:31 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:49:31 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:31 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:32 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:32 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:32 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:49:32 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:32 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:49:32 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:49:32 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:33 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:33 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:33 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:49:33 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:34 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:34 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:34 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:34 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:34 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:34 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:50564->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:49:34 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:49:35 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:35 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:35 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:35 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:35 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:36 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:49:36 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:36 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:49:36 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:36 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:36 [WARN] agent: Check "mr-kafka" is now warning 2021/06/17 11:49:37 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:49:37 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:49:37 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:49:37 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:49:37 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:37 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:38 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:38 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:38 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:39 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:39 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:39 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:49:39 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:49:39 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:40 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:40 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:49:40 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:49:41 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:49:41 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:49:41 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:41 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:41 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:42 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:42 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:42 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:42 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:43 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:43 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:49:43 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:49:43 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:49:43 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:49:43 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:43 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:44 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:44 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:49:44 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:44 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:49:45 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:45 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:45 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:49:45 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:46 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:49:46 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:46 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:49:47 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:47 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:47 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:49:47 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:49:47 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:47 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:49:47 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:47 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:48 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:48 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:48 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:49:48 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:48 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:49:49 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:49 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:49:49 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:49 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:49:49 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:49 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:50746->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:49:50 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:50 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:49:50 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:49:50 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:50 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:51 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:49:51 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:51 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:51 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:51 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:51 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:52 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:52 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:53 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:53 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:53 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:54 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:54 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:49:54 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:54 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:49:54 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:49:54 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:49:54 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:55 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:49:55 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:56 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:56 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:49:56 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:49:56 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:56 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:56 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:49:57 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:57 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:57 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:49:57 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:57 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:57 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:49:57 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:49:57 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:49:58 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:58 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:49:58 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:58 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:49:59 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:49:59 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:49:59 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:49:59 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:00 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:00 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:50:00 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:50:00 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:00 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:50:01 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:50:01 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:02 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:02 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:02 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:02 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:03 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:03 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:03 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:50:03 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:50:03 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:04 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:04 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:04 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:04 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:50:04 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:50924->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:50:04 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:05 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:50:05 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:50:05 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:05 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:50:05 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:50:05 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:06 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:06 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:50:06 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:06 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:50:06 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:06 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:06 [WARN] agent: Check "mr-kafka" is now warning 2021/06/17 11:50:07 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:50:07 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:50:07 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:50:07 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:50:07 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:07 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:07 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:50:08 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:08 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:08 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:09 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:09 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:50:09 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:50:09 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:10 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:10 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:50:10 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:50:10 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:50:11 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:50:11 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:50:11 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:50:11 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:11 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:12 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:12 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:12 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:12 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:13 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:13 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:50:13 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:50:13 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:13 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:14 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:50:14 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:14 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:15 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:50:15 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:15 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:50:16 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:16 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:50:16 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:50:16 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:50:16 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:16 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:50:16 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:50:16 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:50:17 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:17 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:17 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:50:17 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:50:17 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:50:17 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:17 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:17 [WARN] agent: Check "elasticsearch-write-health" is now warning 2021/06/17 11:50:18 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:18 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:18 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:50:18 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:19 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:50:19 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:19 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:50:19 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:19 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:50:19 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:51094->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:50:19 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:20 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:20 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:50:20 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:50:20 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:20 [INFO] agent: Synced check "vfc-nokiav2vnfmdriver" 2021/06/17 11:50:20 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:21 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:50:21 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:50:21 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:21 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:21 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:22 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:22 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:23 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:50:23 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:23 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:23 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:23 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:50:24 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:24 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:24 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:50:24 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:25 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:50:26 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:26 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:50:26 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:50:26 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:26 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:26 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:50:27 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:50:27 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:27 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:27 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:50:27 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:50:27 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:27 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:27 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:50:27 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:50:27 [INFO] agent: Synced check "log-kibana-server" 2021/06/17 11:50:27 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:50:27 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:50:28 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:28 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:50:28 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:28 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:29 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:50:29 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:50:29 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:50:29 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:30 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:30 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:50:30 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:50:30 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:30 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:50:31 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:50:31 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:32 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:32 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:32 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:50:32 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:32 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:33 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:33 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:33 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:50:33 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:34 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:34 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:34 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:34 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:50:34 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:51274->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:50:34 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:35 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:50:35 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:50:35 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:35 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:36 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:36 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:50:36 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:36 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:50:36 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:36 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:36 [WARN] agent: Check "mr-kafka" is now warning 2021/06/17 11:50:37 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:50:37 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:50:37 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:50:37 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:37 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:38 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:50:38 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:38 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:38 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:50:38 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:50:38 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:39 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:50:39 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:39 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:50:39 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:50:39 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:39 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:50:40 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:40 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:50:40 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:50:41 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:50:41 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:50:41 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:41 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:42 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:42 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:42 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:42 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:43 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:50:43 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:43 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:50:43 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:50:43 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:43 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:44 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:50:44 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:44 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:45 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:50:45 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:45 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:50:45 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:50:46 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:46 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:50:46 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:46 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:50:47 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:47 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:50:47 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:47 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:50:47 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:50:47 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:50:47 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:47 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:48 [INFO] agent: Synced check "policy-nexus-local-status" 2021/06/17 11:50:48 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:48 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:48 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:50:48 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:49 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:50:49 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:49 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:50:49 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:49 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:50:49 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:50:49 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:50:49 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:51464->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:50:49 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:50 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:50 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:50:50 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:50:50 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:50 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:51 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:50:51 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:50:51 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:51 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:51 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:52 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:52 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:53 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:53 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:53 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:54 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:54 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:54 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:50:54 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:50:54 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:55 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:50:55 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:50:55 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:50:56 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:56 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:50:56 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:50:56 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:56 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:56 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:50:57 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:57 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:57 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:50:57 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:57 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:57 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:50:57 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:50:58 [INFO] agent: Synced check "sdc-be-healthcheck" 2021/06/17 11:50:58 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:58 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:50:58 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:58 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:50:59 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:50:59 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:50:59 [INFO] agent: Synced check "log-logstash-internal-server-os-info" 2021/06/17 11:50:59 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:50:59 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:00 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:51:00 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:00 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:51:00 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:51:00 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:00 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:51:00 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:51:00 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:51:00 [INFO] agent: Synced check "log-logstash-internal-server-jvm-stat" 2021/06/17 11:51:01 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:51:01 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:01 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:51:02 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:02 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:02 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:02 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:03 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:03 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:03 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:51:03 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:04 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:04 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:04 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:51:04 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:04 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:51638->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:51:04 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:05 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:51:05 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:05 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:51:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:06 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:06 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:06 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:51:06 [INFO] agent: Synced check "sdc-catalog-healthcheck" 2021/06/17 11:51:06 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:06 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:51:06 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:06 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:06 [WARN] agent: Check "mr-kafka" is now warning 2021/06/17 11:51:07 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:51:07 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:51:07 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:51:07 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:51:07 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:07 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:08 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:08 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:08 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:09 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:09 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:51:09 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:51:09 [INFO] agent: Synced check "so-camunda-healthcheck" 2021/06/17 11:51:09 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:10 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:10 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:51:10 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:51:11 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:51:11 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:51:11 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:51:11 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:11 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:11 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:51:11 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:51:11 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:51:11 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:51:12 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:12 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:12 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:12 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:13 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:13 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:51:13 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:13 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:14 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:51:14 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:14 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:15 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:51:15 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:51:15 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:15 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:51:16 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:16 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:51:16 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:16 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:51:16 [INFO] agent: Synced check "appc-dgbuilder" 2021/06/17 11:51:16 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:51:17 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:17 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:17 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:51:17 [INFO] agent: Synced check "log-logstash-internal-server-os-stat" 2021/06/17 11:51:17 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:51:17 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:51:17 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:51:17 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:17 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:18 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:18 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:51:18 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:18 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:51:18 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:19 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:19 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:51:19 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:51:19 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:19 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:51808->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:51:19 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:20 [INFO] agent: Synced check "vfc-workflow" 2021/06/17 11:51:20 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:20 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:51:20 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:51:20 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:21 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:21 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:51:21 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:21 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:21 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:22 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:51:22 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:22 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:51:22 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:51:22 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:23 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:51:23 [WARN] agent: Check "elasticsearch-write-health" is now warning 2021/06/17 11:51:23 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:23 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:23 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:24 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:24 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:24 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:51:24 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:25 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:51:26 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:26 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:26 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:51:26 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:26 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:51:26 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:51:26 [INFO] agent: Synced check "appc-sdnhost" 2021/06/17 11:51:27 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:27 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:27 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:51:27 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:51:27 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:27 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:27 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:51:27 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:51:27 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:51:27 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:51:28 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:28 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:51:28 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:28 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:29 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:51:29 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:51:29 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:30 [INFO] agent: Synced check "vfc-catalog" 2021/06/17 11:51:30 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:30 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:51:30 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:51:30 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:30 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:51:31 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:51:31 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:51:31 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:32 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:32 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:32 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:32 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:33 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:33 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:51:33 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:33 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:51:33 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:51:33 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:51:33 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:51:33 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:34 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:34 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:34 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:51:34 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:34 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:51988->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:51:34 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:35 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:51:35 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:36 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:36 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:36 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:51:36 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:36 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:51:36 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:36 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:36 [WARN] agent: Check "mr-kafka" is now warning 2021/06/17 11:51:37 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:51:37 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:51:37 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:51:37 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:37 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:38 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:51:38 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:38 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:38 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:39 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:51:39 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:39 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:51:39 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:51:39 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:40 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:40 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:51:40 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:51:41 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:41 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:51:41 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:41 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:51:42 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:42 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:42 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:42 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:43 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:43 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:51:43 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:51:43 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:43 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:43 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:51:44 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:51:44 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:44 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:51:44 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:51:44 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:51:44 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:45 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:51:45 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:45 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:51:46 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:46 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:51:46 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:46 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:51:47 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:51:47 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:47 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:47 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:51:47 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:51:47 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:51:47 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:47 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:48 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:48 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:48 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:51:48 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:49 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:51:49 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:49 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:51:49 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:51:49 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:51:49 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:51:49 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:49 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:52174->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:51:49 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:50 [INFO] agent: Synced check "brmsgw-tcp" 2021/06/17 11:51:50 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:50 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:51:50 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:51:50 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:51 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:51 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:51:51 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:51 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:51 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:52 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:52 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:53 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:53 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:53 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:54 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:54 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:54 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:51:55 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:55 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:51:55 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:51:55 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:51:55 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:51:55 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:51:56 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:56 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:56 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:51:56 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:56 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:51:56 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:51:57 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:57 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:57 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:51:57 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:57 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:57 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:51:57 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:51:58 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:58 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:51:58 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:58 [INFO] agent: Synced check "policy-nexus-internal-healthcheck" 2021/06/17 11:51:58 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:59 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:51:59 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:51:59 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:51:59 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:51:59 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:52:00 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:00 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:52:00 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:52:00 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:52:00 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:00 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:52:01 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:52:01 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:02 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:02 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:02 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:02 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:03 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:52:03 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:03 [INFO] agent: Synced check "sdnc-dgbuilder" 2021/06/17 11:52:03 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:03 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:52:03 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:04 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:04 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:04 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:52:04 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:04 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:52346->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:52:04 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:05 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:52:05 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:05 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:52:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:06 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:06 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:06 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:52:06 [INFO] agent: Synced check "aai-service" 2021/06/17 11:52:06 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:52:06 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:52:06 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:06 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:52:06 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:52:06 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:06 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:07 [WARN] agent: Check "mr-kafka" is now warning 2021/06/17 11:52:07 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:52:07 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:52:07 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:52:07 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:07 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:08 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:08 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:08 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:09 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:09 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:52:09 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:52:09 [INFO] agent: Synced check "so-api-healthcheck" 2021/06/17 11:52:10 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:10 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:10 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:52:10 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:52:11 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:11 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:52:11 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:11 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:52:11 [INFO] agent: Synced check "log-elasticsearch-server" 2021/06/17 11:52:11 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:52:11 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:52:12 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:12 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:12 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:12 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:13 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:13 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:52:13 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:13 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:14 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:52:14 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:14 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:15 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:52:15 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:52:15 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:15 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:52:15 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:52:16 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:16 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:52:16 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:16 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:52:17 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:17 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:17 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:52:17 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:52:17 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:52:17 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:52:17 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:17 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:52:17 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:52:17 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:18 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:18 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:18 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:52:18 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:19 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:52:19 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:19 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:52:19 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:52:19 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:19 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:52520->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:52:19 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:20 [WARN] agent: Check "dmaap" HTTP request failed: Get http://message-router:3904/topics: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:52:20 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:20 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:52:20 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:52:20 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:21 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:21 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:52:21 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:52:21 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:21 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:22 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:22 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:52:22 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:22 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:22 [INFO] agent: Synced check "sdnctldb01" 2021/06/17 11:52:23 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:23 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:23 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:24 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:24 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:24 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:52:25 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:25 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:52:26 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:26 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:26 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:26 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:52:26 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:52:26 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:52:27 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:27 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:27 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:52:27 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:52:27 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:27 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:27 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:52:27 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:52:28 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:28 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:52:28 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:52:28 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:28 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:52:28 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:52:28 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:29 [WARN] agent: Check "elasticsearch-write-health" is now warning 2021/06/17 11:52:29 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:52:29 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:52:29 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:30 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:30 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:52:30 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:52:30 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:30 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:52:31 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:52:31 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:52:31 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:31 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:52:32 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:32 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:32 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:32 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:33 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:33 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:33 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:52:33 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:52:33 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:34 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:34 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:34 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:52:34 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:34 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:52698->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:52:34 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:35 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:52:35 [INFO] agent: Synced check "vfc-resmgr" 2021/06/17 11:52:35 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:52:35 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:36 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:36 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:36 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:52:36 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:36 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:52:37 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:37 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:37 [WARN] agent: Check "mr-kafka" is now warning 2021/06/17 11:52:37 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:52:37 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:52:37 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:52:37 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:52:37 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:37 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:38 [INFO] agent: Synced check "log-elasticsearch-tcp" 2021/06/17 11:52:38 [INFO] agent: Synced check "pap" 2021/06/17 11:52:38 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:38 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:38 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:39 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:52:39 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:39 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:52:39 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:52:39 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:52:39 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:52:40 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:40 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:40 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:52:40 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:52:40 [INFO] agent: Synced check "sdc-fe-healthcheck" 2021/06/17 11:52:40 [INFO] agent: Synced check "log-logstash-tcp" 2021/06/17 11:52:41 [INFO] agent: Synced check "log-logstash-internal-server-jvm-info" 2021/06/17 11:52:41 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:41 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:41 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:52:41 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:52:42 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:42 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:42 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:42 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:43 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:43 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:52:43 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:52:43 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:44 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:44 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:52:44 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:44 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:52:44 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:45 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:52:45 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:45 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:52:46 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:46 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:46 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:52:46 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:52:47 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:47 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:47 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:52:47 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:52:47 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:52:47 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:52:47 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:47 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:47 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:52:48 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:48 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:48 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:52:48 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:49 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:49 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:52:49 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:52:49 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:49 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:52884->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:52:49 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:50 [INFO] agent: Synced check "dmaap" 2021/06/17 11:52:50 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:52:50 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:50 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:52:50 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:52:50 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:50 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:52:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:50 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:52:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:51 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:51 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:52:51 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:52:51 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:52 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:52 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:52 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:52 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:53 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:52:53 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:53 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:54 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:54 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:54 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:54 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:52:55 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:55 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:52:55 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:52:56 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:56 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:56 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:56 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:52:56 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:52:56 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:52:57 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:57 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:57 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:52:57 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:57 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:57 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:52:57 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:52:58 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:58 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:52:58 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:58 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:52:59 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:52:59 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:52:59 [INFO] agent: Synced check "so-jra-healthcheck" 2021/06/17 11:52:59 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:52:59 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:00 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:00 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:53:00 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:53:00 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:00 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:53:00 [INFO] agent: Synced check "vid-server" 2021/06/17 11:53:01 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:53:01 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:01 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:53:01 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:53:01 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:53:02 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:02 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:02 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:02 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:03 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:03 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:53:03 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:03 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:53:03 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:53:04 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:04 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:04 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:04 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:53:04 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:04 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:53064->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:53:04 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:05 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:53:05 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:05 [INFO] agent: Synced check "framework" 2021/06/17 11:53:06 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:06 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:06 [INFO] agent: Synced check "appc-sdnctldb02" 2021/06/17 11:53:06 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:53:06 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:53:06 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:06 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:53:07 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:07 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:07 [WARN] agent: Check "mr-kafka" is now warning 2021/06/17 11:53:07 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:53:07 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:53:07 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:53:07 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:53:07 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:07 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:08 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:08 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:08 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:09 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:09 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:53:09 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:53:09 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:53:10 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:10 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:10 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:53:10 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:53:11 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:11 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:11 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:53:11 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:53:12 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:12 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:12 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:53:12 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:12 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:12 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:53:12 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:53:13 [INFO] agent: Synced check "vfc-nokiavnfmdriver" 2021/06/17 11:53:13 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:13 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:53:14 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:14 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:14 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:53:14 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:14 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:15 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:53:15 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:53:15 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:15 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:53:16 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:16 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:16 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:53:16 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:53:17 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:17 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:17 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:53:17 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:53:17 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:53:17 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:53:17 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:17 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:18 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:18 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:18 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:53:18 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:19 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:53:19 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:19 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:53:19 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:53:19 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:53238->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:53:19 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:19 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:19 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:53:20 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:20 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:53:20 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:53:20 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:21 [INFO] agent: Synced check "vfc-emsdriver" 2021/06/17 11:53:21 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:21 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:21 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:53:22 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:22 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:22 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:22 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:23 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:53:23 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:53:23 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:53:23 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:53:23 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:23 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:24 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:24 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:24 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:24 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:53:25 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:25 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:53:25 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:53:26 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:26 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:26 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:26 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:53:26 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:53:26 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:53:27 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:27 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:27 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:53:27 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:27 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:27 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:53:27 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:53:28 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:28 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:53:28 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:53:28 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:29 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:29 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:53:29 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:53:29 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:30 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:30 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:53:30 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:53:30 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:30 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:53:31 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:53:31 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:31 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:53:32 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:32 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:32 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:32 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:33 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:33 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:33 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:53:34 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:34 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:53:34 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:34 [WARN] agent: Check "elasticsearch-write-health" is now warning 2021/06/17 11:53:34 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:34 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:53:34 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:53:34 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:53:34 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:53422->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:53:34 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:34 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:35 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:53:35 [INFO] agent: Synced check "drools" 2021/06/17 11:53:35 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:35 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:53:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:35 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:53:36 [INFO] agent: Synced check "msb-eag" 2021/06/17 11:53:36 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:36 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:36 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:36 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:53:36 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:53:37 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:37 [WARN] agent: Check "mr-kafka" is now warning 2021/06/17 11:53:37 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:37 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:53:37 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:53:37 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:53:37 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:37 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:38 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:38 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:38 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:39 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:53:39 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:39 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:53:39 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:53:39 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:53:40 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:40 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:40 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:53:40 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:53:41 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:41 [INFO] agent: Synced check "pdp" 2021/06/17 11:53:41 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:41 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:53:41 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:53:41 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:53:42 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:42 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:42 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:42 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:42 [INFO] agent: Synced check "elasticsearch" 2021/06/17 11:53:43 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:43 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:53:44 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:44 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:44 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:53:44 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:44 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:45 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:53:45 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:45 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:53:45 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:53:45 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:53:45 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:53:46 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:46 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:46 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:53:46 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:53:47 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:47 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:47 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:53:47 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:53:47 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:53:47 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:53:47 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:47 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:48 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:48 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:48 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:53:48 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:49 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:49 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:53:49 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:53:49 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:53608->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:53:49 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:49 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:50 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:50 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:53:50 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:53:50 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:50 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:53:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:51 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:51 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:53:51 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:51 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:53:51 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:53:52 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:52 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:52 [INFO] agent: Synced check "multicloud-windriver" 2021/06/17 11:53:52 [INFO] agent: Synced check "sdnc-sdnhost" 2021/06/17 11:53:52 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:52 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:53 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:53 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:54 [INFO] agent: Synced check "vfc-workflowengineactiviti" 2021/06/17 11:53:54 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:54 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:54 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:54 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:53:55 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:53:55 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:55 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:53:56 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:56 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:53:56 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:56 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:56 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:53:56 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:53:56 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:53:56 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:53:56 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:53:57 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:57 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:57 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:53:57 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:57 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:57 [INFO] agent: Synced check "vfc-ztesdncdriver" 2021/06/17 11:53:57 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:53:57 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:53:57 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:53:58 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:58 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:53:58 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:59 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:53:59 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:53:59 [INFO] agent: Synced check "log-logstash-internal-server-process-stat" 2021/06/17 11:53:59 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:53:59 [INFO] agent: Synced check "appc-sdnctldb01" 2021/06/17 11:53:59 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:00 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:00 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:54:00 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:54:00 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:00 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:54:01 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:54:01 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:02 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:54:02 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:02 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:02 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:03 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:03 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:03 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:54:03 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:03 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:54:04 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:04 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:04 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:04 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:54:04 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:53790->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:54:04 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:04 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:05 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:05 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:54:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:06 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:06 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:06 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:06 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:54:06 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:54:07 [WARN] agent: Check "mr-kafka" is now warning 2021/06/17 11:54:07 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:07 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:07 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:54:07 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:54:07 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:54:07 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:54:07 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:54:07 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:07 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:54:07 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:54:07 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:54:07 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:08 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:08 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:08 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:09 [INFO] agent: Synced check "log-logstash-internal-server-node-stat" 2021/06/17 11:54:09 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:09 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:54:09 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:54:10 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:10 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:10 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:54:10 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:54:11 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:54:11 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:11 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:11 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:54:12 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:54:12 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:12 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:12 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:12 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:12 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:54:13 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:13 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:54:13 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:54:14 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:14 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:14 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:54:14 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:14 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:15 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:15 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:54:15 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:54:16 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:16 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:16 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:54:17 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:54:17 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:17 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:17 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:54:17 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:54:17 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:54:17 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:18 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:18 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:18 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:54:18 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:18 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:54:18 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:18 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:54:18 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:54:19 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:54:19 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:19 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:54:19 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:54:19 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:53972->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:54:19 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:19 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:20 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:20 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:20 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:54:20 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:54:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:21 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:21 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:22 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:22 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:22 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:54:22 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:22 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:23 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:54:23 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:54:23 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:23 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:23 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:54:24 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:24 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:24 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:24 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:54:25 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:25 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:54:26 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:26 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:26 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:26 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:54:26 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:54:27 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:54:27 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:54:27 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:27 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:27 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:54:27 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:27 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:27 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:54:27 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:54:28 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:28 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:54:28 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:29 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:29 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:54:29 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:54:29 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:54:29 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:54:29 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:54:29 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:54:29 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:30 [INFO] agent: Synced check "sdc-titan-healthcheck" 2021/06/17 11:54:30 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:30 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:54:30 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:54:30 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:30 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:54:31 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:32 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:54:32 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:32 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:32 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:33 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:33 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:33 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:33 [INFO] agent: Synced check "policy-nexus-internal-metrics" 2021/06/17 11:54:33 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:54:34 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:34 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:34 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:34 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:54:34 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:54:34 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:54156->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:54:34 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:34 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:35 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:54:35 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:35 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:54:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:36 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:36 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:36 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:37 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:54:37 [WARN] agent: Check "mr-kafka" is now warning 2021/06/17 11:54:37 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:54:37 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:37 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:37 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:54:37 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:54:37 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:54:37 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:38 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:38 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:38 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:38 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:39 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:54:39 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:39 [INFO] agent: Synced check "vfc-jujudriver" 2021/06/17 11:54:39 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:54:39 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:54:39 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:54:40 [INFO] agent: Synced check "log-logstash-internal-server-node-info" 2021/06/17 11:54:40 [WARN] agent: Check "elasticsearch-write-health" is now warning 2021/06/17 11:54:40 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:40 [INFO] agent: Synced check "clamp-health" 2021/06/17 11:54:40 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:54:40 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:40 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:54:40 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:54:40 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:54:40 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:54:41 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:41 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:41 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:54:42 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:54:42 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:42 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:42 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:42 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:43 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:54:43 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:43 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:54:44 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:44 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:44 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:54:44 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:44 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:45 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:54:45 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:54:45 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:45 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:54:45 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:54:46 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:46 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:47 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:54:47 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:54:47 [INFO] agent: Synced check "sdc-cs-healthcheck" 2021/06/17 11:54:47 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:47 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:47 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:54:47 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:54:47 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:54:47 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:48 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:48 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:48 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:48 [INFO] agent: Synced check "log-logstash-internal-server-gi" 2021/06/17 11:54:48 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:54:48 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:49 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:49 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:54:49 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:54:49 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:54342->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:54:49 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:49 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:50 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:50 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:50 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:54:50 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:54:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:51 [INFO] agent: Synced check "so-api-healthcheck" 2021/06/17 11:54:51 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:51 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:54:51 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:54:51 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:54:51 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:54:51 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:52 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:52 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:52 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:54:52 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:53 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:53 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:53 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:54 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:54 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:54 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:54 [INFO] agent: Synced check "aai-resources" 2021/06/17 11:54:54 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:54:55 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:55 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:54:55 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:54:55 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:54:56 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:56 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:56 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:56 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:54:56 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:54:57 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:54:57 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:54:57 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:57 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:57 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:57 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:54:57 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:57 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:54:57 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:54:58 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:58 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:54:58 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:59 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:54:59 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:54:59 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:54:59 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:54:59 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:00 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:00 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:55:00 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:55:00 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:00 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:55:01 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:55:01 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:02 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:55:02 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:02 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:02 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:55:02 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:02 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:55:02 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:55:03 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:03 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:03 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:03 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:55:04 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:04 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:04 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:04 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:55:04 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:54530->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:55:04 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:05 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:05 [INFO] agent: Synced check "odl-api-healthcheck" 2021/06/17 11:55:05 [INFO] agent: Synced check "sdnctldb02" 2021/06/17 11:55:05 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:05 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:55:06 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:06 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:06 [INFO] agent: Synced check "log-logstash-internal-server-plugin-info" 2021/06/17 11:55:06 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:07 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:55:07 [WARN] agent: Check "mr-kafka" is now warning 2021/06/17 11:55:07 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:07 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:07 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:55:07 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:55:07 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:55:07 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:55:07 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:55:07 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:55:07 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:08 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:08 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:08 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:08 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:09 [INFO] agent: Synced check "multicloud-starlingx" 2021/06/17 11:55:09 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:09 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:55:09 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:55:10 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:10 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:10 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:55:10 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:55:11 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:55:11 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:11 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:11 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:55:11 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:55:12 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:55:12 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:12 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:12 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:12 [INFO] agent: Synced check "msb-iag" 2021/06/17 11:55:12 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:13 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:13 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:55:13 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:55:13 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:55:13 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:55:14 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:14 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:55:14 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:14 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:14 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:15 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:55:15 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:15 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:55:16 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:55:16 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:16 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:17 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:55:17 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:55:17 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:17 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:17 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:55:17 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:55:17 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:55:17 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:55:17 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:18 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:18 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:18 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:18 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:55:18 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:55:18 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:19 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:19 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:55:19 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:55:19 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:54708->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:55:19 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:20 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:20 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:20 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:20 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:55:20 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:55:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:21 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:21 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:22 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:22 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:22 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:55:22 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:23 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:23 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:55:23 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:24 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:24 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:55:24 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:24 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:24 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:24 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:55:24 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:55:24 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:55:25 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:26 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:55:26 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:26 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:26 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:26 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:55:27 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:55:27 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:55:27 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:27 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:55:27 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:27 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:27 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:55:27 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:27 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:55:27 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:55:27 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:55:28 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:28 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:55:28 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:29 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:29 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:55:29 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:55:29 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:55:29 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:30 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:30 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:55:30 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:55:30 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:30 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:55:31 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:55:31 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:32 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:55:32 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:32 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:32 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:33 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:33 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:33 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:33 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:55:33 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:55:34 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:34 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:34 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:34 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:55:34 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:54892->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:55:34 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:35 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:35 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:55:35 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:35 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:55:35 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:55:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:36 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:55:36 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:36 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:36 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:37 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:55:37 [WARN] agent: Check "mr-kafka" is now warning 2021/06/17 11:55:37 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:37 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:37 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:55:37 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:55:37 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:55:37 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:55:37 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:38 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:38 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:38 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:39 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:39 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:55:39 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:39 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:55:39 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:55:40 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:40 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:40 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:55:40 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:55:40 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:55:41 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:41 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:41 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:55:42 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:42 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:55:42 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:42 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:42 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:43 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:55:43 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:43 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:55:43 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:55:44 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:44 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:55:44 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:44 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:45 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:45 [WARN] agent: Check "elasticsearch-write-health" is now warning 2021/06/17 11:55:45 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:45 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:55:46 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:55:46 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:46 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:55:46 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:46 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:55:46 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:55:47 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:55:47 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:55:47 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:55:47 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:47 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:47 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:55:47 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:55:47 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:55:47 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:48 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:48 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:48 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:48 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:55:48 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:49 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:49 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:55:49 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:55:49 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:55080->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:55:49 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:55:49 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:50 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:50 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:50 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:50 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:55:50 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:55:50 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:51 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:51 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:55:51 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:52 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:52 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:52 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:55:52 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:53 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:53 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:54 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:54 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:54 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:54 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:54 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:55:55 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:55 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:55:56 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:55:56 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:56 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:56 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:56 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:55:57 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:55:57 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:57 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:55:57 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:57 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:55:57 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:57 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:55:57 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:57 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:55:57 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:55:57 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:55:57 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:55:58 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:58 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:55:58 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:59 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:55:59 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:55:59 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:55:59 [INFO] agent: Synced check "so-jra-healthcheck" 2021/06/17 11:55:59 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:55:59 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:56:00 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:00 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:00 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:56:00 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:56:00 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:00 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:56:01 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:02 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:02 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:56:02 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:02 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:56:02 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:03 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:56:03 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:03 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:03 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:03 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:56:04 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:04 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:04 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:04 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:56:04 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:55266->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:56:04 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:05 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:05 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:56:05 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:05 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:06 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:06 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:56:06 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:07 [WARN] agent: Check "mr-kafka" is now warning 2021/06/17 11:56:07 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:56:07 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:07 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:07 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:07 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:56:07 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:56:07 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:56:07 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:56:07 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:08 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:08 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:56:08 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:56:08 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:56:08 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:08 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:09 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:09 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:09 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:56:09 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:56:10 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:10 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:10 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:56:10 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:56:11 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:56:11 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:11 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:11 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:56:12 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:12 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:12 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:12 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:56:12 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:13 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:13 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:56:13 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:56:14 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:14 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:56:14 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:14 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:15 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:15 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:56:15 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:15 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:56:15 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:56:16 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:56:16 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:16 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:17 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:56:17 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:17 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:56:17 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:17 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:56:17 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:56:17 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:56:17 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:18 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:18 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:18 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:18 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:56:18 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:19 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:56:19 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:56:19 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:19 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:56:19 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:55446->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:56:19 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:56:19 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:56:19 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:56:20 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:20 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:20 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:20 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:20 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:56:20 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:56:20 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:21 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:21 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:56:22 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:22 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:22 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:22 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:56:22 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:23 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:23 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:24 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:24 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:24 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:24 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:24 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:56:24 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:56:25 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:26 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:56:26 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:26 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:26 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:26 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:56:27 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:56:27 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:27 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:27 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:56:27 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:56:27 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:27 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:56:27 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:27 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:56:27 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:56:28 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:28 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:56:28 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:29 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:29 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:56:29 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:56:30 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:30 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:56:30 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:30 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:56:30 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:56:30 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:30 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:56:30 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:56:30 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:56:31 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:56:31 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:31 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:56:32 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:32 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:32 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:56:32 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:33 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:33 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:33 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:33 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:56:34 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:34 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:34 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:34 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:56:34 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:55628->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:56:35 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:35 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:35 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:56:35 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:56:35 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:35 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:36 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:36 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:56:36 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:37 [WARN] agent: Check "mr-kafka" is now warning 2021/06/17 11:56:37 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:37 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:56:37 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:37 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:37 [INFO] agent: Synced check "so-camunda-healthcheck" 2021/06/17 11:56:37 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:56:37 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:56:37 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:56:37 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:56:37 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:56:37 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:38 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:38 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:38 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:39 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:39 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:39 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:56:39 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:56:40 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:40 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:40 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:56:40 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:56:41 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:56:41 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:41 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:41 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:56:41 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:56:41 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:56:42 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:42 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:42 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:42 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:42 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:56:43 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:43 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:56:43 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:56:44 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:44 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:56:44 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:44 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:45 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:45 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:45 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:56:46 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:56:46 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:46 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:56:46 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:47 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:56:47 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:56:47 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:47 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:47 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:56:47 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:56:47 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:56:47 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:56:47 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:47 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:56:48 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:48 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:48 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:48 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:56:48 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:49 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:49 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:56:49 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:55812->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:56:49 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:56:50 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:50 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:50 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:50 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:50 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:56:50 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:56:51 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:51 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:51 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:56:51 [WARN] agent: Check "elasticsearch-write-health" is now warning 2021/06/17 11:56:51 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:52 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:52 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:52 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:52 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:56:52 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:56:52 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:52 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:56:52 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:56:53 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:53 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:56:53 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:54 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:54 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:54 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:54 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:55 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:56:55 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:56 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:56:56 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:56 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:56 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:57 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:56:57 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:56:57 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:57 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:57 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:56:57 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:57 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:56:57 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:56:57 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:57 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:56:57 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:56:58 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:58 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:58 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:56:59 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:56:59 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:56:59 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:56:59 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:57:00 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:00 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:00 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:57:00 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:57:00 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:00 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:57:01 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:02 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:02 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:02 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:57:02 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:03 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:03 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:03 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:57:03 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:57:03 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:03 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:57:03 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:57:03 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:57:03 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:57:04 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:04 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:04 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:04 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:57:04 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:55998->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:57:05 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:05 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:05 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:06 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:06 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:06 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:06 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:57:06 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:07 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:57:07 [WARN] agent: Check "mr-kafka" is now warning 2021/06/17 11:57:07 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:07 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:57:07 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:07 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:07 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:57:07 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:57:07 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:57:07 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:57:07 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:08 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:08 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:57:08 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:08 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:09 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:09 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:57:09 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:09 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:57:10 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:57:10 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:10 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:10 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:57:10 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:57:11 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:11 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:12 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:57:12 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:12 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:12 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:12 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:57:12 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:13 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:14 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:57:14 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:14 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:57:14 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:57:14 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:14 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:14 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:57:14 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:57:15 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:15 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:57:15 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:15 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:57:16 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:57:16 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:16 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:17 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:57:17 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:17 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:17 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:57:17 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:57:17 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:57:17 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:57:17 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:18 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:18 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:18 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:18 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:57:18 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:19 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:57:19 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:19 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:57:19 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:57:19 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:56178->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:57:19 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:57:19 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:57:20 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:20 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:20 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:20 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:20 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:57:20 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:57:21 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:21 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:21 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:22 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:22 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:22 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:22 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:57:22 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:23 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:57:23 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:24 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:24 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:24 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:24 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:24 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:25 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:57:25 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:25 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:57:25 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:57:25 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:57:25 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:57:26 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:57:26 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:26 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:26 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:27 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:57:27 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:57:27 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:27 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:27 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:27 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:57:27 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:57:27 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:27 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:57:27 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:57:28 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:29 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:29 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:57:29 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:29 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:57:29 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:57:30 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:30 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:57:30 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:30 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:57:30 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:57:30 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:30 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:57:31 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:57:31 [INFO] agent: Synced check "so-api-healthcheck" 2021/06/17 11:57:31 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:32 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:32 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:32 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:57:32 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:33 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:33 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:33 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:33 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:57:34 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:34 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:34 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:34 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:57:34 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:56358->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:57:35 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:35 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:35 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:57:35 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:35 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:57:36 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:36 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:36 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:36 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:57:36 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:36 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:57:36 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:57:36 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:57:37 [WARN] agent: Check "mr-kafka" is now warning 2021/06/17 11:57:37 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:37 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:37 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:57:37 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:37 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:57:37 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:57:37 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:57:37 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:37 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:57:38 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:39 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:39 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:39 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:39 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:57:39 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:40 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:57:40 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:57:40 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:40 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:40 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:57:40 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:57:41 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:41 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:57:41 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:41 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:57:42 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:57:42 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:42 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:42 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:42 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:42 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:57:43 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:44 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:57:44 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:44 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:57:44 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:44 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:45 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:45 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:46 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:57:46 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:46 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:57:46 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:47 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:57:47 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:47 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:57:47 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:57:47 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:47 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:57:47 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:57:47 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:57:47 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:57:47 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:57:47 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:57:47 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:48 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:48 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:48 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:48 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:57:49 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:49 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:49 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:57:49 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:56548->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:57:50 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:57:50 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:50 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:50 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:50 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:50 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:57:50 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:57:51 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:51 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:51 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:51 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:57:51 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:57:52 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:52 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:52 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:52 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:57:52 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:57:52 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:53 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:54 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:54 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:54 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:54 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:54 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:55 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:57:55 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:57:55 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:56 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:56 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:57:56 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:56 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:56 [WARN] agent: Check "elasticsearch-write-health" is now warning 2021/06/17 11:57:57 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:57:57 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:57:57 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:57 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:57 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:57 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:57:57 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:57:57 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:57:57 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:57 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:57:57 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:57:58 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:57:58 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:58 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:57:58 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:57:59 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:59 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:57:59 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:57:59 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:58:00 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:58:00 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:00 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:00 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:58:00 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:58:00 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:01 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:58:01 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:02 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:02 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:02 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:58:02 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:03 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:03 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:03 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:58:03 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:03 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:58:03 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:58:04 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:04 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:04 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:04 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:58:04 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:56730->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:58:05 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:05 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:05 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:06 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:06 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:06 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:06 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:06 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:58:07 [WARN] agent: Check "mr-kafka" is now warning 2021/06/17 11:58:07 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:07 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:07 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:58:07 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:07 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:58:07 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:58:07 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:58:07 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:07 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:58:07 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:58:07 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:58:08 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:09 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:09 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:09 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:09 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:58:09 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:09 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:58:09 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:58:10 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:58:10 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:58:10 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:10 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:10 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:58:10 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:58:11 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:58:11 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:11 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:12 [WARN] agent: Check "search-data-service-api" is now warning 2021/06/17 11:58:12 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:12 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:12 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:12 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:12 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:58:13 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:13 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:58:14 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical 2021/06/17 11:58:14 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:14 [WARN] agent: Check "data-router-process" is now warning 2021/06/17 11:58:14 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:14 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:14 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:58:15 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:15 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:16 [WARN] agent: Check "sparky-be-process" is now warning 2021/06/17 11:58:16 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:16 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:58:16 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:17 [WARN] agent: Check "so-mariadb" is now warning 2021/06/17 11:58:17 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:17 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:17 [WARN] agent: Check "mr-zookeeper" is now warning 2021/06/17 11:58:17 [WARN] agent: Check "so-api-healthcheck" is now critical 2021/06/17 11:58:17 [WARN] agent: Check "clamp-mariadb" is now warning 2021/06/17 11:58:17 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning 2021/06/17 11:58:17 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:18 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:18 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:18 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:18 [WARN] agent: Check "model-loader-process" is now warning 2021/06/17 11:58:19 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:19 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:58:19 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:19 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF 2021/06/17 11:58:19 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.2.83:56910->10.96.71.193:9009: read: connection reset by peer 2021/06/17 11:58:20 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning 2021/06/17 11:58:20 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:20 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:20 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check 2021/06/17 11:58:20 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:20 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:20 [WARN] agent: Check "vid-mariadb" is now warning 2021/06/17 11:58:20 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning 2021/06/17 11:58:20 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check 2021/06/17 11:58:20 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check 2021/06/17 11:58:21 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:21 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:21 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:22 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:22 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:22 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:22 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:22 [WARN] agent: Check "so-camunda-healthcheck" is now critical 2021/06/17 11:58:23 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:23 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:58:23 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 2021/06/17 11:58:24 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:24 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:24 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:24 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:24 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:25 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF 2021/06/17 11:58:25 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:25 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check 2021/06/17 11:58:26 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:26 [WARN] agent: Check "so-jra-healthcheck" is now critical 2021/06/17 11:58:26 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving 2021/06/17 11:58:26 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request faile