By type
+ CONSUL_BIND=
+ [ -n ]
+ CONSUL_CLIENT=
+ [ -n ]
+ CONSUL_DATA_DIR=/consul/data
+ CONSUL_CONFIG_DIR=/consul/config
+ [ -n ]
+ [ a = - ]
+ [ agent = agent ]
+ shift
+ set -- consul agent -data-dir=/consul/data -config-dir=/consul/config -client 0.0.0.0 -enable-script-checks -retry-join consul-server
+ [ consul = consul ]
+ stat -c %u /consul/data
+ id -u consul
+ [ 100 != 100 ]
+ stat -c %u /consul/config
+ id -u consul
+ [ 100 != 100 ]
+ [ ! -z ]
+ exec consul agent -data-dir=/consul/data -config-dir=/consul/config -client 0.0.0.0 -enable-script-checks -retry-join consul-server
==> Starting Consul agent...
==> Consul agent running!
Version: 'v1.0.6'
Node ID: '4bc2d91d-aa60-4684-d992-740c0408ade1'
Node name: 'dev-consul-7467bf7b46-6xm62'
Datacenter: 'dc1' (Segment: '')
Server: false (Bootstrap: false)
Client Addr: [0.0.0.0] (HTTP: 8500, HTTPS: -1, DNS: 8600)
Cluster Addr: 10.242.113.229 (LAN: 8301, WAN: 8302)
Encrypt: Gossip: false, TLS-Outgoing: false, TLS-Incoming: false
==> Log data will now stream in as it occurs:
2021/05/07 11:30:51 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-6xm62 10.242.113.229
2021/05/07 11:30:51 [WARN] Service name "Health Check: Application Authorization Framework" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] Service name "Health Check: Secret Management Service (sms)" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] Service name "A&AI Synapse Data Routing Service" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] agent: check "data-router-process" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/05/07 11:30:51 [WARN] Service name "A&AI Model Loader" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] agent: check "model-loader-process" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/05/07 11:30:51 [WARN] Service name "A&AI Search Data Service" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] agent: check "elasticsearch-write-health" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/05/07 11:30:51 [WARN] agent: check "search-data-service-availability" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/05/07 11:30:51 [WARN] agent: check "search-data-service-api" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/05/07 11:30:51 [WARN] Service name "Active and Available Inventory" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] Service name "A&AI UI Backend Service" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] agent: check "sparky-be-process" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/05/07 11:30:51 [WARN] Service name "Health Check: APPC - Dgbuilder" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] Service name "Health Check: APPC" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] agent: check "appc-dbhost-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/05/07 11:30:51 [WARN] Service name "Health Check: APPC-SDN-CTL-DB-01" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] Service name "Health Check: APPC-SDN-CTL-DB-02" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] Service name "Health Check: APPC - SDN Host" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] Service name "Health Check: CLAMP" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] Service name "Health Check: CLAMP - MariaDb" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] agent: check "clamp-mariadb" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/05/07 11:30:51 [WARN] Service name "Health Check: ONAP CLI" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] Service name "Health Check: Log - Elastic Search" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] Service name "Health Check: Log - Kibana" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] Service name "Health Check: Log - Log Stash" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] Service name "Health Check: DMaaP" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] agent: check "mr-zookeeper" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/05/07 11:30:51 [WARN] agent: check "mr-kafka" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/05/07 11:30:51 [WARN] Service name "Health Check: MSB" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] Service name "Health Check: MULTICLOUD" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] Service name "Health Check: Policy" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] agent: check "Policy-mariadb-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/05/07 11:30:51 [WARN] Service name "Health Check: SDC" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] agent: check "sdc-fe-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/05/07 11:30:51 [WARN] agent: check "sdc-be-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/05/07 11:30:51 [WARN] agent: check "sdc-titan-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/05/07 11:30:51 [WARN] agent: check "sdc-cs-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/05/07 11:30:51 [WARN] Service name "Health Check: SDNC ODL Cluster" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] agent: check "sdnc-odl-cluster-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/05/07 11:30:51 [WARN] Service name "Health Check: SDNC - DB Host" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] agent: check "sdnc-dbhost-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/05/07 11:30:51 [WARN] Service name "Health Check: SDNC - DGBuilder" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] Service name "Health Check: SDNC" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] Service name "Health Check: SDNC-SDN-CTL-DB-01" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] Service name "Health Check: SDNC-SDN-CTL-DB-02" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] Service name "Health Check: SDNC - SDN Host" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] Service name "Health Check: SO" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] agent: check "so-api-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/05/07 11:30:51 [WARN] agent: check "so-camunda-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/05/07 11:30:51 [WARN] agent: check "so-jra-healthcheck" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/05/07 11:30:51 [WARN] Service name "Health Check: SO - MariaDb" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] agent: check "so-mariadb" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/05/07 11:30:51 [WARN] Service name "Health Check: VFC" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] Service name "Health Check: VID" will not be discoverable via DNS due to invalid characters. Valid characters include all alpha-numerics and dashes.
2021/05/07 11:30:51 [WARN] agent: check "vid-mariadb" has the 'script' field, which has been deprecated and replaced with the 'args' field. See https://www.consul.io/docs/agent/checks.html
2021/05/07 11:30:51 [INFO] agent: Started DNS server 0.0.0.0:8600 (tcp)
2021/05/07 11:30:51 [INFO] agent: Started DNS server 0.0.0.0:8600 (udp)
2021/05/07 11:30:51 [INFO] agent: Started HTTP server on [::]:8500 (tcp)
2021/05/07 11:30:51 [INFO] agent: started state syncer
2021/05/07 11:30:51 [INFO] agent: Retry join LAN is supported for: aliyun aws azure digitalocean gce os scaleway softlayer
2021/05/07 11:30:51 [INFO] agent: Joining LAN cluster...
2021/05/07 11:30:51 [INFO] agent: (LAN) joining: [consul-server]
2021/05/07 11:30:51 [WARN] manager: No servers available
2021/05/07 11:30:51 [ERR] agent: failed to sync remote state: No known Consul servers
2021/05/07 11:30:51 [INFO] serf: EventMemberJoin: dev-consul-server-0 10.242.113.198
2021/05/07 11:30:51 [INFO] serf: EventMemberJoin: dev-consul-server-2 10.242.139.204
2021/05/07 11:30:51 [INFO] consul: adding server dev-consul-server-0 (Addr: tcp/10.242.113.198:8300) (DC: dc1)
2021/05/07 11:30:51 [INFO] consul: adding server dev-consul-server-2 (Addr: tcp/10.242.139.204:8300) (DC: dc1)
2021/05/07 11:30:51 [INFO] agent: (LAN) joined: 2 Err:
2021/05/07 11:30:51 [INFO] agent: Join LAN completed. Synced with 2 initial agents
2021/05/07 11:30:51 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:30:51 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:30:51 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:30:52 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:30:52 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:30:52 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:30:52 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:30:52 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:30:52 [INFO] agent: Synced service "Health Check: MSB"
2021/05/07 11:30:52 [INFO] agent: Synced service "Active and Available Inventory"
2021/05/07 11:30:52 [INFO] agent: Synced service "Health Check: APPC"
2021/05/07 11:30:53 [INFO] agent: Synced service "Health Check: Log - Elastic Search"
2021/05/07 11:30:53 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:30:53 [INFO] agent: Synced service "Health Check: SDNC - DB Host"
2021/05/07 11:30:53 [INFO] agent: Synced service "Health Check: SDNC"
2021/05/07 11:30:53 [INFO] agent: Synced service "Health Check: Application Authorization Framework"
2021/05/07 11:30:53 [INFO] agent: Synced service "A&AI Model Loader"
2021/05/07 11:30:53 [INFO] agent: Synced service "Health Check: APPC - Dgbuilder"
2021/05/07 11:30:53 [INFO] agent: Synced service "Health Check: SDNC - SDN Host"
2021/05/07 11:30:53 [INFO] agent: Synced service "Health Check: SO - MariaDb"
2021/05/07 11:30:53 [INFO] agent: Synced service "Health Check: VID"
2021/05/07 11:30:53 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:30:53 [INFO] agent: Synced service "Health Check: APPC-SDN-CTL-DB-02"
2021/05/07 11:30:53 [INFO] agent: Synced service "Health Check: CLAMP"
2021/05/07 11:30:53 [INFO] agent: Synced service "Health Check: DMaaP"
2021/05/07 11:30:53 [INFO] agent: Synced service "Health Check: APPC - SDN Host"
2021/05/07 11:30:53 [INFO] agent: Synced service "Health Check: CLAMP - MariaDb"
2021/05/07 11:30:53 [INFO] agent: Synced service "Health Check: ONAP CLI"
2021/05/07 11:30:53 [INFO] agent: Synced service "Health Check: VFC"
2021/05/07 11:30:53 [INFO] agent: Synced service "Health Check: Secret Management Service (sms)"
2021/05/07 11:30:53 [INFO] agent: Synced service "A&AI UI Backend Service"
2021/05/07 11:30:53 [INFO] agent: Synced service "Health Check: APPC-SDN-CTL-DB-01"
2021/05/07 11:30:53 [INFO] agent: Synced service "A&AI Synapse Data Routing Service"
2021/05/07 11:30:53 [INFO] agent: Synced service "Health Check: SO"
2021/05/07 11:30:53 [INFO] agent: Synced service "Health Check: SDNC-SDN-CTL-DB-01"
2021/05/07 11:30:53 [INFO] agent: Synced service "Health Check: SDNC-SDN-CTL-DB-02"
2021/05/07 11:30:53 [INFO] agent: Synced service "A&AI Search Data Service"
2021/05/07 11:30:54 [INFO] agent: Synced service "Health Check: Log - Kibana"
2021/05/07 11:30:54 [INFO] agent: Synced service "Health Check: MULTICLOUD"
2021/05/07 11:30:54 [INFO] agent: Synced service "Health Check: SDNC ODL Cluster"
2021/05/07 11:30:54 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:30:54 [INFO] agent: Synced service "Health Check: SDNC - DGBuilder"
2021/05/07 11:30:54 [INFO] agent: Synced service "Health Check: Log - Log Stash"
2021/05/07 11:30:54 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:30:54 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:30:54 [INFO] agent: Synced service "Health Check: Policy"
2021/05/07 11:30:54 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:30:54 [INFO] agent: Synced service "Health Check: SDC"
2021/05/07 11:30:54 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:30:54 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:30:54 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:30:55 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:30:55 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:30:55 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:30:55 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:30:55 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:30:56 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:30:56 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:30:56 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:30:56 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:30:56 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:30:56 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:30:56 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:30:56 [INFO] agent: Synced check "vfc-nslcm"
2021/05/07 11:30:56 [INFO] agent: Synced check "aaf-sms-health"
2021/05/07 11:30:57 [INFO] agent: Synced check "sdnc-dbhost-healthcheck"
2021/05/07 11:30:57 [INFO] agent: Synced check "mr-zookeeper"
2021/05/07 11:30:57 [INFO] agent: Synced check "appc-dbhost-healthcheck"
2021/05/07 11:30:57 [INFO] agent: Synced check "vfc-vnfmgr"
2021/05/07 11:30:57 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:30:57 [INFO] agent: Synced check "vfc-vnflcm"
2021/05/07 11:30:57 [INFO] agent: Synced check "sparky-be-process"
2021/05/07 11:30:57 [INFO] agent: Synced check "Policy-mariadb-healthcheck"
2021/05/07 11:30:57 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:30:57 [INFO] agent: Synced check "vfc-vnfres"
2021/05/07 11:30:57 [INFO] agent: Synced check "sdnc-odl-cluster-healthcheck"
2021/05/07 11:30:57 [INFO] agent: Synced check "model-loader-process"
2021/05/07 11:30:57 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:30:57 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:30:57 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:30:57 [INFO] agent: Synced check "data-router-process"
2021/05/07 11:30:58 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:30:58 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:30:58 [INFO] agent: Synced check "clamp-mariadb"
2021/05/07 11:30:58 [INFO] agent: Synced check "vfc-hwvnfmdriver"
2021/05/07 11:30:58 [INFO] agent: Synced check "vfc-gvnfmdriver"
2021/05/07 11:30:58 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:30:58 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:30:58 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:30:58 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:30:58 [INFO] agent: Synced check "so-mariadb"
2021/05/07 11:30:59 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:30:59 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:30:59 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:30:59 [INFO] agent: Synced check "vid-mariadb"
2021/05/07 11:30:59 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:31:00 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:00 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:01 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:31:01 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:31:02 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:02 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:02 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:02 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:02 [INFO] agent: Synced check "aai-traversal"
2021/05/07 11:31:02 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:03 [INFO] agent: Synced check "aai-service"
2021/05/07 11:31:03 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:03 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:53520->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:31:03 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:03 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:04 [INFO] agent: Synced check "multicloud-pike"
2021/05/07 11:31:04 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:31:04 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:31:04 [INFO] agent: Synced check "aai-resources"
2021/05/07 11:31:04 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:04 [INFO] agent: Synced check "vfc-ztevnfmdriver"
2021/05/07 11:31:04 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:04 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:04 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:05 [INFO] agent: Synced check "multicloud-vio"
2021/05/07 11:31:05 [INFO] agent: Synced check "dmaap"
2021/05/07 11:31:05 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:05 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:05 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:31:05 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:31:05 [INFO] agent: Synced check "msb-discovery"
2021/05/07 11:31:05 [INFO] agent: Synced check "msb-consul"
2021/05/07 11:31:06 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:06 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:06 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:06 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:31:06 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:06 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:31:06 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:31:06 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:06 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:06 [INFO] agent: Synced check "search-data-service-api"
2021/05/07 11:31:06 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:07 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:07 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:31:07 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:07 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:31:07 [INFO] agent: Synced check "search-data-service-availability"
2021/05/07 11:31:07 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:08 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:31:08 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:31:09 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:31:09 [INFO] agent: Synced check "aaf-service"
2021/05/07 11:31:09 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:31:09 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:09 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:09 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:31:09 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:31:09 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.41.146
2021/05/07 11:31:09 [INFO] consul: adding server dev-consul-server-1 (Addr: tcp/10.242.41.146:8300) (DC: dc1)
2021/05/07 11:31:09 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:31:09 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:10 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:10 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:31:10 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:31:10 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:10 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:31:11 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:31:11 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:11 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:31:11 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:12 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:12 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:31:12 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:12 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:12 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:12 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:12 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:13 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:31:13 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:13 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:31:14 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:31:14 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:31:14 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:31:14 [WARN] agent: Check "mr-kafka" is now warning
2021/05/07 11:31:14 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:31:15 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:15 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
==> Failed to check for updates: Get https://checkpoint-api.hashicorp.com/v1/check/consul?arch=amd64&os=linux&signature=10571393-35ce-c39c-a9e8-7447e9a418c0&version=1.0.6: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:31:15 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:45076->10.242.41.146:8301: i/o timeout
2021/05/07 11:31:15 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/05/07 11:31:15 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/05/07 11:31:15 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.41.146
2021/05/07 11:31:15 [INFO] consul: removing server dev-consul-server-1 (Addr: tcp/10.242.41.146:8300) (DC: dc1)
2021/05/07 11:31:15 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:31:15 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:16 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:16 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:31:16 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:17 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:17 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:17 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:17 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:31:17 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:18 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:31:18 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:18 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:53780->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:31:18 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:31:18 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:18 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:19 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:31:19 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:19 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:19 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:31:19 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:19 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:20 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:31:20 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:20 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:20 [INFO] agent: Synced check "mr-kafka"
2021/05/07 11:31:21 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:21 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:31:21 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:21 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:31:21 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:21 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:21 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:21 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:31:22 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:22 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:22 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:22 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:31:22 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:23 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:31:23 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:31:24 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:24 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:24 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:31:24 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:31:24 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:31:24 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:31:24 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:25 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:26 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:31:26 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:31:26 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:26 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:31:26 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:27 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:27 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:27 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:27 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:27 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:28 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:31:28 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:29 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:31:29 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:31:30 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:31:30 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:30 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:31:30 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:30 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:30 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:30 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:31:30 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:31:30 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:31:30 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:31:30 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:31:31 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:31:31 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:31:31 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:31:32 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:32 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:31:34 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:31:34 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:31:34 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:31:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:35 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:35 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:35 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:35 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:35 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:54040->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:31:35 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:35 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:35 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:35 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:35 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:35 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:35 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:35 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:36 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:36 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:31:36 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:36 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:31:36 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:36 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:36 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:36 [WARN] agent: Check "elasticsearch-write-health" is now warning
2021/05/07 11:31:37 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:37 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:37 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:31:37 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:38 [INFO] agent: Synced check "elasticsearch-write-health"
2021/05/07 11:31:39 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:31:39 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:39 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:39 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:31:39 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:31:39 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:40 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:31:40 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:40 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:40 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:40 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:40 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:31:40 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:31:40 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:31:40 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:31:40 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:31:40 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:31:41 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:41 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:31:41 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:41 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:31:41 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:42 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:42 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:31:42 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:31:42 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:31:42 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:31:42 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:42 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:42 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:42 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:42 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:43 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:31:43 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:43 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:31:44 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:31:44 [WARN] agent: Check "mr-kafka" is now warning
2021/05/07 11:31:44 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:31:44 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:31:45 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:31:45 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:31:50 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:54334->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:31:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:50 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:50 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:50 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:50 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:50 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:50 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:50 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:50 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:50 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:50 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:50 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:50 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:50 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:50 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:50 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:31:50 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:50 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:50 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:31:50 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:31:50 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:31:50 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:31:50 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:31:50 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:31:51 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:51 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:51 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:31:51 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.41.146:8301
2021/05/07 11:31:51 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:31:51 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:51 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:51 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:52 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:52 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:31:53 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:31:53 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:53 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:53 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:53 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:31:53 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:31:54 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:54 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:54 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:31:54 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:31:54 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:31:54 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:31:54 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:54 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:31:55 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:31:56 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:56 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:31:56 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:56 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:31:56 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:57 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:57 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:57 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:57 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:57 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:58 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:31:58 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:31:58 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:31:58 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:31:59 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:32:00 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:00 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:00 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:00 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:00 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:32:00 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:32:00 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:32:00 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:32:00 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:32:00 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:32:00 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:32:01 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:32:01 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:32:02 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:04 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:32:04 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:32:04 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:32:04 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:32:05 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:54586->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:32:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:05 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:05 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:05 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:05 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:05 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:05 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:05 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:05 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:05 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:05 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:05 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:05 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:05 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:32:06 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:06 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:06 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:32:06 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:06 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:06 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:07 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:32:08 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.41.146
2021/05/07 11:32:08 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-x5pmr 10.242.41.137
2021/05/07 11:32:08 [INFO] consul: adding server dev-consul-server-1 (Addr: tcp/10.242.41.146:8300) (DC: dc1)
2021/05/07 11:32:08 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:32:08 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:08 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:08 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:08 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:32:09 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:09 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:09 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:32:09 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:32:09 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:10 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:10 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:10 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:10 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:10 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:32:10 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:32:10 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:32:10 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:32:10 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:32:10 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:32:10 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:32:11 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:11 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:32:11 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:32:11 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:11 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:32:11 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:12 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:12 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:12 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:12 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:12 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:12 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:13 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:32:13 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:14 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:32:14 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:32:14 [INFO] consul: New leader elected: dev-consul-server-0
2021/05/07 11:32:14 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:32:14 [WARN] agent: Check "mr-kafka" is now warning
2021/05/07 11:32:14 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:32:14 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:32:15 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:46166->10.242.41.146:8301: i/o timeout
2021/05/07 11:32:15 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/05/07 11:32:15 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:32:15 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:32:17 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:32:17 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:32:18 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:32:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:46244->10.242.41.146:8301: i/o timeout
2021/05/07 11:32:19 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/05/07 11:32:20 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:54920->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:32:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:20 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:20 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:20 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:20 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:20 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:20 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:20 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:20 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:20 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:20 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:20 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:20 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:20 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:20 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:20 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:20 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:20 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:32:20 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:32:20 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:32:20 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:32:20 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:32:20 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:32:21 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:21 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:32:21 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:21 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:32:21 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:32:21 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:21 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:21 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:22 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:23 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:32:23 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:23 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:23 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:23 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:48166->10.242.41.137:8301: i/o timeout
2021/05/07 11:32:23 [INFO] memberlist: Suspect dev-consul-7467bf7b46-x5pmr has failed, no acks received
2021/05/07 11:32:24 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:24 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:32:24 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:24 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-x5pmr 10.242.41.137
2021/05/07 11:32:24 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:32:24 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:32:24 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:24 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:32:25 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:32:26 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:26 [WARN] memberlist: Was able to connect to dev-consul-7467bf7b46-x5pmr but other probes failed, network may be misconfigured
2021/05/07 11:32:26 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:32:26 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:32:26 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:26 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:26 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:32:27 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:32:27 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:27 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:27 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:27 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:27 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:28 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:32:28 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:46394->10.242.41.146:8301: i/o timeout
2021/05/07 11:32:28 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/05/07 11:32:28 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:32:28 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:28 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.41.146
2021/05/07 11:32:28 [INFO] consul: removing server dev-consul-server-1 (Addr: tcp/10.242.41.146:8300) (DC: dc1)
2021/05/07 11:32:29 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:32:29 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:32:30 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:32:30 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:32:30 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:30 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:30 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:30 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:30 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:32:30 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:32:30 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:32:30 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:32:30 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:32:30 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:32:31 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:32:31 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:32:32 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:32 [INFO] consul: New leader elected: dev-consul-server-2
2021/05/07 11:32:33 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:32:34 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:32:35 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:32:35 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:55162->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:32:35 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:35 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:35 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:35 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:35 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:35 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:35 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:35 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:35 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:35 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:35 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:35 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:36 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:36 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:36 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:32:36 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:36 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:36 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:37 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:32:37 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:32:38 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:32:38 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:38 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:38 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:39 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:32:39 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:39 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:39 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:32:39 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:32:39 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:40 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:32:40 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:40 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:40 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:40 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:40 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:32:40 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:32:40 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:32:40 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:32:40 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:32:40 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:32:40 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:32:41 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:41 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:32:41 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:41 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:41 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:32:41 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:32:42 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:42 [WARN] agent: Check "elasticsearch-write-health" is now warning
2021/05/07 11:32:42 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:42 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:42 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:42 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:42 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:43 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:32:43 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:32:43 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:44 [WARN] agent: Check "mr-kafka" is now warning
2021/05/07 11:32:44 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:32:44 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:32:45 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:32:46 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:32:46 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:32:48 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:32:48 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:32:49 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:32:50 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:32:50 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:55446->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:32:50 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:50 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:50 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:50 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:50 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:50 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:50 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:50 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:50 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:50 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:50 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:50 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:50 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:50 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:50 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:50 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:50 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:32:50 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:32:50 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:32:50 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:32:50 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:32:50 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:32:51 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:51 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:32:51 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:32:51 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:51 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:32:51 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:51 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:51 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:51 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:32:52 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:53 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:32:53 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:53 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:53 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:54 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:54 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:54 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:32:54 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:32:54 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:54 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:32:55 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:32:56 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:56 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:32:56 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:56 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:56 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:32:57 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:57 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:57 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:57 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:57 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:58 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:32:58 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:32:59 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:32:59 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:32:59 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:32:59 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:33:00 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:00 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:00 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:00 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:00 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:33:00 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:33:00 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:33:00 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:33:00 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:33:00 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:33:01 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:33:01 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:33:01 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:33:02 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:02 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:33:02 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:33:02 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:33:04 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:33:05 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:33:05 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:55728->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:33:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:05 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:05 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:05 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:05 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:05 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:05 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:05 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:05 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:05 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:05 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:05 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:05 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:05 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:33:06 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:06 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:06 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:33:06 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:06 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:06 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:08 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:33:08 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:08 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:08 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:09 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:09 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:09 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:33:09 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:33:09 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:10 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:10 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:10 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:10 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:10 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:33:10 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:33:10 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:33:10 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:33:10 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:33:10 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:33:10 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:33:10 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:33:11 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:11 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:33:11 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:11 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:11 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:33:11 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:33:12 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:33:12 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:12 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:33:12 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:12 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:12 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:12 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:12 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:13 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:33:13 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:33:13 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:14 [WARN] agent: Check "mr-kafka" is now warning
2021/05/07 11:33:14 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:33:14 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:33:15 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:33:15 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:33:18 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:33:18 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:33:20 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:55994->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:33:20 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:20 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:20 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:20 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:20 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:20 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:20 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:20 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:20 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:20 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:20 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:20 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:20 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:20 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:20 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:20 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:20 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:33:20 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:33:20 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:33:20 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:33:20 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:33:20 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:33:21 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:21 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:33:21 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:21 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:33:21 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:33:21 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:33:21 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:21 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:21 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:21 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:33:22 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:33:22 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:23 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:33:23 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:33:23 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:23 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:23 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:24 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:33:24 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:24 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:24 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:33:24 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:33:24 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:24 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:33:25 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:33:26 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:26 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:26 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:26 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:33:27 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:27 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:27 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:27 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:27 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:28 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:33:28 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:33:28 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:29 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:33:30 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:30 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:30 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:30 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:30 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:33:30 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:33:30 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:33:30 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:33:30 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:33:31 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:33:31 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:33:31 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:33:31 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-x5pmr 10.242.41.137:8301
2021/05/07 11:33:32 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:33:32 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:32 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:33:32 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:33:34 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:33:34 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:33:34 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:33:34 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:33:35 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:33:35 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:56258->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:33:35 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:33:35 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:35 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:35 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:35 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:35 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:35 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:35 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:35 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:35 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:35 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:35 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:35 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:36 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:36 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:36 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:33:36 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:36 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:36 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-x5pmr 10.242.41.137
2021/05/07 11:33:36 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:37 [INFO] agent: Synced check "sdc-fe-healthcheck"
2021/05/07 11:33:37 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:33:38 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:33:38 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:38 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:38 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:39 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:49538->10.242.41.137:8301: i/o timeout
2021/05/07 11:33:39 [INFO] memberlist: Suspect dev-consul-7467bf7b46-x5pmr has failed, no acks received
2021/05/07 11:33:39 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:39 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:33:39 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:33:39 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:40 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:40 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:40 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:40 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:40 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:33:40 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:33:40 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:33:41 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:33:41 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:33:41 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:33:41 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:41 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:33:41 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:41 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:41 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:33:42 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:33:42 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:42 [INFO] memberlist: Marking dev-consul-7467bf7b46-x5pmr as failed, suspect timeout reached (2 peer confirmations)
2021/05/07 11:33:42 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-x5pmr 10.242.41.137
2021/05/07 11:33:42 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:42 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:42 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:42 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:42 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:43 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:33:43 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:33:43 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:33:43 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:44 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:33:44 [WARN] agent: Check "mr-kafka" is now warning
2021/05/07 11:33:44 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:33:45 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:33:45 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:33:45 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:33:46 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:33:47 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:33:48 [WARN] agent: Check "elasticsearch-write-health" is now warning
2021/05/07 11:33:49 [INFO] agent: Synced check "vfc-resmgr"
2021/05/07 11:33:50 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:33:50 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:33:50 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:56554->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:33:50 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:50 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:50 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:50 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:50 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:50 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:50 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:50 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:50 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:50 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:50 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:50 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:50 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:50 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:50 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:50 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:50 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:33:50 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:33:50 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:33:51 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:33:51 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:33:51 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:33:51 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:51 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:33:51 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:51 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:33:51 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:51 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:51 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:52 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:33:52 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:53 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:33:53 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:53 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:53 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:53 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:33:54 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:54 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:54 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:33:54 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:33:54 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:33:54 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:33:54 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:55 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:33:55 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:33:56 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:56 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:33:56 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:56 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:56 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:33:57 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:33:57 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:57 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:57 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:57 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:57 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:58 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:33:58 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:33:58 [INFO] agent: Synced check "elasticsearch"
2021/05/07 11:33:59 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:34:00 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:34:00 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:00 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:00 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:00 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:00 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:34:00 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:34:00 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:34:01 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:34:01 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:34:01 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:34:01 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:34:02 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:34:02 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:03 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:34:05 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:34:05 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:56824->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:34:05 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:05 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:05 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:05 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:05 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:05 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:05 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:05 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:05 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:05 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:05 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:05 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:05 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:34:05 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:34:05 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:34:06 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:06 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:34:06 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:34:06 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:06 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:34:06 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:06 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:06 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:07 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:34:08 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:34:08 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:08 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:08 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:08 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:34:09 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:09 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:09 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:34:09 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:34:09 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:34:09 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:10 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:10 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:10 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:10 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:11 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:34:11 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:34:11 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:34:11 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:34:11 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:34:11 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:34:11 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:11 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:34:11 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:11 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:11 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:34:12 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:34:12 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:12 [INFO] agent: Synced check "so-camunda-healthcheck"
2021/05/07 11:34:12 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:12 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:12 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:12 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:12 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:13 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:34:13 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:14 [WARN] agent: Check "mr-kafka" is now warning
2021/05/07 11:34:15 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:34:15 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:34:15 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:34:16 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:34:16 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:34:16 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:34:18 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:34:19 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:34:19 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:34:20 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:57136->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:34:20 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:20 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:20 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:20 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:20 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:20 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:20 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:20 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:20 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:20 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:20 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:20 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:20 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:20 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:20 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:20 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:21 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:34:21 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:34:21 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:34:21 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:34:21 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:34:21 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:34:21 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:21 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-x5pmr 10.242.41.137
2021/05/07 11:34:21 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:21 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:34:21 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:21 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:21 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:21 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:34:22 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:34:22 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:22 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:34:22 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:34:23 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:34:23 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:23 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:23 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:23 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:50404->10.242.41.137:8301: i/o timeout
2021/05/07 11:34:23 [INFO] memberlist: Suspect dev-consul-7467bf7b46-x5pmr has failed, no acks received
2021/05/07 11:34:24 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:24 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:24 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:34:24 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:34:24 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:25 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:34:25 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:34:25 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:34:26 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:26 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:50456->10.242.41.137:8301: i/o timeout
2021/05/07 11:34:26 [INFO] memberlist: Suspect dev-consul-7467bf7b46-x5pmr has failed, no acks received
2021/05/07 11:34:26 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:26 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:26 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:34:26 [INFO] memberlist: Marking dev-consul-7467bf7b46-x5pmr as failed, suspect timeout reached (2 peer confirmations)
2021/05/07 11:34:26 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-x5pmr 10.242.41.137
2021/05/07 11:34:27 [INFO] agent: Synced check "vid-server"
2021/05/07 11:34:27 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:34:27 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:34:27 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:27 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:27 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:27 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:27 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:28 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:34:28 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:29 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:34:29 [INFO] agent: Synced check "log-logstash-internal-server-node-stat"
2021/05/07 11:34:30 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:34:30 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:34:30 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:30 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:30 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:30 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:31 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:34:31 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:34:31 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:34:31 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:34:31 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:34:31 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:34:31 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:34:32 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:34:32 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:32 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:34:35 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:34:35 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:34:35 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:57422->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:34:35 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:35 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:35 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:35 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:35 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:35 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:35 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:35 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:35 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:35 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:35 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:35 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:35 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:34:36 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:36 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:36 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:36 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:36 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:36 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:34:38 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:34:38 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:38 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:38 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:38 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:34:38 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:34:38 [INFO] agent: Synced check "log-logstash-internal-server-os-stat"
2021/05/07 11:34:38 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:34:38 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:34:39 [INFO] agent: Synced check "policy-nexus-internal-healthcheck"
2021/05/07 11:34:39 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:39 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:39 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:34:39 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:34:40 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:40 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:34:40 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:40 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:40 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:40 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:41 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:34:41 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:34:41 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:34:41 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:34:41 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:34:41 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:34:41 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:41 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:34:41 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:41 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:41 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:34:41 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:34:41 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:34:42 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:34:42 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:42 [INFO] agent: Synced check "aai-resources"
2021/05/07 11:34:42 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:42 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:42 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:42 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:42 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:43 [INFO] agent: Synced check "vfc-workflowengineactiviti"
2021/05/07 11:34:44 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:34:44 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:44 [INFO] agent: Synced check "appc-dgbuilder"
2021/05/07 11:34:44 [WARN] agent: Check "mr-kafka" is now warning
2021/05/07 11:34:45 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:34:45 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:34:45 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:34:48 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:34:49 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.41.146
2021/05/07 11:34:49 [INFO] consul: adding server dev-consul-server-1 (Addr: tcp/10.242.41.146:8300) (DC: dc1)
2021/05/07 11:34:50 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:34:50 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:34:50 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:57718->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:34:50 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:50 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:50 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:50 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:50 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:50 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:50 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:50 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:50 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:50 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:50 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:50 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:50 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:50 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:50 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:50 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:51 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:34:51 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:34:51 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:34:51 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:34:51 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:34:51 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:34:51 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:34:51 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:51 [INFO] agent: Synced check "log-kibana-server"
2021/05/07 11:34:51 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:34:51 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:51 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:51 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:51 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:52 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:52 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:34:52 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:34:53 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-x5pmr 10.242.41.137
2021/05/07 11:34:53 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:34:53 [WARN] agent: Check "elasticsearch-write-health" is now warning
2021/05/07 11:34:53 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:53 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:53 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:34:53 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:53 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:34:54 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:54 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:54 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:34:54 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:34:54 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:34:55 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:55 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:34:55 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:34:55 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:34:56 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:57 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:34:57 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:57 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:57 [INFO] agent: Synced check "log-elasticsearch-tcp"
2021/05/07 11:34:58 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:34:58 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:58 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:58 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:58 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:58 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:34:59 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:34:59 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:00 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:35:00 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:51120->10.242.41.137:8301: i/o timeout
2021/05/07 11:35:00 [INFO] memberlist: Suspect dev-consul-7467bf7b46-x5pmr has failed, no acks received
2021/05/07 11:35:00 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:00 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:00 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:00 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:01 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:35:01 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:35:01 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:35:01 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:35:01 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:35:01 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:35:01 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:35:01 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:35:02 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:02 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:35:02 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:35:02 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:35:04 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-x5pmr 10.242.41.137
2021/05/07 11:35:04 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:35:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:49288->10.242.41.146:8301: i/o timeout
2021/05/07 11:35:04 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:51174->10.242.41.137:8301: i/o timeout
2021/05/07 11:35:04 [INFO] memberlist: Suspect dev-consul-7467bf7b46-x5pmr has failed, no acks received
2021/05/07 11:35:04 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:35:04 [INFO] agent: Synced check "odl-api-healthcheck"
2021/05/07 11:35:05 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:35:05 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:58014->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:35:05 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:05 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:05 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:05 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:05 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:05 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:05 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:05 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:05 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:05 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:05 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:05 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:05 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:35:06 [INFO] agent: Synced check "sdnctldb02"
2021/05/07 11:35:06 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:06 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:06 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:06 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:06 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:07 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:35:07 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:49346->10.242.41.146:8301: i/o timeout
2021/05/07 11:35:07 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/05/07 11:35:07 [INFO] agent: Synced check "vfc-workflow"
2021/05/07 11:35:08 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:35:08 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:08 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:08 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:08 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:35:09 [INFO] agent: Synced check "sdnc-sdnhost"
2021/05/07 11:35:09 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/05/07 11:35:09 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.41.146
2021/05/07 11:35:09 [INFO] consul: removing server dev-consul-server-1 (Addr: tcp/10.242.41.146:8300) (DC: dc1)
2021/05/07 11:35:09 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:09 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:09 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:35:09 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:35:10 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:10 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:10 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:10 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:10 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:10 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:35:11 [INFO] agent: Synced check "sdc-cs-healthcheck"
2021/05/07 11:35:11 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:11 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:35:11 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:35:11 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:35:11 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:35:11 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:35:11 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:35:11 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:35:12 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:35:12 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:35:12 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:12 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:12 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:12 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:35:12 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:35:12 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:35:13 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.41.146
2021/05/07 11:35:13 [INFO] consul: adding server dev-consul-server-1 (Addr: tcp/10.242.41.146:8300) (DC: dc1)
2021/05/07 11:35:13 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:35:13 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:13 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:13 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:13 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:13 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:14 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:35:14 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:14 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:35:14 [WARN] agent: Check "mr-kafka" is now warning
2021/05/07 11:35:15 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:35:15 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:35:15 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:35:16 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:35:16 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:49600->10.242.41.146:8301: i/o timeout
2021/05/07 11:35:16 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/05/07 11:35:19 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:49640->10.242.41.146:8301: i/o timeout
2021/05/07 11:35:19 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/05/07 11:35:20 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.41.146
2021/05/07 11:35:20 [INFO] consul: removing server dev-consul-server-1 (Addr: tcp/10.242.41.146:8300) (DC: dc1)
2021/05/07 11:35:20 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:58348->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:35:20 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:35:20 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:20 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:20 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:20 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:20 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:20 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:20 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:20 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:20 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:20 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:20 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:20 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:20 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:20 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:20 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:20 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:21 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:21 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:35:21 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:35:21 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:35:21 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:35:21 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:35:21 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:35:21 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:21 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:21 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:21 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:22 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:22 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:35:22 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:35:23 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:35:23 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:35:23 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:35:23 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:35:23 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:23 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:23 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:23 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:35:23 [INFO] agent: Synced check "vfc-nokiavnfmdriver"
2021/05/07 11:35:24 [INFO] agent: Synced check "policy-nexus-local-status"
2021/05/07 11:35:24 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:35:24 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:24 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:25 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:35:25 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:35:25 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:25 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:35:26 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:26 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:35:26 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:35:26 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:35:27 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:35:27 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:27 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:27 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:35:28 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:28 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:28 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:28 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:28 [INFO] agent: Synced check "log-logstash-internal-server-jvm-stat"
2021/05/07 11:35:28 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:29 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.41.146
2021/05/07 11:35:29 [INFO] consul: adding server dev-consul-server-1 (Addr: tcp/10.242.41.146:8300) (DC: dc1)
2021/05/07 11:35:29 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:29 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:35:29 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-x5pmr 10.242.41.137
2021/05/07 11:35:30 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:35:30 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:35:30 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:30 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:30 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:30 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:31 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:35:31 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:35:31 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:35:31 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:35:31 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:35:31 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:35:32 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:32 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:49906->10.242.41.146:8301: i/o timeout
2021/05/07 11:35:32 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/05/07 11:35:32 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:35:32 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:35:33 [INFO] agent: Synced check "sdnc-dgbuilder"
2021/05/07 11:35:34 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:35:34 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:35:35 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:35:35 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:58616->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:35:35 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:51802->10.242.41.137:8301: i/o timeout
2021/05/07 11:35:35 [INFO] memberlist: Suspect dev-consul-7467bf7b46-x5pmr has failed, no acks received
2021/05/07 11:35:35 [INFO] memberlist: Marking dev-consul-7467bf7b46-x5pmr as failed, suspect timeout reached (2 peer confirmations)
2021/05/07 11:35:35 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-x5pmr 10.242.41.137
2021/05/07 11:35:35 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:35:35 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:35 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:35 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:35 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:35 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:35 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:35 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:35 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:35 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:35 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:35 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:35 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:36 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:36 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:35:36 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/05/07 11:35:36 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.41.146
2021/05/07 11:35:36 [INFO] consul: removing server dev-consul-server-1 (Addr: tcp/10.242.41.146:8300) (DC: dc1)
2021/05/07 11:35:36 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:35:36 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:36 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.41.146:8301
2021/05/07 11:35:36 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:36 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:36 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:37 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:35:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:49984->10.242.41.146:8301: i/o timeout
2021/05/07 11:35:37 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/05/07 11:35:37 [WARN] agent: Check "multicloud-vio" HTTP request failed: Head http://multicloud-vio:9004/api/multicloud-vio/v0/swagger.json: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:35:38 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:35:38 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:39 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:35:39 [INFO] agent: Synced check "multicloud-vio"
2021/05/07 11:35:39 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:39 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:39 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:39 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:35:39 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:40 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:35:40 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:35:40 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:40 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:40 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:40 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:40 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:41 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:41 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:35:41 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:35:41 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:35:41 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:35:41 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:35:41 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:35:41 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.41.146
2021/05/07 11:35:41 [INFO] consul: adding server dev-consul-server-1 (Addr: tcp/10.242.41.146:8300) (DC: dc1)
2021/05/07 11:35:42 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:35:42 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:42 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:42 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:35:43 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:35:43 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:43 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:35:43 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:35:43 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:43 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:43 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:43 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:43 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:44 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:50128->10.242.41.146:8301: i/o timeout
2021/05/07 11:35:44 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/05/07 11:35:44 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:44 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:35:44 [WARN] agent: Check "mr-kafka" is now warning
2021/05/07 11:35:45 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:35:45 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:35:45 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:35:45 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:35:46 [INFO] agent: Synced check "sdc-catalog-healthcheck"
2021/05/07 11:35:46 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:35:46 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:35:46 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:35:46 [INFO] agent: Synced check "log-logstash-internal-server-gi"
2021/05/07 11:35:46 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.41.146
2021/05/07 11:35:46 [INFO] consul: removing server dev-consul-server-1 (Addr: tcp/10.242.41.146:8300) (DC: dc1)
2021/05/07 11:35:48 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:35:50 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:58922->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:35:50 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:50 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:50 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:50 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:50 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:50 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:50 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:50 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:50 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:50 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:50 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:50 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:50 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:50 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:50 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:50 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:51 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:51 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:35:51 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:35:51 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:35:51 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:35:51 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:35:51 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:35:51 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:51 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:51 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:51 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:52 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:35:53 [INFO] agent: Synced check "multicloud-vio"
2021/05/07 11:35:53 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:53 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:35:53 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:35:54 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:35:54 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:54 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:54 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:54 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:54 [ERR] memberlist: failed to receive: read tcp 10.242.113.229:8301->10.242.41.146:57366: i/o timeout from=10.242.41.146:57366
2021/05/07 11:35:54 [INFO] agent: Synced check "vfc-catalog"
2021/05/07 11:35:54 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:35:54 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:54 [ERR] memberlist: Failed to send error: write tcp 10.242.113.229:8301->10.242.41.146:57366: i/o timeout from=10.242.41.146:57366
2021/05/07 11:35:55 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:35:55 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:35:55 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:55 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:35:55 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:35:56 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:56 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:35:56 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:35:56 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:35:57 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:35:57 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:57 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:57 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:35:58 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:35:58 [INFO] agent: Synced check "vfc-emsdriver"
2021/05/07 11:35:58 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:58 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:58 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:58 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:58 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:59 [WARN] agent: Check "elasticsearch-write-health" is now warning
2021/05/07 11:35:59 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:35:59 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:35:59 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:35:59 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:36:00 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:36:00 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:00 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:00 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:00 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:01 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:36:01 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:36:01 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:36:01 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:36:01 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:36:01 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:36:01 [WARN] memberlist: Refuting a suspect message (from: dev-consul-server-1)
2021/05/07 11:36:02 [INFO] agent: Synced check "log-logstash-tcp"
2021/05/07 11:36:02 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:36:03 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:03 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:36:03 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:36:05 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:36:05 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:59160->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:36:05 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:05 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:05 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:05 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:05 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:05 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:05 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:05 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:05 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:05 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:05 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:05 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:06 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:06 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:36:06 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:07 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:07 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:07 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:07 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:36:07 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:36:07 [INFO] agent: Synced check "appc-sdnctldb01"
2021/05/07 11:36:07 [INFO] agent: Synced check "msb-iag"
2021/05/07 11:36:08 [INFO] agent: Synced check "vfc-jujudriver"
2021/05/07 11:36:08 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:36:09 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.41.146
2021/05/07 11:36:09 [INFO] consul: adding server dev-consul-server-1 (Addr: tcp/10.242.41.146:8300) (DC: dc1)
2021/05/07 11:36:09 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-x5pmr 10.242.41.137
2021/05/07 11:36:09 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:36:09 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:09 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:09 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:09 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:09 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:36:09 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:09 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:36:10 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:36:10 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:10 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:36:10 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:36:10 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:10 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:10 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:10 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:11 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:11 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:36:12 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:36:12 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:36:12 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:36:12 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:36:12 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:36:12 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:36:13 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:13 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:13 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:13 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:36:13 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:36:13 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:13 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:13 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:36:13 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:13 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:13 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:14 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:14 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:36:14 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:36:14 [WARN] agent: Check "mr-kafka" is now warning
2021/05/07 11:36:15 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:36:15 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:36:15 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:36:16 [ERR] consul: "Catalog.NodeServices" RPC failed to server 10.242.139.204:8300: rpc error making call: No cluster leader
2021/05/07 11:36:16 [ERR] agent: failed to sync remote state: rpc error making call: No cluster leader
2021/05/07 11:36:17 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:36:18 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:36:18 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:36:18 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:36:20 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:59434->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:36:20 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:20 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:20 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:20 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:20 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:20 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:20 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:20 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:20 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:20 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:20 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:20 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:20 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:20 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:20 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:20 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:36:20 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:21 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:52660->10.242.41.137:8301: i/o timeout
2021/05/07 11:36:21 [INFO] memberlist: Suspect dev-consul-7467bf7b46-x5pmr has failed, no acks received
2021/05/07 11:36:21 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:36:22 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:36:22 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:36:22 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:36:22 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:36:22 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:36:22 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:36:22 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:22 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:22 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:22 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:22 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:23 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:23 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:36:23 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:36:24 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:36:24 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:36:24 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:24 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:24 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:24 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:24 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:36:24 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:25 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:36:25 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:36:25 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:25 [INFO] memberlist: Marking dev-consul-7467bf7b46-x5pmr as failed, suspect timeout reached (2 peer confirmations)
2021/05/07 11:36:25 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-x5pmr 10.242.41.137
2021/05/07 11:36:25 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:36:25 [INFO] consul: New leader elected: dev-consul-server-2
2021/05/07 11:36:25 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-x5pmr 10.242.41.137
2021/05/07 11:36:25 [WARN] memberlist: Was able to connect to dev-consul-7467bf7b46-x5pmr but other probes failed, network may be misconfigured
2021/05/07 11:36:26 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:27 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:36:27 [INFO] agent: Synced check "log-logstash-internal-server-os-info"
2021/05/07 11:36:27 [INFO] agent: Synced check "log-logstash-internal-server-plugin-info"
2021/05/07 11:36:27 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:36:27 [INFO] agent: Synced check "pap"
2021/05/07 11:36:27 [INFO] agent: Synced check "log-logstash-internal-server-jvm-info"
2021/05/07 11:36:28 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:28 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:28 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:36:28 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:28 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:28 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:28 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:28 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:29 [INFO] agent: Synced check "sdnctldb01"
2021/05/07 11:36:29 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:36:29 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:29 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:36:29 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:36:30 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:36:30 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:52828->10.242.41.137:8301: i/o timeout
2021/05/07 11:36:30 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:36:30 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:30 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:30 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:30 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:31 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:36:31 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:36:32 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:36:32 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:36:32 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:36:32 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:36:32 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:36:32 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:36:32 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:36:33 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:33 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:36:33 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:36:34 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:36:35 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:36:35 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:59692->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:36:35 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:35 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:35 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:35 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:35 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:35 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:35 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:35 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:35 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:35 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:35 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:35 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:36 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:52914->10.242.41.137:8301: i/o timeout
2021/05/07 11:36:36 [INFO] memberlist: Suspect dev-consul-7467bf7b46-x5pmr has failed, no acks received
2021/05/07 11:36:37 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:37 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:37 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:37 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:37 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:37 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:36:39 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:36:39 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:39 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:39 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:39 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:39 [WARN] memberlist: Refuting a suspect message (from: dev-consul-7467bf7b46-x5pmr)
2021/05/07 11:36:39 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:36:39 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:40 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:36:40 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:36:40 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:40 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:36:40 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:36:40 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:36:40 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:40 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:40 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:40 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:41 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:41 [INFO] agent: Synced check "so-api-healthcheck"
2021/05/07 11:36:42 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:36:42 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:36:42 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:36:42 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:36:42 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:36:42 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:36:42 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:36:43 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:36:43 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:36:43 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:43 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:43 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:43 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:36:43 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:43 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:43 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:43 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:43 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:44 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:36:44 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:36:44 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:36:44 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:44 [WARN] agent: Check "mr-kafka" is now warning
2021/05/07 11:36:45 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:36:45 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:36:46 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:36:47 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:36:47 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:36:49 [INFO] agent: Synced check "msb-eag"
2021/05/07 11:36:49 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:53154->10.242.41.137:8301: i/o timeout
2021/05/07 11:36:49 [INFO] memberlist: Suspect dev-consul-7467bf7b46-x5pmr has failed, no acks received
2021/05/07 11:36:50 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:59978->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:36:50 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:36:50 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:50 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:50 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:50 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:50 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:50 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:50 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:50 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:50 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:50 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:50 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:50 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:50 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:50 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:50 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:50 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:51 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:36:51 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:36:52 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:36:52 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:36:52 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:36:52 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:36:52 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:36:52 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:36:52 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:52 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:52 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:52 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:52 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:53 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-x5pmr 10.242.41.137
2021/05/07 11:36:53 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:51340->10.242.41.146:8301: i/o timeout
2021/05/07 11:36:53 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/05/07 11:36:53 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:53 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:36:54 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:36:54 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:36:54 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:36:54 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:36:54 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:54 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:54 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:54 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:54 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:54 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:36:55 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:36:55 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:36:55 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:55 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:36:56 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:56 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:51404->10.242.41.146:8301: i/o timeout
2021/05/07 11:36:56 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/05/07 11:36:56 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:36:57 [INFO] agent: Synced check "so-jra-healthcheck"
2021/05/07 11:36:57 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.41.146
2021/05/07 11:36:57 [INFO] consul: removing server dev-consul-server-1 (Addr: tcp/10.242.41.146:8300) (DC: dc1)
2021/05/07 11:36:57 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:36:58 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:51464->10.242.41.146:8301: i/o timeout
2021/05/07 11:36:58 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/05/07 11:36:58 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:58 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:58 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:36:58 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:58 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:58 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:58 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:58 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:59 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:36:59 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:36:59 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:36:59 [INFO] agent: Synced check "log-elasticsearch-server"
2021/05/07 11:37:00 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:37:00 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:00 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:00 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:00 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:02 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:37:02 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:37:02 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:37:02 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:37:02 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:37:02 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:37:02 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:37:02 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:37:02 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:37:03 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:37:03 [INFO] agent: Synced check "sdc-titan-healthcheck"
2021/05/07 11:37:03 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:04 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:37:04 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:37:04 [WARN] agent: Check "elasticsearch-write-health" is now warning
2021/05/07 11:37:04 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:37:05 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:37:05 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:60244->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:37:05 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:37:05 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:05 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:05 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:05 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:05 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:05 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:05 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:05 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:05 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:05 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:05 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:05 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:06 [INFO] agent: Synced check "drools"
2021/05/07 11:37:06 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:37:07 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:07 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:07 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:07 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:07 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:07 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:37:09 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:37:09 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:09 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:09 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:09 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:09 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:09 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:37:10 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:37:10 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:10 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:37:10 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:10 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:10 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:10 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:11 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:11 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-x5pmr 10.242.41.137:8301
2021/05/07 11:37:11 [INFO] agent: Synced check "aai-service"
2021/05/07 11:37:12 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:37:12 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:37:12 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:37:12 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:37:12 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:37:12 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:37:12 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:37:13 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.41.146
2021/05/07 11:37:13 [INFO] consul: adding server dev-consul-server-1 (Addr: tcp/10.242.41.146:8300) (DC: dc1)
2021/05/07 11:37:13 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:37:13 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:13 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:37:13 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:13 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:13 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:37:13 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:13 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:13 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:13 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:13 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:14 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:37:14 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:37:14 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:37:14 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:14 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-x5pmr 10.242.41.137
2021/05/07 11:37:14 [WARN] agent: Check "mr-kafka" is now warning
2021/05/07 11:37:15 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:37:15 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:37:15 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:37:15 [INFO] agent: Synced check "log-logstash-internal-server-process-stat"
2021/05/07 11:37:15 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:37:15 [INFO] agent: Synced check "appc-sdnhost"
2021/05/07 11:37:16 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:37:17 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:37:18 [INFO] agent: Synced check "multicloud-windriver"
2021/05/07 11:37:18 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:37:19 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:37:20 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:60524->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:37:20 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:20 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:20 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:20 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:20 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:20 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:20 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:20 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:20 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:20 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:20 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:20 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:20 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:20 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:20 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:20 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:22 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:37:22 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:37:22 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:37:22 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:37:22 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:37:22 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:37:22 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:37:22 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:22 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:22 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:22 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:22 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:23 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:24 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:37:24 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:37:24 [INFO] agent: Synced check "vfc-nokiav2vnfmdriver"
2021/05/07 11:37:24 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:37:24 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:24 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:24 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:24 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:24 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:37:24 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:37:24 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:24 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:37:25 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:37:25 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:25 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:37:25 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:37:26 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:26 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:37:27 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:53858->10.242.41.137:8301: i/o timeout
2021/05/07 11:37:27 [INFO] memberlist: Suspect dev-consul-7467bf7b46-x5pmr has failed, no acks received
2021/05/07 11:37:27 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:37:28 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:37:28 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:37:28 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:28 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:28 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:37:28 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:28 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:28 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:28 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:28 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:29 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:37:29 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:30 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:37:30 [INFO] agent: Synced check "sdc-be-healthcheck"
2021/05/07 11:37:30 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:30 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:30 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:30 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:31 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-x5pmr 10.242.41.137
2021/05/07 11:37:31 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:37:32 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-x5pmr 10.242.41.137
2021/05/07 11:37:32 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:37:32 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:37:32 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:37:32 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:37:32 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:37:32 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:37:33 [INFO] agent: Synced check "policy-nexus-internal-metrics"
2021/05/07 11:37:33 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:34 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:37:34 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:37:34 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:53958->10.242.41.137:8301: i/o timeout
2021/05/07 11:37:34 [INFO] memberlist: Suspect dev-consul-7467bf7b46-x5pmr has failed, no acks received
2021/05/07 11:37:34 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:37:35 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:37:35 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:37:35 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:60790->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:37:35 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:37:35 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:37:35 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:35 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:35 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:35 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:35 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:35 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:35 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:35 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:35 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:35 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:35 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:35 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:36 [INFO] agent: Synced check "pdp"
2021/05/07 11:37:37 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:37 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:37 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:37 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:37 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:37 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:37:38 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:37:38 [INFO] memberlist: Marking dev-consul-7467bf7b46-x5pmr as failed, suspect timeout reached (2 peer confirmations)
2021/05/07 11:37:38 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-x5pmr 10.242.41.137
2021/05/07 11:37:38 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:37:38 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:37:39 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:52220->10.242.41.146:8301: i/o timeout
2021/05/07 11:37:39 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/05/07 11:37:39 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:37:39 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:39 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:39 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:39 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:39 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:39 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:37:39 [INFO] memberlist: Marking dev-consul-server-1 as failed, suspect timeout reached (2 peer confirmations)
2021/05/07 11:37:39 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.41.146
2021/05/07 11:37:39 [INFO] consul: removing server dev-consul-server-1 (Addr: tcp/10.242.41.146:8300) (DC: dc1)
2021/05/07 11:37:40 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:37:40 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:40 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:37:40 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:40 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:40 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:40 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:41 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:42 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:37:42 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:37:42 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:37:42 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:37:42 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:37:42 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:37:43 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:43 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:43 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:43 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:37:43 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:43 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:43 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:43 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:44 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:44 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:37:44 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:37:44 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:37:44 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:37:44 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:44 [WARN] agent: Check "mr-kafka" is now warning
2021/05/07 11:37:45 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:37:45 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:37:46 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:37:46 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:37:47 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:37:48 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:37:48 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:37:49 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:37:50 [INFO] agent: Synced check "brmsgw-tcp"
2021/05/07 11:37:50 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:32862->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:37:50 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:50 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:50 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:50 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:50 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:50 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:50 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:50 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:50 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:50 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:50 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:50 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:50 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:37:50 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:50 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:50 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:50 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:51 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:37:52 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:37:52 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:37:52 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:37:52 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:37:52 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:37:52 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:37:52 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:52 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:52 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:52 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:52 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:53 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:54 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:37:54 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:37:54 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:37:54 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:37:54 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:54 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:54 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:54 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:54 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:54 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:37:55 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:37:55 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:55 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:37:55 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:37:56 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:57 [INFO] agent: Synced check "vfc-ztesdncdriver"
2021/05/07 11:37:57 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:37:57 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:37:58 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:37:58 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:58 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:58 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:37:58 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:58 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:58 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:58 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:59 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:59 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:37:59 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:37:59 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:38:00 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:38:00 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:38:00 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:38:00 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:00 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:00 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:00 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:02 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:38:02 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:38:02 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:38:02 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:38:02 [INFO] agent: Synced check "clamp-health"
2021/05/07 11:38:02 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:38:02 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:38:03 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:38:03 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:04 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:38:04 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:38:05 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:38:05 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:33104->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:38:05 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:05 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:05 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:05 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:05 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:05 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:05 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:05 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:05 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:05 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:05 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:05 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:06 [INFO] agent: Synced check "framework"
2021/05/07 11:38:06 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:38:07 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:38:07 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:07 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:07 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:07 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:07 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:08 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:38:08 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:38:08 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:38:09 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:38:09 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:09 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:09 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:09 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:09 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:09 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:38:10 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:38:10 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:10 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:38:10 [WARN] agent: Check "elasticsearch-write-health" is now warning
2021/05/07 11:38:10 [ERR] memberlist: failed to receive: read tcp 10.242.113.229:8301->10.242.41.146:59550: i/o timeout from=10.242.41.146:59550
2021/05/07 11:38:10 [ERR] memberlist: Failed to send error: write tcp 10.242.113.229:8301->10.242.41.146:59550: i/o timeout from=10.242.41.146:59550
2021/05/07 11:38:10 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:38:10 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:38:10 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:10 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:10 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:10 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:11 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:11 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:38:12 [INFO] agent: Synced check "so-camunda-healthcheck"
2021/05/07 11:38:12 [INFO] agent: Synced check "multicloud-starlingx"
2021/05/07 11:38:12 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:38:12 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:38:12 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:38:12 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:38:12 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:38:12 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:38:13 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:13 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:13 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:13 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:38:13 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:13 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:13 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:13 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:14 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:14 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:38:14 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:38:14 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:38:14 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:14 [WARN] agent: Check "mr-kafka" is now warning
2021/05/07 11:38:15 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:38:15 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:38:15 [INFO] agent: Synced check "appc-sdnctldb02"
2021/05/07 11:38:16 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:38:18 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:38:19 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:38:19 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:38:19 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:38:20 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:33402->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:38:20 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:20 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:20 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:20 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:20 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:20 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:20 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:20 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:20 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:20 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:20 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:20 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:20 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:20 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:20 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:21 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:21 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:38:22 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:38:22 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:38:22 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:38:22 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:38:22 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:38:22 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:38:22 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:38:22 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:22 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:22 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:22 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:22 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:22 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:38:23 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:38:23 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:24 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:38:24 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:38:24 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:38:24 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:24 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:24 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:24 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:24 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:24 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:38:25 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:38:25 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:25 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:38:25 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:38:26 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:26 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:38:28 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:38:28 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:28 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:28 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:38:28 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:28 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:28 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:28 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:29 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:29 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:38:29 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:30 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:38:30 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:38:30 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:38:31 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:31 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:31 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:31 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:32 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:38:32 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:38:32 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:38:32 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:38:32 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:38:32 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:38:32 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:38:32 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:38:33 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:38:33 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:34 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:38:34 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:38:35 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:38:35 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:38:35 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:33658->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:38:35 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:35 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:35 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:35 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:35 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:35 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:35 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:35 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:35 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:35 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:35 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:35 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:37 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:37 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:37 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:37 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:37 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:38 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:38:38 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:38:39 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:38:39 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:38:39 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:39 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:39 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:39 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:39 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:39 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:38:40 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:38:40 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:40 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:38:41 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:41 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:41 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:41 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:41 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:41 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:38:41 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:38:42 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:38:42 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:38:42 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:38:42 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:38:42 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:38:42 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:38:42 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:38:43 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:43 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:38:43 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:43 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:43 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:38:43 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:43 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:43 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:43 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:44 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:44 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:38:44 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:38:44 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:38:44 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:38:44 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:44 [WARN] agent: Check "mr-kafka" is now warning
2021/05/07 11:38:45 [INFO] serf: attempting reconnect to dev-consul-7467bf7b46-x5pmr 10.242.41.137:8301
2021/05/07 11:38:45 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:38:45 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:38:48 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:38:48 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:38:50 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:33944->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:38:50 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:50 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:50 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:50 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:50 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:50 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:50 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:50 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:50 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:50 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:50 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:50 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:51 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:51 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:51 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:51 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:51 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:38:52 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:38:52 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:38:52 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:38:52 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:38:52 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:38:52 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:38:52 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:52 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:38:52 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:38:52 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:52 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:52 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:52 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:53 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:54 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:38:54 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:38:54 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:38:54 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:54 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:54 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:54 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:54 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:54 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:38:54 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:38:54 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:38:55 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:38:55 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:55 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:38:55 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:38:55 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:38:55 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:38:56 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:58 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:38:58 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:38:58 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:58 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:58 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:38:58 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:58 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:58 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:58 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:59 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:38:59 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:38:59 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:00 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:39:01 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:01 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:01 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:01 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:02 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:39:02 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:39:02 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:39:02 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:39:02 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:39:02 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:39:03 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:39:03 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:39:03 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:04 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:39:04 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:39:04 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:39:05 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:39:05 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:34194->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:39:05 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:05 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:05 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:05 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:05 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:05 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:05 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:05 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:05 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:05 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:05 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:05 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:05 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:39:06 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:39:07 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:39:07 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:07 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:07 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:07 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:07 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:08 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:39:09 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:39:09 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:09 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:09 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:09 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:09 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:09 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:39:10 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:39:10 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:10 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:39:10 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:39:11 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:11 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:11 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:11 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:11 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:11 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:39:12 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:39:12 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:39:12 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:39:12 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:39:12 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:39:12 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:39:13 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:13 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:13 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:13 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:39:13 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:14 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:14 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:14 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:14 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:14 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:39:14 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:39:14 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:39:14 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:39:14 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:14 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:39:14 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:39:14 [WARN] agent: Check "mr-kafka" is now warning
2021/05/07 11:39:15 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:39:15 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:39:15 [WARN] agent: Check "elasticsearch-write-health" is now warning
2021/05/07 11:39:16 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:39:17 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:39:18 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:39:20 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:34474->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:39:20 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:39:20 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:20 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:20 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:20 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:20 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:20 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:20 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:20 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:20 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:20 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:20 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:20 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:21 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:21 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:21 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:21 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:22 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:22 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:22 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:22 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:22 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:22 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:39:22 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:39:22 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:39:22 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:39:22 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:39:22 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:39:23 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:39:23 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:24 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:39:24 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:39:24 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:39:24 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:24 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:24 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:24 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:24 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:25 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:39:25 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:39:25 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:25 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:39:25 [INFO] serf: attempting reconnect to dev-consul-server-1 10.242.41.146:8301
2021/05/07 11:39:25 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:39:25 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:39:25 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:39:26 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:26 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:39:27 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:39:27 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:39:28 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:39:28 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:39:28 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:28 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:28 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:39:28 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:29 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:29 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:29 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:29 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:29 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:39:29 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:30 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:39:30 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:39:31 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:31 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:31 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:31 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:32 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:39:32 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:39:32 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:39:32 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:39:32 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:39:32 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:39:33 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:34 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:39:34 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:39:35 [ERR] memberlist: failed to receive: read tcp 10.242.113.229:8301->10.242.41.137:41036: i/o timeout from=10.242.41.137:41036
2021/05/07 11:39:35 [ERR] memberlist: Failed to send error: write tcp 10.242.113.229:8301->10.242.41.137:41036: i/o timeout from=10.242.41.137:41036
2021/05/07 11:39:35 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:39:35 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:34724->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:39:35 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:35 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:35 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:35 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:35 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:35 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:35 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:35 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:35 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:35 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:35 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:35 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:36 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:39:36 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:39:36 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:39:37 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:37 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:37 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:37 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:37 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:38 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:39:38 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:39:39 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:39:39 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:39:39 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:39:39 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:39 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:39 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:39 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:39 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:40 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:39:40 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:39:40 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:40 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:39:41 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:41 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:41 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:41 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:41 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:42 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:39:42 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:39:42 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:39:42 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:39:42 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:39:42 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:39:42 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:39:43 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:39:43 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:43 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:44 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:39:44 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:44 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:44 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:44 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:44 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:44 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:44 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:39:44 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:44 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:39:44 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:39:44 [WARN] agent: Check "mr-kafka" is now warning
2021/05/07 11:39:45 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:39:45 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:39:46 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:39:47 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:39:47 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:39:48 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:39:49 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:39:50 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:35016->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:39:50 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:39:50 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:50 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:50 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:50 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:50 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:50 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:50 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:50 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:50 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:50 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:50 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:50 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:51 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:51 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:51 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:51 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:52 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:39:52 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:52 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:52 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:52 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:52 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:52 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:39:52 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:39:52 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:39:52 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:39:52 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:39:52 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:39:53 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:54 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:39:54 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:54 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:54 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:54 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:54 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:39:54 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:39:54 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:55 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:39:55 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:39:55 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:55 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:39:55 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:39:55 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:39:56 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:58 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:39:58 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:39:58 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:39:58 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:39:58 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:59 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:59 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:39:59 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:59 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:59 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:59 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:59 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:39:59 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:39:59 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:39:59 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:00 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:40:00 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:40:01 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:01 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:01 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:01 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:01 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:40:02 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:40:02 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:40:02 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:40:02 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:40:02 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:40:02 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:40:02 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:40:03 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:04 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:40:04 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:40:05 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:40:05 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:35262->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:40:05 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:05 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:05 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:05 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:05 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:05 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:05 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:05 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:05 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:05 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:05 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:05 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:07 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:07 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:07 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:07 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:07 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:08 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:40:08 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:40:09 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:40:09 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:40:09 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:09 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:40:09 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:09 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:09 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:09 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:10 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:40:10 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:40:10 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:10 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:40:11 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:11 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:11 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:11 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:11 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:40:11 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:11 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:40:12 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:40:12 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:40:12 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:40:12 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:40:12 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:40:12 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:40:12 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:40:13 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:13 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:14 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:40:14 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:14 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:14 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:14 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:14 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:14 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:14 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:40:14 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:14 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:40:14 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:40:14 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:40:14 [WARN] agent: Check "mr-kafka" is now warning
2021/05/07 11:40:15 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:40:15 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:40:15 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:40:17 [INFO] agent: Synced check "so-jra-healthcheck"
2021/05/07 11:40:18 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:40:18 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:40:20 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:35544->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:40:20 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:40:20 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:40:20 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:20 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:20 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:20 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:20 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:20 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:20 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:20 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:20 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:20 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:20 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:20 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:21 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:21 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:21 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:21 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:21 [WARN] agent: Check "elasticsearch-write-health" is now warning
2021/05/07 11:40:22 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:22 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:22 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:22 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:22 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:22 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:40:22 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:40:22 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:40:22 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:40:22 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:40:22 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:40:22 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:40:23 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:40:23 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:24 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:40:24 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:40:24 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:24 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:24 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:24 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:24 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:24 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:40:24 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:40:25 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:40:25 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:25 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:40:25 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:40:25 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:40:26 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:27 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:40:28 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:40:28 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:29 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:29 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:29 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:40:29 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:29 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:29 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:29 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:29 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:40:29 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:30 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:40:30 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:40:31 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:31 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:31 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:31 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:31 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:40:31 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:40:31 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:40:32 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:40:32 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:40:32 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:40:32 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:40:32 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:40:32 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:40:32 [INFO] agent: Synced check "aai-service"
2021/05/07 11:40:33 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:33 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:40:34 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:40:34 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:40:34 [INFO] serf: EventMemberJoin: dev-consul-server-1 10.242.41.146
2021/05/07 11:40:34 [INFO] consul: adding server dev-consul-server-1 (Addr: tcp/10.242.41.146:8300) (DC: dc1)
2021/05/07 11:40:34 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:40:34 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:40:35 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:40:35 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:35798->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:40:35 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:35 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:35 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:35 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:35 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:35 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:35 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:35 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:35 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:35 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:35 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:35 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:35 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:37 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:55418->10.242.41.146:8301: i/o timeout
2021/05/07 11:40:37 [INFO] memberlist: Suspect dev-consul-server-1 has failed, no acks received
2021/05/07 11:40:37 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:37 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:37 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:37 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:37 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:38 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:40:39 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:40:39 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:39 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:39 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:39 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:39 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:40 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:40:40 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:40 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:40:40 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:40:40 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:40:41 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:41 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:41 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:41 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:41 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:42 [INFO] serf: EventMemberFailed: dev-consul-server-1 10.242.41.146
2021/05/07 11:40:42 [INFO] consul: removing server dev-consul-server-1 (Addr: tcp/10.242.41.146:8300) (DC: dc1)
2021/05/07 11:40:42 [WARN] memberlist: Was able to connect to dev-consul-server-1 but other probes failed, network may be misconfigured
2021/05/07 11:40:42 [INFO] serf: EventMemberJoin: dev-consul-7467bf7b46-x5pmr 10.242.41.137
2021/05/07 11:40:42 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:40:42 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:40:42 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:40:42 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:40:42 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:40:42 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:40:42 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:40:42 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:40:43 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:40:43 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:43 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:44 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:44 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:44 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:44 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:44 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:40:44 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:44 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:44 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:40:44 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:44 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:40:44 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:40:44 [WARN] agent: Check "mr-kafka" is now warning
2021/05/07 11:40:44 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:40:45 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:57428->10.242.41.137:8301: i/o timeout
2021/05/07 11:40:45 [INFO] memberlist: Suspect dev-consul-7467bf7b46-x5pmr has failed, no acks received
2021/05/07 11:40:45 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:40:45 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:40:45 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:40:46 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:40:47 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:40:48 [INFO] memberlist: Marking dev-consul-7467bf7b46-x5pmr as failed, suspect timeout reached (2 peer confirmations)
2021/05/07 11:40:48 [INFO] serf: EventMemberFailed: dev-consul-7467bf7b46-x5pmr 10.242.41.137
2021/05/07 11:40:48 [ERR] memberlist: Failed fallback ping: read tcp 10.242.113.229:57492->10.242.41.137:8301: i/o timeout
2021/05/07 11:40:48 [INFO] memberlist: Suspect dev-consul-7467bf7b46-x5pmr has failed, no acks received
2021/05/07 11:40:48 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:40:50 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:36096->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:40:50 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:40:50 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:50 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:50 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:50 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:50 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:50 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:50 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:50 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:50 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:50 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:50 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:50 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:50 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:51 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:51 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:51 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:51 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:52 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:52 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:52 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:52 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:52 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:52 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:40:52 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:40:52 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:40:52 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:40:52 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:40:52 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:40:53 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:40:53 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:40:53 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:54 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:40:54 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:54 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:54 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:54 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:54 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:55 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:40:55 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:40:55 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:40:55 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:55 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:40:55 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:40:55 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:40:55 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:40:56 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:56 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:40:56 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:40:58 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:40:58 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:59 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:59 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:59 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:59 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:59 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:40:59 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:59 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:40:59 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:40:59 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:40:59 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:00 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:41:01 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:01 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:01 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:01 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:02 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:41:02 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:41:02 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:41:02 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:41:02 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:41:02 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:41:02 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:41:03 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:41:03 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:04 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:41:04 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:41:05 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:41:05 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:41:05 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:41:05 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:36344->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:41:05 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:05 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:05 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:05 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:05 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:05 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:05 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:05 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:05 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:05 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:05 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:05 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:05 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:06 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:41:06 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:41:07 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:41:07 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:07 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:07 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:07 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:07 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:08 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:41:09 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:41:09 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:09 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:09 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:09 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:09 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:10 [WARN] agent: Check "search-data-service-api" is now warning
2021/05/07 11:41:10 [WARN] agent: Check "vfc-workflowengineactiviti" socket connection failed: dial tcp: lookup vfc-workflow-engine on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:10 [WARN] agent: Check "sparky-be-process" is now warning
2021/05/07 11:41:10 [WARN] agent: Check "data-router-process" is now warning
2021/05/07 11:41:10 [INFO] agent: Synced check "aai-resources"
2021/05/07 11:41:11 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:11 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:11 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:11 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:11 [WARN] agent: Check "log-logstash-internal-server-os-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:12 [WARN] agent: Check "vid-server" HTTP request failed: Get http://vid:8080/vid/healthCheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:41:12 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:41:12 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:41:12 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:41:12 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:41:12 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:41:12 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:41:13 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:13 [WARN] agent: Check "log-logstash-internal-server-process-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/process?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:14 [WARN] agent: Check "log-logstash-internal-server-os-info" HTTP request failed: Get http://log-ls-http:9600/_node/os?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:14 [WARN] agent: Check "vfc-resmgr" socket connection failed: dial tcp: lookup vfc-resmgr on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:14 [WARN] agent: Check "vfc-catalog" socket connection failed: dial tcp: lookup vfc-catalog on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:14 [WARN] agent: Check "vfc-workflow" socket connection failed: dial tcp: lookup vfc-workflow on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:14 [WARN] agent: Check "model-loader-process" is now warning
2021/05/07 11:41:14 [WARN] agent: Check "brmsgw-tcp" socket connection failed: dial tcp: lookup brmsgw on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:14 [WARN] agent: Check "vfc-emsdriver" socket connection failed: dial tcp: lookup vfc-ems-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:14 [WARN] agent: Check "appc-dgbuilder" HTTP request failed: Head http://appc-dgbuilder:3000/: EOF
2021/05/07 11:41:14 [WARN] agent: Check "pdp" HTTP request failed: Get https://pdp:8081/pdp/test: dial tcp: lookup pdp on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:14 [WARN] agent: Check "mr-kafka" is now warning
2021/05/07 11:41:15 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/05/07 11:41:15 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:41:15 [WARN] agent: Check "sdnc-sdnhost" HTTP request failed: Head http://sdnc:8282/apidoc/explorer/index.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:41:15 [WARN] agent: Check "appc-dbhost-healthcheck" is now warning
2021/05/07 11:41:15 [WARN] Check "sdc-titan-healthcheck": Timed out (1s) running check
2021/05/07 11:41:15 [WARN] Check "sdc-fe-healthcheck": Timed out (1s) running check
2021/05/07 11:41:15 [WARN] agent: Check "sdc-catalog-healthcheck" is now critical
2021/05/07 11:41:17 [WARN] Check "sdc-be-healthcheck": Timed out (1s) running check
2021/05/07 11:41:18 [WARN] Check "sdc-cs-healthcheck": Timed out (1s) running check
2021/05/07 11:41:18 [WARN] agent: Check "so-api-healthcheck" is now critical
2021/05/07 11:41:18 [WARN] agent: Check "msb-iag" HTTP request failed: Head http://msb-iag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:41:19 [WARN] agent: Check "msb-eag" HTTP request failed: Head http://msb-eag:80/iui/microservices/default.html: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:41:20 [WARN] agent: Check "multicloud-starlingx" HTTP request failed: Head http://multicloud-starlingx:9009/api/multicloud-starlingx/v0/swagger.json: read tcp 10.242.113.229:36624->10.96.14.252:9009: read: connection reset by peer
2021/05/07 11:41:20 [WARN] agent: Check "log-logstash-internal-server-plugin-info" HTTP request failed: Get http://log-ls-http:9600/_node/plugins?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:20 [WARN] agent: Check "log-logstash-internal-server-gi" HTTP request failed: Get http://log-ls-http:9600/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:20 [WARN] agent: Check "log-logstash-internal-server-jvm-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:20 [WARN] agent: Check "log-logstash-internal-server-jvm-info" HTTP request failed: Get http://log-ls-http:9600/_node/jvm?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:20 [WARN] agent: Check "vfc-jujudriver" socket connection failed: dial tcp: lookup vfc-juju-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:20 [WARN] agent: Check "log-elasticsearch-server" HTTP request failed: Get http://log-es:9200/_cluster/health?pretty: dial tcp: lookup log-es on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:20 [WARN] agent: Check "log-kibana-server" HTTP request failed: Head http://log-kibana:5601/status: dial tcp: lookup log-kibana on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:20 [WARN] agent: Check "appc-sdnhost" HTTP request failed: Head http://appc-sdnhost:8282/apidoc/explorer/index.html: dial tcp: lookup appc-sdnhost on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:20 [WARN] agent: Check "policy-nexus-internal-metrics" HTTP request failed: Get http://nexus:8081/nexus/internal/metrics: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:20 [WARN] agent: Check "policy-nexus-internal-healthcheck" HTTP request failed: Get http://nexus:8081/nexus/internal/healthcheck: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:20 [WARN] agent: Check "vfc-ztesdncdriver" socket connection failed: dial tcp: lookup vfc-zte-sdnc-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:20 [WARN] agent: Check "drools" HTTP request failed: Get https://drools:6969/healthcheck: dial tcp: lookup drools on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:20 [WARN] agent: Check "pap" HTTP request failed: Get https://pap:9091/pap/test: dial tcp: lookup pap on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:21 [WARN] agent: Check "sdnctldb01" socket connection failed: dial tcp: lookup sdnc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:21 [WARN] agent: Check "appc-sdnctldb02" socket connection failed: dial tcp: lookup appc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:21 [WARN] agent: Check "appc-sdnctldb01" socket connection failed: dial tcp: lookup appc-sdnctldb01 on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:21 [WARN] agent: Check "clamp-health" HTTP request failed: Get http://clamp:8080/restservices/clds/v1/clds/healthcheck: dial tcp: lookup clamp on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:22 [WARN] agent: Check "odl-api-healthcheck" HTTP request failed: Post http://sdnc:8282/restconf/operations/SLI-API:healthcheck: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021/05/07 11:41:22 [WARN] agent: Check "log-logstash-internal-server-node-info" HTTP request failed: Get http://log-ls-http:9600/_node/?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:22 [WARN] agent: Check "policy-nexus-local-status" HTTP request failed: Get http://nexus:8081/nexus/service/local/status: dial tcp: lookup nexus on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:22 [WARN] agent: Check "multicloud-windriver" HTTP request failed: Head http://multicloud-windriver:9005/api/multicloud-titaniumcloud/v1/swagger.json: dial tcp: lookup multicloud-windriver on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:22 [WARN] agent: Check "vfc-nokiavnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:22 [WARN] agent: Check "elasticsearch" HTTP request failed: Get http://aai-elasticsearch:9200/_cat/indices?v: dial tcp: lookup aai-elasticsearch on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:22 [WARN] agent: Check "vid-mariadb" is now warning
2021/05/07 11:41:22 [WARN] agent: Check "clamp-mariadb" is now warning
2021/05/07 11:41:22 [WARN] agent: Check "sdnc-dbhost-healthcheck" is now warning
2021/05/07 11:41:22 [WARN] agent: Check "mr-zookeeper" is now warning
2021/05/07 11:41:22 [WARN] agent: Check "so-mariadb" is now warning
2021/05/07 11:41:23 [WARN] agent: Check "Policy-mariadb-healthcheck" is now warning
2021/05/07 11:41:23 [INFO] agent: Synced check "so-api-healthcheck"
2021/05/07 11:41:23 [WARN] agent: Check "sdnctldb02" socket connection failed: dial tcp: lookup sdnc-sdnctldb02 on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:24 [WARN] agent: Check "sdnc-dgbuilder" HTTP request failed: Head http://sdnc-dgbuilder:3000/: EOF
2021/05/07 11:41:24 [WARN] agent: Check "log-logstash-internal-server-node-stat" HTTP request failed: Get http://log-ls-http:9600/_node/stats?pretty: dial tcp: lookup log-ls-http on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:24 [WARN] agent: Check "log-logstash-tcp" socket connection failed: dial tcp: lookup log-ls on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:24 [WARN] agent: Check "vfc-nokiav2vnfmdriver" socket connection failed: dial tcp: lookup vfc-nokia-v2vnfm-driver on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:24 [WARN] agent: Check "framework" HTTP request failed: Head http://framework:9001/api/multicloud/v0/swagger.json: dial tcp: lookup framework on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:24 [WARN] agent: Check "log-elasticsearch-tcp" socket connection failed: dial tcp: lookup log-es-tcp on 10.96.0.10:53: server misbehaving
2021/05/07 11:41:25 [WARN] agent: Check "so-camunda-healthcheck" is now critical
2021/05/07 11:41:25 [WARN] agent: Check "so-jra-healthcheck" is now critical
2021/