2023-03-03T23:55:52.826939Z info FLAG: --concurrency="2" 2023-03-03T23:55:52.827006Z info FLAG: --domain="onap.svc.cluster.local" 2023-03-03T23:55:52.827023Z info FLAG: --help="false" 2023-03-03T23:55:52.827051Z info FLAG: --log_as_json="false" 2023-03-03T23:55:52.827066Z info FLAG: --log_caller="" 2023-03-03T23:55:52.827088Z info FLAG: --log_output_level="default:info" 2023-03-03T23:55:52.827106Z info FLAG: --log_rotate="" 2023-03-03T23:55:52.827120Z info FLAG: --log_rotate_max_age="30" 2023-03-03T23:55:52.827140Z info FLAG: --log_rotate_max_backups="1000" 2023-03-03T23:55:52.827160Z info FLAG: --log_rotate_max_size="104857600" 2023-03-03T23:55:52.827172Z info FLAG: --log_stacktrace_level="default:none" 2023-03-03T23:55:52.827221Z info FLAG: --log_target="[stdout]" 2023-03-03T23:55:52.827246Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2023-03-03T23:55:52.827265Z info FLAG: --outlierLogPath="" 2023-03-03T23:55:52.827284Z info FLAG: --proxyComponentLogLevel="misc:error" 2023-03-03T23:55:52.827303Z info FLAG: --proxyLogLevel="warning" 2023-03-03T23:55:52.827317Z info FLAG: --serviceCluster="istio-proxy" 2023-03-03T23:55:52.827329Z info FLAG: --stsPort="0" 2023-03-03T23:55:52.827346Z info FLAG: --templateFile="" 2023-03-03T23:55:52.827358Z info FLAG: --tokenManagerPlugin="GoogleTokenExchange" 2023-03-03T23:55:52.827406Z info FLAG: --vklog="0" 2023-03-03T23:55:52.827430Z info Version 1.17.0-c8c901a56861021dc25412f2e557b72a235b554c-Clean 2023-03-03T23:55:52.897410Z info Maximum file descriptors (ulimit -n): 1048576 2023-03-03T23:55:52.899371Z info Proxy role ips=[10.233.71.227] type=sidecar id=onap-holmes-rule-mgmt-5d6c999667-f6rg2.onap domain=onap.svc.cluster.local 2023-03-03T23:55:52.900898Z info Apply proxy config from env {} 2023-03-03T23:55:52.966750Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod.istio-system.svc:15012 drainDuration: 45s proxyAdminPort: 15000 serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s tracing: zipkin: address: zipkin.istio-system:9411 2023-03-03T23:55:52.966812Z info JWT policy is third-party-jwt 2023-03-03T23:55:52.966824Z info using credential fetcher of JWT type in cluster.local trust domain 2023-03-03T23:55:53.073282Z info Opening status port 15020 2023-03-03T23:55:53.073572Z info Workload SDS socket not found. Starting Istio SDS Server 2023-03-03T23:55:53.073887Z info CA Endpoint istiod.istio-system.svc:15012, provider Citadel 2023-03-03T23:55:53.074372Z info Using CA istiod.istio-system.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2023-03-03T23:55:53.377832Z info ads All caches have been synced up in 586.942902ms, marking server ready 2023-03-03T23:55:53.414127Z info sds Starting SDS grpc server 2023-03-03T23:55:53.415550Z info xdsproxy Initializing with upstream address "istiod.istio-system.svc:15012" and cluster "Kubernetes" 2023-03-03T23:55:53.438405Z info starting Http service at 127.0.0.1:15004 2023-03-03T23:55:53.499501Z info Pilot SAN: [istiod.istio-system.svc] 2023-03-03T23:55:53.516512Z info Starting proxy agent 2023-03-03T23:55:53.533287Z info starting 2023-03-03T23:55:53.533766Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields --log-format %Y-%m-%dT%T.%fZ %l envoy %n %g:%# %v thread=%t -l warning --component-log-level misc:error --concurrency 2] 2023-03-03T23:55:54.112297Z info cache generated new workload certificate latency=700.772329ms ttl=23h59m59.887722147s 2023-03-03T23:55:54.112398Z info cache Root cert has changed, start rotating root cert 2023-03-03T23:55:54.112502Z info ads XDS: Incremental Pushing:0 ConnectedEndpoints:0 Version: 2023-03-03T23:55:54.112728Z info cache returned workload trust anchor from cache ttl=23h59m59.887279751s 2023-03-03T23:55:54.135150Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-03-03T23:55:54.567756Z info ads ADS: new connection for node:onap-holmes-rule-mgmt-5d6c999667-f6rg2.onap-1 2023-03-03T23:55:54.567888Z info cache returned workload certificate from cache ttl=23h59m59.432122559s 2023-03-03T23:55:54.568420Z info ads SDS: PUSH request for node:onap-holmes-rule-mgmt-5d6c999667-f6rg2.onap resources:1 size:4.0kB resource:default 2023-03-03T23:55:54.610579Z info ads ADS: new connection for node:onap-holmes-rule-mgmt-5d6c999667-f6rg2.onap-2 2023-03-03T23:55:54.611021Z info cache returned workload trust anchor from cache ttl=23h59m59.38913459s 2023-03-03T23:55:54.611516Z info ads SDS: PUSH request for node:onap-holmes-rule-mgmt-5d6c999667-f6rg2.onap resources:1 size:1.1kB resource:ROOTCA 2023-03-03T23:55:56.029395Z info Readiness succeeded in 3.359076896s 2023-03-03T23:55:56.033088Z info Envoy proxy is ready 2023-03-04T00:01:20.909963Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-03-04T00:01:50.865018Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-03-04T00:04:21.676284Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-03-04T00:08:40.553322Z error Request to probe app failed: Get "https://10.233.71.227:9101/api/holmes-rule-mgmt/v1/healthcheck": net/http: request canceled (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/holmes-rule-mgmt/livez app URL path = /api/holmes-rule-mgmt/v1/healthcheck 2023-03-04T00:09:20.566186Z error Request to probe app failed: Get "https://10.233.71.227:9101/api/holmes-rule-mgmt/v1/healthcheck": net/http: request canceled (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/holmes-rule-mgmt/livez app URL path = /api/holmes-rule-mgmt/v1/healthcheck 2023-03-04T00:11:10.554635Z error Request to probe app failed: Get "https://10.233.71.227:9101/api/holmes-rule-mgmt/v1/healthcheck": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/holmes-rule-mgmt/livez app URL path = /api/holmes-rule-mgmt/v1/healthcheck 2023-03-04T00:11:10.556453Z error Request to probe app failed: Get "https://10.233.71.227:9101/api/holmes-rule-mgmt/v1/healthcheck": net/http: request canceled (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/holmes-rule-mgmt/readyz app URL path = /api/holmes-rule-mgmt/v1/healthcheck 2023-03-04T00:11:30.611231Z error Request to probe app failed: Get "https://10.233.71.227:9101/api/holmes-rule-mgmt/v1/healthcheck": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/holmes-rule-mgmt/livez app URL path = /api/holmes-rule-mgmt/v1/healthcheck 2023-03-04T00:14:10.591477Z error Request to probe app failed: Get "https://10.233.71.227:9101/api/holmes-rule-mgmt/v1/healthcheck": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/holmes-rule-mgmt/readyz app URL path = /api/holmes-rule-mgmt/v1/healthcheck 2023-03-04T00:14:10.592788Z error Request to probe app failed: Get "https://10.233.71.227:9101/api/holmes-rule-mgmt/v1/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/holmes-rule-mgmt/livez app URL path = /api/holmes-rule-mgmt/v1/healthcheck 2023-03-04T00:30:50.698887Z error Request to probe app failed: Get "https://10.233.71.227:9101/api/holmes-rule-mgmt/v1/healthcheck": net/http: request canceled (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/holmes-rule-mgmt/livez app URL path = /api/holmes-rule-mgmt/v1/healthcheck 2023-03-04T00:33:42.208750Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-03-04T00:49:14.028877Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-03-04T00:49:30.549496Z error Request to probe app failed: Get "https://10.233.71.227:9101/api/holmes-rule-mgmt/v1/healthcheck": net/http: request canceled (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/holmes-rule-mgmt/livez app URL path = /api/holmes-rule-mgmt/v1/healthcheck 2023-03-04T00:53:43.950053Z warn xdsproxy upstream [6] terminated with unexpected error rpc error: code = Unavailable desc = closing transport due to: connection error: desc = "error reading from server: read tcp 10.233.71.227:38130->10.233.66.133:15012: read: connection reset by peer", received prior goaway: code: NO_ERROR 2023-03-04T00:53:44.531051Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-03-04T00:54:44.402903Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-03-04T00:54:44.409844Z warn xdsproxy upstream [8] terminated with unexpected error rpc error: code = ResourceExhausted desc = request rate limit exceeded: rate: Wait(n=1) would exceed context deadline 2023-03-04T00:54:44.413411Z warning envoy config external/envoy/source/common/config/grpc_stream.h:185 StreamAggregatedResources gRPC config stream to xds-grpc closed: 8, request rate limit exceeded: rate: Wait(n=1) would exceed context deadline (previously 14, error reading from server: EOF since 0s ago) thread=28 2023-03-04T00:54:44.883561Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-03-04T01:23:38.106546Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-03-04T01:51:12.119077Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-03-04T02:19:48.002924Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012