2022-09-09T23:21:14.207431Z info FLAG: --concurrency="2" 2022-09-09T23:21:14.207546Z info FLAG: --domain="onap.svc.cluster.local" 2022-09-09T23:21:14.207565Z info FLAG: --help="false" 2022-09-09T23:21:14.207578Z info FLAG: --log_as_json="false" 2022-09-09T23:21:14.207598Z info FLAG: --log_caller="" 2022-09-09T23:21:14.207609Z info FLAG: --log_output_level="default:info" 2022-09-09T23:21:14.207618Z info FLAG: --log_rotate="" 2022-09-09T23:21:14.207634Z info FLAG: --log_rotate_max_age="30" 2022-09-09T23:21:14.207647Z info FLAG: --log_rotate_max_backups="1000" 2022-09-09T23:21:14.207658Z info FLAG: --log_rotate_max_size="104857600" 2022-09-09T23:21:14.207674Z info FLAG: --log_stacktrace_level="default:none" 2022-09-09T23:21:14.207703Z info FLAG: --log_target="[stdout]" 2022-09-09T23:21:14.207719Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2022-09-09T23:21:14.207737Z info FLAG: --outlierLogPath="" 2022-09-09T23:21:14.207749Z info FLAG: --proxyComponentLogLevel="misc:error" 2022-09-09T23:21:14.207760Z info FLAG: --proxyLogLevel="warning" 2022-09-09T23:21:14.207775Z info FLAG: --serviceCluster="istio-proxy" 2022-09-09T23:21:14.207787Z info FLAG: --stsPort="0" 2022-09-09T23:21:14.207797Z info FLAG: --templateFile="" 2022-09-09T23:21:14.207809Z info FLAG: --tokenManagerPlugin="GoogleTokenExchange" 2022-09-09T23:21:14.207823Z info FLAG: --vklog="0" 2022-09-09T23:21:14.207835Z info Version 1.14.1-f59ce19ec6b63bbb70a65c43ac423845f1129464-Clean 2022-09-09T23:21:14.208224Z info Proxy role ips=[10.233.72.155] type=sidecar id=onap-holmes-rule-mgmt-c4b7985bb-jmp9m.onap domain=onap.svc.cluster.local 2022-09-09T23:21:14.208444Z info Apply proxy config from env {} 2022-09-09T23:21:14.220918Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod.istio-system.svc:15012 drainDuration: 45s parentShutdownDuration: 60s proxyAdminPort: 15000 serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s tracing: zipkin: address: zipkin.istio-system:9411 2022-09-09T23:21:14.220989Z info JWT policy is third-party-jwt 2022-09-09T23:21:14.221006Z info using credential fetcher of JWT type in cluster.local trust domain 2022-09-09T23:21:14.322986Z info SDS socket not found. Starting Istio SDS Server 2022-09-09T23:21:14.323146Z info CA Endpoint istiod.istio-system.svc:15012, provider Citadel 2022-09-09T23:21:14.323251Z info Using CA istiod.istio-system.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2022-09-09T23:21:14.323453Z info citadelclient Citadel client using custom root cert: var/run/secrets/istio/root-cert.pem 2022-09-09T23:21:14.333577Z info Opening status port 15020 2022-09-09T23:21:14.410336Z info ads All caches have been synced up in 300.990356ms, marking server ready 2022-09-09T23:21:14.411609Z info sds SDS server for workload certificates started, listening on "./var/run/secrets/workload-spiffe-uds/socket" 2022-09-09T23:21:14.411667Z info xdsproxy Initializing with upstream address "istiod.istio-system.svc:15012" and cluster "Kubernetes" 2022-09-09T23:21:14.411736Z info sds Starting SDS grpc server 2022-09-09T23:21:14.416203Z info Pilot SAN: [istiod.istio-system.svc] 2022-09-09T23:21:14.417374Z info starting Http service at 127.0.0.1:15004 2022-09-09T23:21:14.420277Z info Starting proxy agent 2022-09-09T23:21:14.420327Z info Epoch 0 starting 2022-09-09T23:21:14.420373Z info Envoy command: [-c etc/istio/proxy/envoy-rev0.json --restart-epoch 0 --drain-time-s 45 --drain-strategy immediate --parent-shutdown-time-s 60 --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --log-format %Y-%m-%dT%T.%fZ %l envoy %n %v -l warning --component-log-level misc:error --concurrency 2] 2022-09-09T23:21:14.775463Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-09-09T23:21:15.197495Z info ads ADS: new connection for node:onap-holmes-rule-mgmt-c4b7985bb-jmp9m.onap-1 2022-09-09T23:21:15.237932Z info ads ADS: new connection for node:onap-holmes-rule-mgmt-c4b7985bb-jmp9m.onap-2 2022-09-09T23:21:15.305869Z info cache generated new workload certificate latency=894.908621ms ttl=23h59m59.694160629s 2022-09-09T23:21:15.305971Z info cache Root cert has changed, start rotating root cert 2022-09-09T23:21:15.306023Z info ads XDS: Incremental Pushing:0 ConnectedEndpoints:2 Version: 2022-09-09T23:21:15.306176Z info cache returned workload trust anchor from cache ttl=23h59m59.693836917s 2022-09-09T23:21:15.306249Z info cache returned workload trust anchor from cache ttl=23h59m59.69375958s 2022-09-09T23:21:15.307414Z info ads SDS: PUSH request for node:onap-holmes-rule-mgmt-c4b7985bb-jmp9m.onap resources:1 size:1.1kB resource:ROOTCA 2022-09-09T23:21:15.307875Z info cache returned workload certificate from cache ttl=23h59m59.692138186s 2022-09-09T23:21:15.308199Z info ads SDS: PUSH request for node:onap-holmes-rule-mgmt-c4b7985bb-jmp9m.onap resources:1 size:4.0kB resource:default 2022-09-09T23:21:15.308408Z info cache returned workload trust anchor from cache ttl=23h59m59.691601201s 2022-09-09T23:21:15.308512Z info ads SDS: PUSH for node:onap-holmes-rule-mgmt-c4b7985bb-jmp9m.onap resources:1 size:1.1kB resource:ROOTCA 2022-09-09T23:21:18.041549Z info Readiness succeeded in 3.863050447s 2022-09-09T23:21:18.042456Z info Envoy proxy is ready 2022-09-09T23:27:58.182970Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-09-09T23:31:08.227911Z error Request to probe app failed: Get "https://10.233.72.155:9101/api/holmes-rule-mgmt/v1/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/holmes-rule-mgmt/livez app URL path = /api/holmes-rule-mgmt/v1/healthcheck 2022-09-09T23:49:48.271322Z error Request to probe app failed: Get "https://10.233.72.155:9101/api/holmes-rule-mgmt/v1/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/holmes-rule-mgmt/livez app URL path = /api/holmes-rule-mgmt/v1/healthcheck 2022-09-09T23:53:48.256536Z error Request to probe app failed: Get "https://10.233.72.155:9101/api/holmes-rule-mgmt/v1/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/holmes-rule-mgmt/livez app URL path = /api/holmes-rule-mgmt/v1/healthcheck 2022-09-09T23:53:58.239310Z error Request to probe app failed: Get "https://10.233.72.155:9101/api/holmes-rule-mgmt/v1/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/holmes-rule-mgmt/livez app URL path = /api/holmes-rule-mgmt/v1/healthcheck 2022-09-09T23:54:08.320417Z error Request to probe app failed: Get "https://10.233.72.155:9101/api/holmes-rule-mgmt/v1/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/holmes-rule-mgmt/livez app URL path = /api/holmes-rule-mgmt/v1/healthcheck 2022-09-09T23:54:08.321566Z error Request to probe app failed: Get "https://10.233.72.155:9101/api/holmes-rule-mgmt/v1/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/holmes-rule-mgmt/readyz app URL path = /api/holmes-rule-mgmt/v1/healthcheck 2022-09-09T23:54:09.581545Z error Request to probe app failed: Get "https://10.233.72.155:9101/api/holmes-rule-mgmt/v1/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/holmes-rule-mgmt/readyz app URL path = /api/holmes-rule-mgmt/v1/healthcheck 2022-09-09T23:55:07.247291Z error Request to probe app failed: Get "https://10.233.72.155:9101/api/holmes-rule-mgmt/v1/healthcheck": dial tcp 127.0.0.6:0->10.233.72.155:9101: connect: connection refused, original URL path = /app-health/holmes-rule-mgmt/readyz app URL path = /api/holmes-rule-mgmt/v1/healthcheck 2022-09-09T23:55:37.227944Z error Request to probe app failed: Get "https://10.233.72.155:9101/api/holmes-rule-mgmt/v1/healthcheck": dial tcp 127.0.0.6:0->10.233.72.155:9101: connect: connection refused, original URL path = /app-health/holmes-rule-mgmt/readyz app URL path = /api/holmes-rule-mgmt/v1/healthcheck 2022-09-09T23:58:57.446586Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-09-10T00:00:38.258639Z error Request to probe app failed: Get "https://10.233.72.155:9101/api/holmes-rule-mgmt/v1/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/holmes-rule-mgmt/readyz app URL path = /api/holmes-rule-mgmt/v1/healthcheck 2022-09-10T00:00:38.259159Z error Request to probe app failed: Get "https://10.233.72.155:9101/api/holmes-rule-mgmt/v1/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/holmes-rule-mgmt/livez app URL path = /api/holmes-rule-mgmt/v1/healthcheck 2022-09-10T00:02:02.365963Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-09-10T00:11:18.836083Z warn xdsproxy upstream [4] terminated with unexpected error rpc error: code = Unavailable desc = closing transport due to: connection error: desc = "error reading from server: read tcp 10.233.72.155:38770->10.233.70.208:15012: read: connection reset by peer", received prior goaway: code: NO_ERROR 2022-09-10T00:11:18.956013Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-09-10T00:38:52.193803Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-09-10T00:48:07.373457Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-09-10T00:48:07.379108Z warn xdsproxy upstream [7] terminated with unexpected error rpc error: code = ResourceExhausted desc = request rate limit exceeded: rate: Wait(n=1) would exceed context deadline 2022-09-10T00:48:07.393977Z warning envoy config StreamAggregatedResources gRPC config stream closed: 8, request rate limit exceeded: rate: Wait(n=1) would exceed context deadline (previously 14, closing transport due to: connection error: desc = "error reading from server: EOF", received prior goaway: code: NO_ERROR since 0s ago) 2022-09-10T00:48:08.505505Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012