2023-02-09T00:07:26.142295Z info FLAG: --concurrency="2" 2023-02-09T00:07:26.142360Z info FLAG: --domain="onap.svc.cluster.local" 2023-02-09T00:07:26.142381Z info FLAG: --help="false" 2023-02-09T00:07:26.142393Z info FLAG: --log_as_json="false" 2023-02-09T00:07:26.142402Z info FLAG: --log_caller="" 2023-02-09T00:07:26.142849Z info FLAG: --log_output_level="default:info" 2023-02-09T00:07:26.142940Z info FLAG: --log_rotate="" 2023-02-09T00:07:26.142960Z info FLAG: --log_rotate_max_age="30" 2023-02-09T00:07:26.142973Z info FLAG: --log_rotate_max_backups="1000" 2023-02-09T00:07:26.142984Z info FLAG: --log_rotate_max_size="104857600" 2023-02-09T00:07:26.142994Z info FLAG: --log_stacktrace_level="default:none" 2023-02-09T00:07:26.143030Z info FLAG: --log_target="[stdout]" 2023-02-09T00:07:26.143050Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2023-02-09T00:07:26.143059Z info FLAG: --outlierLogPath="" 2023-02-09T00:07:26.143069Z info FLAG: --proxyComponentLogLevel="misc:error" 2023-02-09T00:07:26.143123Z info FLAG: --proxyLogLevel="warning" 2023-02-09T00:07:26.143140Z info FLAG: --serviceCluster="istio-proxy" 2023-02-09T00:07:26.143152Z info FLAG: --stsPort="0" 2023-02-09T00:07:26.143162Z info FLAG: --templateFile="" 2023-02-09T00:07:26.143288Z info FLAG: --tokenManagerPlugin="GoogleTokenExchange" 2023-02-09T00:07:26.143507Z info FLAG: --vklog="0" 2023-02-09T00:07:26.143534Z info Version 1.15.1-bf836f0be536b0adcef68f93c405994769e767cb-Clean 2023-02-09T00:07:26.166416Z info Maximum file descriptors (ulimit -n): 1048576 2023-02-09T00:07:26.166948Z info Proxy role ips=[10.233.70.8] type=sidecar id=onap-dmaap-dr-prov-8576f545cc-6dpcm.onap domain=onap.svc.cluster.local 2023-02-09T00:07:26.167189Z info Apply proxy config from env {} 2023-02-09T00:07:26.190638Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod.istio-system.svc:15012 drainDuration: 45s parentShutdownDuration: 60s proxyAdminPort: 15000 serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s tracing: zipkin: address: zipkin.istio-system:9411 2023-02-09T00:07:26.190680Z info JWT policy is third-party-jwt 2023-02-09T00:07:26.190689Z info using credential fetcher of JWT type in cluster.local trust domain 2023-02-09T00:07:26.296895Z info Workload SDS socket not found. Starting Istio SDS Server 2023-02-09T00:07:26.296960Z info CA Endpoint istiod.istio-system.svc:15012, provider Citadel 2023-02-09T00:07:26.297005Z info Using CA istiod.istio-system.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2023-02-09T00:07:26.297163Z info citadelclient Citadel client using custom root cert: var/run/secrets/istio/root-cert.pem 2023-02-09T00:07:26.328447Z info Opening status port 15020 2023-02-09T00:07:26.476720Z info ads All caches have been synced up in 348.469023ms, marking server ready 2023-02-09T00:07:26.480240Z info xdsproxy Initializing with upstream address "istiod.istio-system.svc:15012" and cluster "Kubernetes" 2023-02-09T00:07:26.480608Z info sds Starting SDS grpc server 2023-02-09T00:07:26.485274Z info starting Http service at 127.0.0.1:15004 2023-02-09T00:07:26.496505Z info Pilot SAN: [istiod.istio-system.svc] 2023-02-09T00:07:26.512414Z info Starting proxy agent 2023-02-09T00:07:26.512698Z info starting 2023-02-09T00:07:26.512913Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --parent-shutdown-time-s 60 --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --log-format %Y-%m-%dT%T.%fZ %l envoy %n %v -l warning --component-log-level misc:error --concurrency 2] 2023-02-09T00:07:27.057960Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T00:07:27.163534Z info cache generated new workload certificate latency=684.855635ms ttl=23h59m59.836523722s 2023-02-09T00:07:27.163692Z info cache Root cert has changed, start rotating root cert 2023-02-09T00:07:27.163766Z info ads XDS: Incremental Pushing:0 ConnectedEndpoints:0 Version: 2023-02-09T00:07:27.164092Z info cache returned workload trust anchor from cache ttl=23h59m59.835932115s 2023-02-09T00:07:27.538776Z info ads ADS: new connection for node:onap-dmaap-dr-prov-8576f545cc-6dpcm.onap-1 2023-02-09T00:07:27.538972Z info cache returned workload trust anchor from cache ttl=23h59m59.461039653s 2023-02-09T00:07:27.539546Z info ads SDS: PUSH request for node:onap-dmaap-dr-prov-8576f545cc-6dpcm.onap resources:1 size:1.1kB resource:ROOTCA 2023-02-09T00:07:27.580450Z info ads ADS: new connection for node:onap-dmaap-dr-prov-8576f545cc-6dpcm.onap-2 2023-02-09T00:07:27.580946Z info cache returned workload certificate from cache ttl=23h59m59.419071214s 2023-02-09T00:07:27.581455Z info ads SDS: PUSH request for node:onap-dmaap-dr-prov-8576f545cc-6dpcm.onap resources:1 size:4.0kB resource:default 2023-02-09T00:07:28.976930Z info Readiness succeeded in 2.867954772s 2023-02-09T00:07:28.977681Z info Envoy proxy is ready 2023-02-09T00:10:50.909683Z error Request to probe app failed: Get "http://10.233.70.8:8080/internal/prov": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/dmaap-dr-prov/readyz app URL path = /internal/prov 2023-02-09T00:10:50.909360Z error Request to probe app failed: Get "http://10.233.70.8:8080/internal/prov": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/dmaap-dr-prov/livez app URL path = /internal/prov 2023-02-09T00:11:00.894016Z error Request to probe app failed: Get "http://10.233.70.8:8080/internal/prov": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/dmaap-dr-prov/readyz app URL path = /internal/prov 2023-02-09T00:11:00.895345Z error Request to probe app failed: Get "http://10.233.70.8:8080/internal/prov": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/dmaap-dr-prov/livez app URL path = /internal/prov 2023-02-09T00:11:30.895807Z error Request to probe app failed: Get "http://10.233.70.8:8080/internal/prov": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/dmaap-dr-prov/readyz app URL path = /internal/prov 2023-02-09T00:12:30.920374Z error Request to probe app failed: Get "http://10.233.70.8:8080/internal/prov": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/dmaap-dr-prov/readyz app URL path = /internal/prov 2023-02-09T00:29:10.896322Z error Request to probe app failed: Get "http://10.233.70.8:8080/internal/prov": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/dmaap-dr-prov/readyz app URL path = /internal/prov 2023-02-09T00:32:00.889420Z error Request to probe app failed: Get "http://10.233.70.8:8080/internal/prov": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/dmaap-dr-prov/livez app URL path = /internal/prov 2023-02-09T00:39:25.816324Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T00:42:11.206096Z warn xdsproxy upstream [2] terminated with unexpected error rpc error: code = Unavailable desc = closing transport due to: connection error: desc = "error reading from server: read tcp 10.233.70.8:57864->10.233.65.237:15012: read: connection reset by peer", received prior goaway: code: NO_ERROR 2023-02-09T00:42:11.425051Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T01:12:51.765725Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T01:45:17.254084Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T02:17:42.450437Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T02:49:35.434480Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T03:19:09.572302Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T03:46:29.093144Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T04:16:10.076720Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T04:45:00.125814Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T05:17:04.821519Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T05:18:50.894201Z error Request to probe app failed: Get "http://10.233.70.8:8080/internal/prov": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/dmaap-dr-prov/readyz app URL path = /internal/prov 2023-02-09T05:18:50.916610Z error Request to probe app failed: Get "http://10.233.70.8:8080/internal/prov": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/dmaap-dr-prov/livez app URL path = /internal/prov 2023-02-09T05:44:21.872193Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T05:45:01.322554Z warn xdsproxy upstream [13] terminated with unexpected error rpc error: code = Unavailable desc = closing transport due to: connection error: desc = "error reading from server: read tcp 10.233.70.8:44918->10.233.65.159:15012: read: connection reset by peer", received prior goaway: code: NO_ERROR 2023-02-09T05:45:01.731535Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T05:45:01.734299Z warn xdsproxy upstream [14] terminated with unexpected error rpc error: code = ResourceExhausted desc = request rate limit exceeded: rate: Wait(n=1) would exceed context deadline 2023-02-09T05:45:01.735053Z error xdsproxy upstream [14] send error for type url type.googleapis.com/envoy.config.cluster.v3.Cluster: EOF 2023-02-09T05:45:01.734876Z warning envoy config StreamAggregatedResources gRPC config stream closed: 8, request rate limit exceeded: rate: Wait(n=1) would exceed context deadline (previously 14, closing transport due to: connection error: desc = "error reading from server: read tcp 10.233.70.8:44918->10.233.65.159:15012: read: connection reset by peer", received prior goaway: code: NO_ERROR since 0s ago) 2023-02-09T05:45:02.125698Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T06:16:42.481576Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T06:48:19.187668Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T06:50:39.254353Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T07:19:43.048407Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T07:52:00.169288Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T07:53:46.557426Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T07:54:01.647425Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T08:23:00.065672Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-02-09T08:50:49.391451Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012