2022-10-30T22:51:36.472112Z info FLAG: --concurrency="2" 2022-10-30T22:51:36.472159Z info FLAG: --domain="onap.svc.cluster.local" 2022-10-30T22:51:36.472168Z info FLAG: --help="false" 2022-10-30T22:51:36.472178Z info FLAG: --log_as_json="false" 2022-10-30T22:51:36.472183Z info FLAG: --log_caller="" 2022-10-30T22:51:36.472189Z info FLAG: --log_output_level="default:info" 2022-10-30T22:51:36.472197Z info FLAG: --log_rotate="" 2022-10-30T22:51:36.472206Z info FLAG: --log_rotate_max_age="30" 2022-10-30T22:51:36.472215Z info FLAG: --log_rotate_max_backups="1000" 2022-10-30T22:51:36.472224Z info FLAG: --log_rotate_max_size="104857600" 2022-10-30T22:51:36.472235Z info FLAG: --log_stacktrace_level="default:none" 2022-10-30T22:51:36.472251Z info FLAG: --log_target="[stdout]" 2022-10-30T22:51:36.472265Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2022-10-30T22:51:36.472270Z info FLAG: --outlierLogPath="" 2022-10-30T22:51:36.472274Z info FLAG: --proxyComponentLogLevel="misc:error" 2022-10-30T22:51:36.472279Z info FLAG: --proxyLogLevel="warning" 2022-10-30T22:51:36.472283Z info FLAG: --serviceCluster="istio-proxy" 2022-10-30T22:51:36.472288Z info FLAG: --stsPort="0" 2022-10-30T22:51:36.472292Z info FLAG: --templateFile="" 2022-10-30T22:51:36.472297Z info FLAG: --tokenManagerPlugin="GoogleTokenExchange" 2022-10-30T22:51:36.472303Z info FLAG: --vklog="0" 2022-10-30T22:51:36.472308Z info Version 1.14.1-f59ce19ec6b63bbb70a65c43ac423845f1129464-Clean 2022-10-30T22:51:36.472532Z info Proxy role ips=[10.233.68.64] type=sidecar id=onap-dcae-heartbeat-postgres-primary-764cb48468-tmgv8.onap domain=onap.svc.cluster.local 2022-10-30T22:51:36.472660Z info Apply proxy config from env {} 2022-10-30T22:51:36.480308Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod.istio-system.svc:15012 drainDuration: 45s parentShutdownDuration: 60s proxyAdminPort: 15000 serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s tracing: zipkin: address: zipkin.istio-system:9411 2022-10-30T22:51:36.480562Z info JWT policy is third-party-jwt 2022-10-30T22:51:36.480573Z info using credential fetcher of JWT type in cluster.local trust domain 2022-10-30T22:51:36.582108Z info SDS socket not found. Starting Istio SDS Server 2022-10-30T22:51:36.582162Z info CA Endpoint istiod.istio-system.svc:15012, provider Citadel 2022-10-30T22:51:36.582147Z info Opening status port 15020 2022-10-30T22:51:36.582194Z info Using CA istiod.istio-system.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2022-10-30T22:51:36.582311Z info citadelclient Citadel client using custom root cert: var/run/secrets/istio/root-cert.pem 2022-10-30T22:51:36.607482Z info ads All caches have been synced up in 140.01365ms, marking server ready 2022-10-30T22:51:36.608870Z info sds SDS server for workload certificates started, listening on "./var/run/secrets/workload-spiffe-uds/socket" 2022-10-30T22:51:36.608916Z info xdsproxy Initializing with upstream address "istiod.istio-system.svc:15012" and cluster "Kubernetes" 2022-10-30T22:51:36.609007Z info sds Starting SDS grpc server 2022-10-30T22:51:36.609505Z info starting Http service at 127.0.0.1:15004 2022-10-30T22:51:36.611685Z info Pilot SAN: [istiod.istio-system.svc] 2022-10-30T22:51:36.613780Z info Starting proxy agent 2022-10-30T22:51:36.613815Z info Epoch 0 starting 2022-10-30T22:51:36.613856Z info Envoy command: [-c etc/istio/proxy/envoy-rev0.json --restart-epoch 0 --drain-time-s 45 --drain-strategy immediate --parent-shutdown-time-s 60 --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --log-format %Y-%m-%dT%T.%fZ %l envoy %n %v -l warning --component-log-level misc:error --concurrency 2] 2022-10-30T22:51:36.729331Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-10-30T22:51:36.886339Z info ads ADS: new connection for node:onap-dcae-heartbeat-postgres-primary-764cb48468-tmgv8.onap-1 2022-10-30T22:51:36.920421Z info cache generated new workload certificate latency=312.186798ms ttl=24h0m0.079631177s 2022-10-30T22:51:36.920502Z info cache Root cert has changed, start rotating root cert 2022-10-30T22:51:36.920598Z info ads XDS: Incremental Pushing:0 ConnectedEndpoints:1 Version: 2022-10-30T22:51:36.920719Z info cache returned workload trust anchor from cache ttl=24h0m0.079306514s 2022-10-30T22:51:36.920772Z info cache returned workload trust anchor from cache ttl=24h0m0.079235858s 2022-10-30T22:51:36.921479Z info ads SDS: PUSH request for node:onap-dcae-heartbeat-postgres-primary-764cb48468-tmgv8.onap resources:1 size:1.1kB resource:ROOTCA 2022-10-30T22:51:36.921684Z info cache returned workload trust anchor from cache ttl=24h0m0.078324268s 2022-10-30T22:51:36.921771Z info ads SDS: PUSH for node:onap-dcae-heartbeat-postgres-primary-764cb48468-tmgv8.onap resources:1 size:1.1kB resource:ROOTCA 2022-10-30T22:51:36.926890Z info ads ADS: new connection for node:onap-dcae-heartbeat-postgres-primary-764cb48468-tmgv8.onap-2 2022-10-30T22:51:36.927077Z info cache returned workload certificate from cache ttl=24h0m0.072962768s 2022-10-30T22:51:36.927334Z info ads SDS: PUSH request for node:onap-dcae-heartbeat-postgres-primary-764cb48468-tmgv8.onap resources:1 size:4.0kB resource:default 2022-10-30T22:51:37.583198Z info Readiness succeeded in 1.114854499s 2022-10-30T22:51:37.583764Z info Envoy proxy is ready 2022-10-30T23:22:06.336279Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-10-30T23:40:04.671233Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-10-30T23:40:04.672162Z warn xdsproxy upstream [3] terminated with unexpected error rpc error: code = ResourceExhausted desc = request rate limit exceeded: rate: Wait(n=1) would exceed context deadline 2022-10-30T23:40:04.672405Z error xdsproxy upstream [3] send error for type url type.googleapis.com/envoy.config.cluster.v3.Cluster: EOF 2022-10-30T23:40:04.672790Z warning envoy config StreamAggregatedResources gRPC config stream closed: 8, request rate limit exceeded: rate: Wait(n=1) would exceed context deadline (previously 14, error reading from server: EOF since 0s ago) 2022-10-30T23:40:04.723914Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-10-31T00:12:40.465479Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-10-31T00:40:35.457981Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-10-31T00:43:26.896321Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-10-31T00:43:26.898653Z warn xdsproxy upstream [7] terminated with unexpected error rpc error: code = ResourceExhausted desc = request rate limit exceeded: rate: Wait(n=1) would exceed context deadline 2022-10-31T00:43:26.899174Z warning envoy config StreamAggregatedResources gRPC config stream closed: 8, request rate limit exceeded: rate: Wait(n=1) would exceed context deadline (previously 14, error reading from server: EOF since 0s ago) 2022-10-31T00:43:27.030046Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-10-31T00:43:27.031039Z error xdsproxy upstream [8] send error for type url type.googleapis.com/envoy.config.endpoint.v3.ClusterLoadAssignment: EOF 2022-10-31T00:43:27.031047Z warn xdsproxy upstream [8] terminated with unexpected error rpc error: code = ResourceExhausted desc = request rate limit exceeded: rate: Wait(n=1) would exceed context deadline 2022-10-31T00:43:28.794023Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-10-31T01:14:36.867231Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-10-31T01:17:30.819777Z warn xdsproxy upstream [10] terminated with unexpected error rpc error: code = Unavailable desc = closing transport due to: connection error: desc = "error reading from server: read tcp 10.233.68.64:39732->10.233.72.232:15012: read: connection reset by peer", received prior goaway: code: NO_ERROR 2022-10-31T01:17:30.907580Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-10-31T01:45:40.644643Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012