2022-11-24T08:44:01.449118Z info FLAG: --concurrency="2" 2022-11-24T08:44:01.449151Z info FLAG: --domain="onap.svc.cluster.local" 2022-11-24T08:44:01.449155Z info FLAG: --help="false" 2022-11-24T08:44:01.449158Z info FLAG: --log_as_json="false" 2022-11-24T08:44:01.449160Z info FLAG: --log_caller="" 2022-11-24T08:44:01.449162Z info FLAG: --log_output_level="default:info" 2022-11-24T08:44:01.449163Z info FLAG: --log_rotate="" 2022-11-24T08:44:01.449165Z info FLAG: --log_rotate_max_age="30" 2022-11-24T08:44:01.449167Z info FLAG: --log_rotate_max_backups="1000" 2022-11-24T08:44:01.449169Z info FLAG: --log_rotate_max_size="104857600" 2022-11-24T08:44:01.449171Z info FLAG: --log_stacktrace_level="default:none" 2022-11-24T08:44:01.449182Z info FLAG: --log_target="[stdout]" 2022-11-24T08:44:01.449185Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2022-11-24T08:44:01.449187Z info FLAG: --outlierLogPath="" 2022-11-24T08:44:01.449190Z info FLAG: --proxyComponentLogLevel="misc:error" 2022-11-24T08:44:01.449193Z info FLAG: --proxyLogLevel="warning" 2022-11-24T08:44:01.449195Z info FLAG: --serviceCluster="istio-proxy" 2022-11-24T08:44:01.449197Z info FLAG: --stsPort="0" 2022-11-24T08:44:01.449199Z info FLAG: --templateFile="" 2022-11-24T08:44:01.449201Z info FLAG: --tokenManagerPlugin="GoogleTokenExchange" 2022-11-24T08:44:01.449210Z info FLAG: --vklog="0" 2022-11-24T08:44:01.449214Z info Version 1.14.1-f59ce19ec6b63bbb70a65c43ac423845f1129464-Clean 2022-11-24T08:44:01.449377Z info Proxy role ips=[10.233.65.88] type=sidecar id=onap-dcae-son-handler-75c5b55b9b-ckbcl.onap domain=onap.svc.cluster.local 2022-11-24T08:44:01.449448Z info Apply proxy config from env {} 2022-11-24T08:44:01.452468Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod.istio-system.svc:15012 drainDuration: 45s parentShutdownDuration: 60s proxyAdminPort: 15000 serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s tracing: zipkin: address: zipkin.istio-system:9411 2022-11-24T08:44:01.452501Z info JWT policy is third-party-jwt 2022-11-24T08:44:01.452507Z info using credential fetcher of JWT type in cluster.local trust domain 2022-11-24T08:44:01.553550Z info SDS socket not found. Starting Istio SDS Server 2022-11-24T08:44:01.553600Z info CA Endpoint istiod.istio-system.svc:15012, provider Citadel 2022-11-24T08:44:01.553623Z info Using CA istiod.istio-system.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2022-11-24T08:44:01.553726Z info citadelclient Citadel client using custom root cert: var/run/secrets/istio/root-cert.pem 2022-11-24T08:44:01.553756Z info Opening status port 15020 2022-11-24T08:44:01.570985Z info ads All caches have been synced up in 128.322388ms, marking server ready 2022-11-24T08:44:01.571688Z info sds SDS server for workload certificates started, listening on "./var/run/secrets/workload-spiffe-uds/socket" 2022-11-24T08:44:01.571734Z info xdsproxy Initializing with upstream address "istiod.istio-system.svc:15012" and cluster "Kubernetes" 2022-11-24T08:44:01.572737Z info sds Starting SDS grpc server 2022-11-24T08:44:01.572885Z info starting Http service at 127.0.0.1:15004 2022-11-24T08:44:01.573942Z info Pilot SAN: [istiod.istio-system.svc] 2022-11-24T08:44:01.575356Z info Starting proxy agent 2022-11-24T08:44:01.575386Z info Epoch 0 starting 2022-11-24T08:44:01.575467Z info Envoy command: [-c etc/istio/proxy/envoy-rev0.json --restart-epoch 0 --drain-time-s 45 --drain-strategy immediate --parent-shutdown-time-s 60 --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --log-format %Y-%m-%dT%T.%fZ %l envoy %n %v -l warning --component-log-level misc:error --concurrency 2] 2022-11-24T08:44:01.671988Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-11-24T08:44:01.776981Z info ads ADS: new connection for node:onap-dcae-son-handler-75c5b55b9b-ckbcl.onap-1 2022-11-24T08:44:01.801246Z info cache generated new workload certificate latency=229.579744ms ttl=24h0m4.198777145s 2022-11-24T08:44:01.801381Z info cache Root cert has changed, start rotating root cert 2022-11-24T08:44:01.801403Z info ads XDS: Incremental Pushing:0 ConnectedEndpoints:1 Version: 2022-11-24T08:44:01.801488Z info cache returned workload trust anchor from cache ttl=24h0m4.198515928s 2022-11-24T08:44:01.801502Z info cache returned workload trust anchor from cache ttl=24h0m4.198514537s 2022-11-24T08:44:01.802101Z info ads SDS: PUSH request for node:onap-dcae-son-handler-75c5b55b9b-ckbcl.onap resources:1 size:1.1kB resource:ROOTCA 2022-11-24T08:44:01.802184Z info cache returned workload trust anchor from cache ttl=24h0m4.197820564s 2022-11-24T08:44:01.802230Z info ads SDS: PUSH for node:onap-dcae-son-handler-75c5b55b9b-ckbcl.onap resources:1 size:1.1kB resource:ROOTCA 2022-11-24T08:44:01.815920Z info ads ADS: new connection for node:onap-dcae-son-handler-75c5b55b9b-ckbcl.onap-2 2022-11-24T08:44:01.816100Z info cache returned workload certificate from cache ttl=24h0m4.183914078s 2022-11-24T08:44:01.816343Z info ads SDS: PUSH request for node:onap-dcae-son-handler-75c5b55b9b-ckbcl.onap resources:1 size:4.0kB resource:default 2022-11-24T08:44:02.537072Z info Readiness succeeded in 1.093767937s 2022-11-24T08:44:02.537559Z info Envoy proxy is ready 2022-11-24T08:44:26.592633Z error Request to probe app failed: Get "http://10.233.65.88:8080/healthcheck": dial tcp 127.0.0.6:0->10.233.65.88:8080: connect: connection refused, original URL path = /app-health/dcae-son-handler/readyz app URL path = /healthcheck 2022-11-24T09:11:32.737020Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-11-24T09:14:33.716754Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-11-24T09:14:33.725658Z warn xdsproxy upstream [3] terminated with unexpected error rpc error: code = ResourceExhausted desc = request rate limit exceeded: rate: Wait(n=1) would exceed context deadline 2022-11-24T09:14:33.726153Z warning envoy config StreamAggregatedResources gRPC config stream closed: 8, request rate limit exceeded: rate: Wait(n=1) would exceed context deadline (previously 14, error reading from server: EOF since 0s ago) 2022-11-24T09:14:34.465826Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-11-24T09:14:34.468948Z warn xdsproxy upstream [4] terminated with unexpected error rpc error: code = ResourceExhausted desc = request rate limit exceeded: rate: Wait(n=1) would exceed context deadline 2022-11-24T09:14:35.111073Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-11-24T09:45:56.852161Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-11-24T10:16:57.633956Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-11-24T10:45:28.822696Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-11-24T11:16:15.434595Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-11-24T11:35:22.556686Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-11-24T11:35:22.558005Z warn xdsproxy upstream [10] terminated with unexpected error rpc error: code = ResourceExhausted desc = request rate limit exceeded: rate: Wait(n=1) would exceed context deadline 2022-11-24T11:35:22.558474Z warning envoy config StreamAggregatedResources gRPC config stream closed: 8, request rate limit exceeded: rate: Wait(n=1) would exceed context deadline (previously 14, error reading from server: EOF since 0s ago) 2022-11-24T11:35:22.916098Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2022-11-24T11:35:22.919310Z warn xdsproxy upstream [11] terminated with unexpected error rpc error: code = ResourceExhausted desc = request rate limit exceeded: rate: Wait(n=1) would exceed context deadline 2022-11-24T11:35:23.831202Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012