2023-03-09T23:21:51.998926Z info FLAG: --concurrency="2" 2023-03-09T23:21:51.998974Z info FLAG: --domain="onap.svc.cluster.local" 2023-03-09T23:21:51.998988Z info FLAG: --help="false" 2023-03-09T23:21:51.998996Z info FLAG: --log_as_json="false" 2023-03-09T23:21:51.999004Z info FLAG: --log_caller="" 2023-03-09T23:21:51.999029Z info FLAG: --log_output_level="default:info" 2023-03-09T23:21:51.999037Z info FLAG: --log_rotate="" 2023-03-09T23:21:51.999046Z info FLAG: --log_rotate_max_age="30" 2023-03-09T23:21:51.999054Z info FLAG: --log_rotate_max_backups="1000" 2023-03-09T23:21:51.999062Z info FLAG: --log_rotate_max_size="104857600" 2023-03-09T23:21:51.999069Z info FLAG: --log_stacktrace_level="default:none" 2023-03-09T23:21:51.999105Z info FLAG: --log_target="[stdout]" 2023-03-09T23:21:51.999118Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2023-03-09T23:21:51.999126Z info FLAG: --outlierLogPath="" 2023-03-09T23:21:51.999133Z info FLAG: --proxyComponentLogLevel="misc:error" 2023-03-09T23:21:51.999141Z info FLAG: --proxyLogLevel="warning" 2023-03-09T23:21:51.999149Z info FLAG: --serviceCluster="istio-proxy" 2023-03-09T23:21:51.999157Z info FLAG: --stsPort="0" 2023-03-09T23:21:51.999164Z info FLAG: --templateFile="" 2023-03-09T23:21:51.999171Z info FLAG: --tokenManagerPlugin="GoogleTokenExchange" 2023-03-09T23:21:51.999194Z info FLAG: --vklog="0" 2023-03-09T23:21:51.999205Z info Version 1.17.0-c8c901a56861021dc25412f2e557b72a235b554c-Clean 2023-03-09T23:21:52.016607Z info Maximum file descriptors (ulimit -n): 1048576 2023-03-09T23:21:52.017019Z info Proxy role ips=[10.233.76.159] type=sidecar id=onap-sdc-onboarding-be-f485b487d-xbnv6.onap domain=onap.svc.cluster.local 2023-03-09T23:21:52.017220Z info Apply proxy config from env {} 2023-03-09T23:21:52.034279Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod.istio-system.svc:15012 drainDuration: 45s proxyAdminPort: 15000 serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s tracing: zipkin: address: zipkin.istio-system:9411 2023-03-09T23:21:52.034408Z info JWT policy is third-party-jwt 2023-03-09T23:21:52.034483Z info using credential fetcher of JWT type in cluster.local trust domain 2023-03-09T23:21:52.157829Z info Workload SDS socket not found. Starting Istio SDS Server 2023-03-09T23:21:52.172246Z info CA Endpoint istiod.istio-system.svc:15012, provider Citadel 2023-03-09T23:21:52.158417Z info Opening status port 15020 2023-03-09T23:21:52.173156Z info Using CA istiod.istio-system.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2023-03-09T23:21:52.401214Z info ads All caches have been synced up in 417.690454ms, marking server ready 2023-03-09T23:21:52.406178Z info xdsproxy Initializing with upstream address "istiod.istio-system.svc:15012" and cluster "Kubernetes" 2023-03-09T23:21:52.407097Z info sds Starting SDS grpc server 2023-03-09T23:21:52.410294Z info starting Http service at 127.0.0.1:15004 2023-03-09T23:21:52.430802Z info Pilot SAN: [istiod.istio-system.svc] 2023-03-09T23:21:52.452767Z info Starting proxy agent 2023-03-09T23:21:52.453259Z info starting 2023-03-09T23:21:52.453805Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields --log-format %Y-%m-%dT%T.%fZ %l envoy %n %g:%# %v thread=%t -l warning --component-log-level misc:error --concurrency 2] 2023-03-09T23:21:52.820941Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-03-09T23:21:53.544674Z info ads ADS: new connection for node:onap-sdc-onboarding-be-f485b487d-xbnv6.onap-1 2023-03-09T23:21:53.544775Z info ads ADS: new connection for node:onap-sdc-onboarding-be-f485b487d-xbnv6.onap-2 2023-03-09T23:21:53.595823Z info cache generated new workload certificate latency=1.192330684s ttl=24h0m0.404197159s 2023-03-09T23:21:53.595887Z info cache Root cert has changed, start rotating root cert 2023-03-09T23:21:53.595913Z info ads XDS: Incremental Pushing:0 ConnectedEndpoints:2 Version: 2023-03-09T23:21:53.596000Z info cache returned workload trust anchor from cache ttl=24h0m0.404006048s 2023-03-09T23:21:53.596060Z info cache returned workload certificate from cache ttl=24h0m0.403944249s 2023-03-09T23:21:53.596595Z info ads SDS: PUSH request for node:onap-sdc-onboarding-be-f485b487d-xbnv6.onap resources:1 size:4.0kB resource:default 2023-03-09T23:21:53.597046Z info cache returned workload trust anchor from cache ttl=24h0m0.40296117s 2023-03-09T23:21:53.597350Z info ads SDS: PUSH request for node:onap-sdc-onboarding-be-f485b487d-xbnv6.onap resources:1 size:1.1kB resource:ROOTCA 2023-03-09T23:21:53.597553Z info cache returned workload trust anchor from cache ttl=24h0m0.402453518s 2023-03-09T23:21:55.387107Z info Readiness succeeded in 3.462031356s 2023-03-09T23:21:55.387721Z info Envoy proxy is ready 2023-03-09T23:23:16.745171Z error Request to probe app failed: Get "http://10.233.76.159:8081/onboarding-api/v1.0/healthcheck": dial tcp 127.0.0.6:0->10.233.76.159:8081: connect: connection refused, original URL path = /app-health/sdc-onboarding-be/startupz app URL path = /onboarding-api/v1.0/healthcheck 2023-03-09T23:23:26.747347Z error Request to probe app failed: Get "http://10.233.76.159:8081/onboarding-api/v1.0/healthcheck": dial tcp 127.0.0.6:0->10.233.76.159:8081: connect: connection refused, original URL path = /app-health/sdc-onboarding-be/startupz app URL path = /onboarding-api/v1.0/healthcheck 2023-03-09T23:23:36.743717Z error Request to probe app failed: Get "http://10.233.76.159:8081/onboarding-api/v1.0/healthcheck": dial tcp 127.0.0.6:0->10.233.76.159:8081: connect: connection refused, original URL path = /app-health/sdc-onboarding-be/startupz app URL path = /onboarding-api/v1.0/healthcheck 2023-03-09T23:24:01.746809Z error Request to probe app failed: Get "http://10.233.76.159:8081/onboarding-api/v1.0/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/sdc-onboarding-be/startupz app URL path = /onboarding-api/v1.0/healthcheck 2023-03-09T23:24:16.747268Z error Request to probe app failed: Get "http://10.233.76.159:8081/onboarding-api/v1.0/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/sdc-onboarding-be/startupz app URL path = /onboarding-api/v1.0/healthcheck 2023-03-09T23:24:31.749117Z error Request to probe app failed: Get "http://10.233.76.159:8081/onboarding-api/v1.0/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/sdc-onboarding-be/startupz app URL path = /onboarding-api/v1.0/healthcheck 2023-03-09T23:24:46.756423Z error Request to probe app failed: Get "http://10.233.76.159:8081/onboarding-api/v1.0/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/sdc-onboarding-be/startupz app URL path = /onboarding-api/v1.0/healthcheck 2023-03-09T23:25:01.769758Z error Request to probe app failed: Get "http://10.233.76.159:8081/onboarding-api/v1.0/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/sdc-onboarding-be/startupz app URL path = /onboarding-api/v1.0/healthcheck 2023-03-09T23:25:16.770275Z error Request to probe app failed: Get "http://10.233.76.159:8081/onboarding-api/v1.0/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/sdc-onboarding-be/startupz app URL path = /onboarding-api/v1.0/healthcheck 2023-03-09T23:25:31.791649Z error Request to probe app failed: Get "http://10.233.76.159:8081/onboarding-api/v1.0/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/sdc-onboarding-be/startupz app URL path = /onboarding-api/v1.0/healthcheck 2023-03-09T23:25:46.794025Z error Request to probe app failed: Get "http://10.233.76.159:8081/onboarding-api/v1.0/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/sdc-onboarding-be/startupz app URL path = /onboarding-api/v1.0/healthcheck 2023-03-09T23:26:01.792747Z error Request to probe app failed: Get "http://10.233.76.159:8081/onboarding-api/v1.0/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/sdc-onboarding-be/startupz app URL path = /onboarding-api/v1.0/healthcheck 2023-03-09T23:26:16.788314Z error Request to probe app failed: Get "http://10.233.76.159:8081/onboarding-api/v1.0/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/sdc-onboarding-be/startupz app URL path = /onboarding-api/v1.0/healthcheck 2023-03-09T23:26:31.814013Z error Request to probe app failed: Get "http://10.233.76.159:8081/onboarding-api/v1.0/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/sdc-onboarding-be/startupz app URL path = /onboarding-api/v1.0/healthcheck 2023-03-09T23:26:46.822957Z error Request to probe app failed: Get "http://10.233.76.159:8081/onboarding-api/v1.0/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/sdc-onboarding-be/startupz app URL path = /onboarding-api/v1.0/healthcheck 2023-03-09T23:27:01.796206Z error Request to probe app failed: Get "http://10.233.76.159:8081/onboarding-api/v1.0/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/sdc-onboarding-be/startupz app URL path = /onboarding-api/v1.0/healthcheck 2023-03-09T23:27:16.812997Z error Request to probe app failed: Get "http://10.233.76.159:8081/onboarding-api/v1.0/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/sdc-onboarding-be/startupz app URL path = /onboarding-api/v1.0/healthcheck 2023-03-09T23:27:31.866291Z error Request to probe app failed: Get "http://10.233.76.159:8081/onboarding-api/v1.0/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/sdc-onboarding-be/startupz app URL path = /onboarding-api/v1.0/healthcheck 2023-03-09T23:27:46.813920Z error Request to probe app failed: Get "http://10.233.76.159:8081/onboarding-api/v1.0/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/sdc-onboarding-be/startupz app URL path = /onboarding-api/v1.0/healthcheck 2023-03-09T23:28:01.815924Z error Request to probe app failed: Get "http://10.233.76.159:8081/onboarding-api/v1.0/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/sdc-onboarding-be/startupz app URL path = /onboarding-api/v1.0/healthcheck 2023-03-09T23:28:16.813851Z error Request to probe app failed: Get "http://10.233.76.159:8081/onboarding-api/v1.0/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/sdc-onboarding-be/startupz app URL path = /onboarding-api/v1.0/healthcheck 2023-03-09T23:28:31.830579Z error Request to probe app failed: Get "http://10.233.76.159:8081/onboarding-api/v1.0/healthcheck": context deadline exceeded (Client.Timeout exceeded while awaiting headers), original URL path = /app-health/sdc-onboarding-be/startupz app URL path = /onboarding-api/v1.0/healthcheck 2023-03-09T23:42:19.026151Z warn xdsproxy upstream [1] terminated with unexpected error rpc error: code = Unavailable desc = closing transport due to: connection error: desc = "error reading from server: read tcp 10.233.76.159:37956->10.233.66.229:15012: read: connection reset by peer", received prior goaway: code: NO_ERROR 2023-03-09T23:42:19.450653Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-03-09T23:42:19.463752Z warn xdsproxy upstream [2] terminated with unexpected error rpc error: code = ResourceExhausted desc = request rate limit exceeded: rate: Wait(n=1) would exceed context deadline 2023-03-09T23:42:19.465966Z warning envoy config external/envoy/source/common/config/grpc_stream.h:185 StreamAggregatedResources gRPC config stream to xds-grpc closed: 8, request rate limit exceeded: rate: Wait(n=1) would exceed context deadline (previously 14, closing transport due to: connection error: desc = "error reading from server: read tcp 10.233.76.159:37956->10.233.66.229:15012: read: connection reset by peer", received prior goaway: code: NO_ERROR since 0s ago) thread=30 2023-03-09T23:42:19.896545Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-03-10T00:09:51.576481Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-03-10T00:37:21.358298Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-03-10T01:10:29.194837Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-03-10T01:43:12.941985Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-03-10T02:11:15.992308Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012 2023-03-10T02:39:02.119478Z info xdsproxy connected to upstream XDS server: istiod.istio-system.svc:15012